Content input method and device and electronic equipment

Abstract

The embodiment of the invention discloses a content input method and device and electronic equipment. The method comprises the following steps: in response to a trigger operation, identifying an input box in a current interface of the electronic equipment, acquiring position information and input box category information of the identified input box, acquiring a target input box from the identified input box based on the position information of the identified input box, and displaying the target input box in the current interface of the electronic equipment. And inputting a target content into the target input box, wherein the target content is a content corresponding to the input box category information of the target input box. Therefore, the acquisition of the target input box, the confirmation of the target content and the input of the target content can be automatically completed, the steps of manual operation of a user are reduced, and the user experience is improved. Moreover, the position information of the input box and the category information of the input box are obtained in an image recognition mode, so that the method and the device can be suitable for more types of interfaces and have better universality.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and more specifically, to a content input method, device and electronic device. Background Art

[0002] Generally, an input box may be provided in the application interface for the user to input relevant information. For example, when the application needs to obtain the user's personal information, an input box may be configured in the application interface of the application so that the user can input the user's personal information in the input box. However, in the related method, the user is required to manually input the relevant content into the input box through the input method, which is time-consuming and leads to poor user experience. Summary of the invention

[0003] In view of the above problems, the present application proposes a content input method, device and electronic device to improve the above problems.

[0004] In a first aspect, the present application provides a content input method, which is applied to an electronic device, and the method includes: in response to a trigger operation, identifying an input box in a current interface of the electronic device, and obtaining position information and input box category information of the identified input box; based on the position information of the identified input box, obtaining a target input box from the identified input box; and inputting target content into the target input box, the target content being content corresponding to the input box category information of the target input box.

[0005] In a second aspect, the present application provides a content input device that runs on an electronic device, the device comprising: an interface recognition unit for identifying an input box in a current interface of the electronic device in response to a trigger operation, an information acquisition unit for acquiring position information and input box category information of the identified input box; a target acquisition unit for acquiring a target input box from the identified input box based on the position information of the identified input box; and a content input unit for inputting target content into the target input box, the target content being content corresponding to the input box category information of the target input box.

[0006] In a third aspect, the present application provides an electronic device comprising one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the above-mentioned method.

[0007] In a fourth aspect, the present application provides a computer-readable storage medium storing a program code executable by a processor, wherein the computer-readable storage medium includes the stored program code, wherein the above method is executed when the program code is run.

[0008] The present application provides a content input method, device and electronic device, which, in response to a trigger operation, identifies an input box in the current interface of the electronic device, identifies the position information and input box category information of the input box in the displayed interface, and then can obtain a target input box from the identified input box based on the position information of the identified input box, so as to input the target content into the target input box, wherein the target content is the content corresponding to the input box category information of the target input box. Thus, through the above-mentioned method, the interface can be image-recognized to obtain the position information and input box category information of the input box in the interface, and then the target to be currently inputted can be determined as the target input box according to the position information of the input box, and then the target content can be obtained according to the input box category information of the target input box, so as to automatically input the target content into the target input box, so that the acquisition of the target input box, the confirmation of the target content and the input of the target content can be automatically completed, thereby reducing the steps of manual operation of the user and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0010] Figure 1 A flow chart of a content input method proposed in an embodiment of the present application is shown;

[0011] Figure 2 A schematic diagram showing an interface displayed by an electronic device in an embodiment of the present application is shown;

[0012] Figure 3 A schematic diagram showing candidate content displayed by an electronic device in an embodiment of the present application;

[0013] Figure 4 A schematic diagram showing pre-entered content stored in an electronic device in an embodiment of the present application is shown;

[0014] Figure 5 A flow chart of a content input method proposed in another embodiment of the present application is shown;

[0015] Figure 6 A flow chart of a content input method proposed in another embodiment of the present application is shown;

[0016] Figure 7 A schematic diagram showing a designated function control displayed by an electronic device in an embodiment of the present application is shown;

[0017] Figure 8 A schematic diagram showing candidate users displayed by an electronic device in an embodiment of the present application is shown;

[0018] Fig. 9 A schematic diagram showing the sorting directions of multiple input boxes in an embodiment of the present application;

[0019] Fig.10 A schematic diagram showing that the values ​​of two input boxes at the same coordinate latitude are the same in an embodiment of the present application;

[0020] Fig.11 A flow chart of a content input method proposed in another embodiment of the present application is shown;

[0021] Fig.12 A flow chart of a content input method proposed in another embodiment of the present application is shown;

[0022] Fig.13 A schematic diagram showing an interface displayed by an electronic device before and after an interface switching operation is performed in an embodiment of the present application;

[0023] Fig.14 A flow chart of a content input method proposed in another embodiment of the present application is shown;

[0024] Fig.15 A structural block diagram of an interface display device proposed in an embodiment of the present application is shown;

[0025] Fig.16 A structural block diagram of an electronic device for executing a content input method according to an embodiment of the present application is shown;

[0026] Fig.17 It is a storage unit of an embodiment of the present application for storing or carrying a program code for implementing a content input method according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0028] In electronic devices, an input box is a control for inputting content. In the application interface of an application, an input box can be set to facilitate users to input content. For example, for some applications, during the account registration process, users are required to enter some personal information (for example, name, gender, address, etc.), then the registration interface of the application will provide a corresponding input box for users to input content.

[0029] However, the inventor found in the research that in the related methods, the user needs to manually input the relevant content into the input box through the input method, which results in a poor user experience. Therefore, the inventor proposes a content input method, device and electronic device in the present application. In the method provided in the present application, the input box in the current interface of the electronic device can be identified in response to a trigger operation to identify the position information of the input box in the displayed interface and the input box category information. Then, based on the position information of the identified input box, a target input box can be obtained from the identified input box to input the target content into the target input box, wherein the target content is the content corresponding to the input box category information of the target input box.

[0030] Therefore, through the above method, it is possible to perform image recognition on the interface to obtain the position information and input box category information of the input box in the interface, and then determine the target for current content input as the target input box according to the position information of the input box, and then obtain the target content according to the input box category information of the target input box to automatically input the target content into the target input box, so that the acquisition of the target input box, the confirmation of the target content and the input of the target content can be completed automatically, thereby reducing the steps of manual operation of the user and improving the user experience.

[0031] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0032] See also Figure 1 The present application provides a content input method, which is applied to an electronic device, and the method includes:

[0033] S110: In response to a trigger operation, identifying an input box in a current interface of the electronic device.

[0034] In the embodiment of the present application, the trigger operation can be understood as an operation that triggers the recognition of the interface currently displayed by the electronic device. There are multiple implementation methods for the trigger operation.

[0035] As a method, the trigger operation may be a click operation. For example, the trigger operation may be a click operation on an input box. The input box may be any input box in the interface, or an input box of a specified category. For example, Figure 2 As shown, in Figure 2 The interface 10 shown includes input boxes B11, B12, B13 and B14. If any of the input boxes B11, B12, B13 and B14 is clicked, image recognition of the interface 10 can be triggered.

[0036] As another way, the trigger operation can be a touch operation acting on a specified function control. The specified function control can be displayed in a floating state on the screen, or in a side toolbar, or in a drop-down toolbar. As another way, the trigger operation can be a voice instruction of specified content. For example, the specified content can be "enter content", "please enter content" or "please fill in content", etc. Among them, the specified content can be configured by the user according to his own operating system.

[0037] In the embodiment of the present application, the interface may be a native interface of the operating system, a web interface, or a cross-platform development interface. For example, when the operating system of the electronic device is an Android system, the native interface may be a native interface of the Android system.

[0038] Among them, identifying the input box in the current interface of the electronic device may include acquiring an image of the interface and then performing content recognition on the image to detect the content included in the image content. For example, detecting the input box included in the image, and then acquiring the position information and input box category information of the input box when the image of the interface is detected to include the input box.

[0039] As a method, a large amount of input box data (for example, tens of thousands of images including input boxes) can be used in advance to train the initial deep learning algorithm model to obtain the target network model. The target network model can output the position information of the input box in the image and the input box category information according to the input image including the input box. In this way, the image of the current interface (the currently displayed interface) can be obtained, and then the image can be input into the target network model to realize the identification of the input box in the current interface of the electronic device. Among them, the position information of the input box is used to characterize the position of the input box in the interface, and the position can be understood as the absolute position of the input box in the interface. Optionally, there can be a corresponding coordinate for each input box identified, and then the coordinate can be used as the position information of the input box. Among them, the coordinates of the input box can be the coordinates of any vertex (the intersection of two sides) of the input box, or the coordinates of the center of the input box.

[0040] It should be noted that the user may need to wait for some time during the process of identifying the interface. In this case, the electronic device can also display a process animation on the screen during the process of identifying the interface to let the user know that it is still in the process of identifying the interface.

[0041] S120: Obtaining position information and input box category information of the identified input box.

[0042] After the electronic device completes the recognition operation on the current interface, the position information of the input box and the category information of the input box obtained through the recognition operation can be obtained.

[0043] S130: Acquire a target input box from the identified input box based on the position information of the identified input box.

[0044] After the position information of the input box in the interface is obtained, the target where content input is required can be determined according to the position information of the input box as the target input box.

[0045] S140: Inputting target content into the target input box, where the target content is content corresponding to the input box category information of the target input box.

[0046] It should be noted that, for the input boxes in the interface, the content used to input each input box corresponds to the input box category information of the input box. For example, the name input box is used to input the user's name. The address input box is used to input the user's address, and the phone input box is used to input the user's phone number. After determining the target input box, the content corresponding to the category can be obtained as the target content according to the input box category information of the target input box, and input into the target input box.

[0047] In the embodiments of the present application, the electronic device may determine the target content in a variety of ways.

[0048] As a method, candidate content corresponding to the input box category information of the target input box can be displayed, and the content selected from the candidate content is used as the target content and input into the target input box. The user can manually select the content from the candidate content as the target content, or the electronic device can select the content from the candidate content as the target content. The candidate content can be the content that the electronic device infers that the user may input. For example, Figure 3 As shown, if the image recognition of the interface 10 is triggered by a click operation on the input box B11, the candidate content can be displayed through the interface 20, wherein the displayed candidate content can include content C1, content C2 and content C3. If content C2 is selected, content C2 can be input as the target content into the target input box (input box B11).

[0049] Optionally, the candidate content may be content recently input by the user, or the candidate content may be content recently input by the user that corresponds to the input box category information of the target input box. The recently input content may be content input in the last day, or content input in the last week, or content input in the last month. Optionally, the candidate content may also be content that has been input a high number of times or a high frequency of input. In this case, the electronic device may count the content input into the input box to count the number of times each input content has been input, and then the number of times each input content has been input may be sorted, and then the multiple input contents with the highest sorting results may be used as candidate content.

[0050] Exemplarily, the electronic device obtains the content that the user has input into the input box in the past, including content C1, content C2, content C3, content C4, and content C5. The corresponding relationship between each historical input content and the number of inputs can be shown in the following Table 1:

[0051] ID Content Information Number of inputs 1 Content C1 10 2 Content C2 1 3 Content C3 8 4 Content C4 7 5 Content C5 5

[0052] Table 1

[0053] As shown in Table 1 above, the number of inputs corresponding to content C1 is 10, the number of inputs corresponding to content C2 is 1, the number of inputs corresponding to content C3 is 8, the number of inputs corresponding to content C4 is 7, and the number of inputs corresponding to content C5 is 5. If the top three input contents in the ranking result are used as candidate contents, then content C1, content C3, and content C4 can be used as candidate contents.

[0054] In addition, illustratively, the corresponding relationship between the content of each historical input and the number of inputs may also be shown in the following Table 2:

[0055] ID Content Information Number of inputs Content Category 1 Content C1 10 Name 2 Content C2 1 Name 3 Content C3 8 Name 4 Content C4 7 Telephone 5 Content C5 5 Telephone

[0056] Table 2

[0057] As shown in Table 2 above, each content information also corresponds to a content category. If the content corresponding to the input box category information of the target input box among the top three input contents in the ranking result is taken as the candidate content, and the input box category information of the target input box is name, then content C1 and content C3 can be taken as candidate content.

[0058] As another method, the pre-stored content of the electronic device may be obtained, and the content corresponding to the input box category information of the target input box in the pre-stored content may be used as the target content and input into the target input box, wherein the pre-stored content includes one or more of identity information, address information, and work information. Optionally, the pre-stored content may be information corresponding to the user of the electronic device, and the pre-stored content may also be information of a user other than the user of the electronic device.

[0059] In this way, the electronic device can pre-store corresponding content for each of the multiple categories of input boxes. Then, when the electronic device needs to obtain candidate content, it can read the content corresponding to the target input box from the pre-stored content as the candidate content. For example, Figure 4 As shown, in Figure 4 The interface 30 shown shows the content that the user has pre-entered into the electronic device for storage. The pre-entered content may include the user's name, phone number, address, ID number and other related information. It should be noted that the category of the content that the user can pre-enter is not specifically limited in the present embodiment of the application. Figure 4 In addition, in addition to entering relevant information about themselves, users can also enter relevant information about other people.

[0060] In an embodiment of the present application, when inputting target content into a target input box, the target content can be input into the target input box by means of simulated operation. The simulated operation can be understood as the electronic device simulating the user's operation, and then the target content is input through the simulated operation so that the user no longer needs to manually input the target content into the target input box through the input method, thereby reducing the user's operation steps. Optionally, the simulated operation method can include an auxiliary input method of an accessibility service in the electronic device.

[0061] It should be noted that some of the content that needs to be entered into the input box may involve the privacy of the user. In order to further enhance the confidentiality of the content and prevent the leakage of privacy-related content, as a way, before entering the target content into the target input box, it can also include: detecting whether the target content includes sensitive information. Sensitive information may include one or more of privacy, secrets, or other content that is generally not suitable for public disclosure. If it is detected that the target content includes sensitive information, identity authentication is triggered. If the identity authentication is successful, the target content is entered into the target input box. Among them, there can be multiple ways to authenticate the user, for example, identity authentication can be performed through a password, identity authentication can also be performed through a fingerprint, and identity authentication can also be performed through a voiceprint.

[0062] In addition, in the embodiment of the present application, the stage of triggering the user identity authentication is not limited to before the target content is input. For example, in response to the trigger operation, the user identity authentication can be performed first, and when the identity authentication is passed, the input box in the current interface of the electronic device can be identified to identify the position information and input box category information of the input box in the displayed interface.

[0063] A content input method provided in this embodiment, in response to a trigger operation, identifies an input box in the current interface of the electronic device, and identifies the position information and input box category information of the input box in the displayed interface. Then, based on the position information of the identified input box, a target input box can be obtained from the identified input box to input the target content into the target input box, wherein the target content is the content corresponding to the input box category information of the target input box. Thus, through the above method, the interface can be image recognized to obtain the position information and input box category information of the input box in the interface, and then the target to be currently inputted can be determined as the target input box according to the position information of the input box, and then the target content can be obtained according to the input box category information of the target input box, so that the target content can be automatically input into the target input box, so that the acquisition of the target input box, the confirmation of the target content and the input of the target content can be automatically completed, thereby reducing the steps of manual operation by the user and improving the user experience. Moreover, in the present application, because the position information and input box category information of the input box are obtained by image recognition, the present application can also be applied to more types of interfaces, thereby having better versatility.

[0064] See also Figure 5 The present application provides a content input method, which is applied to an electronic device, and the method includes:

[0065] S210: In response to a touch operation on the input box, identify the input box in the current interface of the electronic device.

[0066] When a touch operation on the input box is detected, it can be determined that the user has a need to input content, and then the input box included in the interface can be identified. In an embodiment of the present application, when it is detected that a keyboard for content input is displayed in the interface, it can be determined that a touch operation on the input box is present. Alternatively, when it is detected that the process of the input method is called, it can be confirmed that a touch operation on the input box is present. Among them, the touch operation on the input box can include a click operation.

[0067] S220: Obtaining the position information and input box category information of the identified input box.

[0068] S230: Acquire a target input box from the identified input boxes based on the action position information of the touch operation and the position information of the identified input box.

[0069] As a method, the effective position information of the touch operation can be matched with the position information of the recognized input box, and the input box whose position information is successfully matched with the effective position information of the click operation is used as the target input box.

[0070] It should be noted that the input box affected by the touch operation can obtain the input focus. In some cases, the currently displayed interface is not the native interface of the operating system, but may be the interface of a third-party application. In this case, if the user touches the input box, the input box that currently obtains the input focus cannot be directly obtained. In addition, the input box touched by the user can be determined by the position information of the touch operation.

[0071] The position information of the identified input box can be an absolute position in the interface, for example, the position of the input box in the interface can be represented by coordinates. Correspondingly, the effective position information of the touch operation can also be represented by coordinates, and then by matching the effective position information of the touch operation with the position information of the identified input box, the target input box can be obtained.

[0072] The input box whose position information successfully matches the effective position information of the click operation may include an input box whose position information is the same as the effective position information of the click operation. For example, if the situation of the identified input box is as shown in Table 3 below:

[0073] ID Horizontal axis Vertical axis 1 X1 Y1 2 X1 Y2 3 X1 Y3 4 X1 Y4

[0074] Table 3

[0075] As shown in Table 3 above, 4 input boxes are identified from the interface, where the position information of input box B1 is (X1, Y1), the position information of input box B2 is (X1, Y2), the position information of input box B3 is (X1, Y3), and the position information of input box B4 is (X1, Y4). If the position information of the touch operation is (X1, Y1), input box B1 will be used as the target input box.

[0076] In addition, the input box whose position information successfully matches the effective position information of the click operation may also include an input box whose position information is less than the specified difference threshold value. It should be noted that when the number of input boxes included in the interface is large, the spacing between adjacent input boxes will be relatively small, and the smaller the spacing between adjacent input boxes, the easier it is to misidentify the input box clicked by the user. Then as a way, the electronic device can determine the specified difference threshold value according to the number of input boxes included in the interface. For example, if the number of input boxes included in the interface is large, the specified difference threshold value can be smaller, and if the number of input boxes included in the interface is small, the specified difference threshold value can be larger, so that in this way, not only the specified difference threshold value can be configured more flexibly, but also when there are many input boxes in the interface, the probability of misidentifying the target input box can be reduced by configuring a relatively lower specified difference threshold value.

[0077] Optionally, the electronic device may store a correspondence between the number of input boxes and the specified difference threshold. After the number of input boxes in the interface is obtained through image recognition, the specified difference threshold may be determined based on the number of input boxes identified and the correspondence.

[0078] It should be noted that, when there are multiple ways to determine the input box that successfully matches the action position of the click operation, the user can also select an available determination method. As one method, the two options of exact match and quick match can be provided in the electronic device. If the electronic device determines that the user has selected an exact match, the electronic device will determine the target input box in such a way that the corresponding position is the same as the position of the click operation. If the electronic device determines that the user has selected a quick match, the electronic device can simultaneously use the above two methods to determine the target input box to increase the speed of determining the target input box.

[0079] S240: Inputting target content into the target input box, where the target content is content corresponding to the input box category information of the target input box.

[0080] The present embodiment provides a content input method, which responds to a click operation on an input box to trigger image recognition of the interface, so as to obtain the position information of the input box in the interface and the input box category information, and then the position information of the identified input box can be matched with the action position of the click operation to determine the target for the current content input as the target input box, and then obtain the target content according to the input box category information of the target input box, so as to automatically input the target content into the target input box, so that the acquisition of the target input box, the confirmation of the target content and the input of the target content can be completed automatically, thereby reducing the steps of manual operation by the user and improving the user experience. In addition, in the present application, because the position information and the input box category information of the input box are obtained by image recognition, the present application can also be applied to more types of interfaces, and thus has better versatility.

[0081] See also Figure 6 The present application provides a content input method, which is applied to an electronic device, and the method includes:

[0082] S310: In response to a triggering operation, identifying an input box in a current interface of the electronic device.

[0083] In this embodiment, as a method, the trigger operation can be a click operation on a specified function control. The specified function device can be understood as a control for triggering the recognition of the interface to automatically fill in multiple input boxes in the interface. Among them, the specified function control can be displayed in a drop-down toolbar of the electronic device, or the specified function control can be displayed in a side toolbar of the electronic device, or the specified function control can be displayed in a suspended state on the screen. Optionally, the electronic device can respond to a click operation on any input box and display the specified function control in a suspended state on the screen. For example, Figure 7 As shown, if there is a click operation on the input box 11, the specified function control 15 can be displayed in a floating manner. If a click operation on the specified function control 15 is further detected, image recognition of the interface 10 displayed by the electronic device will be started.

[0084] Optionally, if there is a click operation on the input box, the candidate users may be displayed first, and if the target user is determined from the candidate users, the designated function control corresponding to the target user may be displayed in a floating manner. The designated function control corresponding to the target user may be understood as filling the target user's corresponding information into the input box of the interface if the designated function control is clicked. For example, Figure 8 As shown, if there is a click operation on the input box, the candidate users can be displayed through the interface 16, where the candidate users include user 1 and user 2. If user 2 is further clicked, the Figure 8The right image shows the designated function control 17 corresponding to the user 2. If a click operation on the designated function control 17 is further detected, the interface 10 displayed by the electronic device will begin to be image recognized, and the information of the user 2 will be filled into the subsequently recognized input box.

[0085] Among them, the candidate user can be a user of the electronic device pre-entered into the electronic device. In this case, the electronic device can read the pre-entered user as the candidate user. It should be noted that while entering the user into the electronic device, the relevant information corresponding to the user can also be entered simultaneously, so that when the candidate user is determined as the target user, the input box in the interface can be directly filled based on the relevant information of the target user.

[0086] In addition, in this embodiment, the electronic device may also directly respond to a click operation on any input box and start to recognize the input box in the current interface of the electronic device.

[0087] S320: If the number of input boxes recognized in the current interface is greater than or equal to 2, sort the input boxes based on the position information of the recognized input boxes to obtain a sorting result.

[0088] In an embodiment of the present application, when multiple input boxes are identified from the interface (the number of input boxes is greater than or equal to 2), the multiple input boxes can also be sorted based on the position information of the multiple input boxes identified, so that content can be input into the multiple input boxes in sequence according to the sorting results.

[0089] As a method, the identified multiple input boxes can be sorted based on the position information of the identified multiple input boxes and the specified direction to obtain a sorting result. Based on the sorting result, the target input box corresponding to the current input process is selected from the identified input boxes, wherein the sorting of the target input box corresponding to the next input process is adjacent to the sorting of the target input box corresponding to the previous input process and is after the sorting of the target input box corresponding to the previous input process.

[0090] For example, four input boxes are identified from the interface, among which the position information of input box B1 is (X1, Y1), the position information of input box B2 is (X1, Y2), the position information of input box B3 is (X1, Y3), and the position information of input box B4 is (X1, Y4). If the four input boxes are sorted based on the specified direction, the sorting results may be as follows:

[0091] Input box B1<Input box B2<Input box B3<Input box B4

[0092] Among them, input box B1 is sorted at the front, and input box B4 is sorted at the end. In this case, in the first input process, input box B1 will be first obtained as the target input box corresponding to the first input process, and then the target content corresponding to the first input process will be determined according to the category of input box B1, so as to input the target content corresponding to the first input process into input box B1. Among them, after determining that input box B1 is the target input box, input box B1 can be clicked through the auxiliary click function of the barrier-free service, so that input box B1 can obtain the input focus, and then the target content can be input into input box B1 through the auxiliary input method of the barrier-free service. After completing the input of input box B1, the second input process will be entered. Among them, input box B2 is adjacent to input box B1 and sorted after input box B1, and then input box B2 will be used as the target input box corresponding to the second input process, and so on, then the content input of input box B2, input box B3 and input box B4 can be completed.

[0093] Among them, the specified method referred to when sorting multiple input boxes can be the direction from the top to the bottom of the screen, or the direction from the bottom to the top of the screen. In this way, when filling in multiple input boxes in the interface, they can be filled according to certain rules, which is conducive to improving the user experience.

[0094] It should be noted that the position information of the input box can be represented by coordinates, and the coordinates can include values ​​of two dimensions, for example, values ​​of the horizontal coordinate and the vertical coordinate. When sorting multiple input boxes, the size of the values ​​of the multiple input boxes in the same dimension is used as a reference for sorting. For example, Fig. 9 As shown, Y represents the ordinate and X represents the abscissa. In this case, the input boxes can be sorted in descending order based on the value of the ordinate. However, in some cases, there may be at least two input boxes with the same value in the same dimension. For example, Fig.10 As shown, the values ​​of input boxes 41 and 42 in the ordinate dimension in the interface 40 are the same. If multiple input boxes are sorted based on the ordinate dimension, the sorting results of input boxes 41 and 42 will be the same. In this case, the sorting of input boxes 41 and 42 can be determined in combination with the value of another dimension. For example, the sorting of multiple input boxes with the same ordinate can be further determined based on the values ​​of the abscissas of the multiple input boxes with the same ordinate.

[0095] In addition, in an embodiment of the present application, multiple input boxes can also be sorted based on the position information of the identified multiple input boxes and the input box category information. Optionally, the multiple input boxes can be preliminarily sorted based on the position information of the multiple input boxes, and after obtaining the preliminary sorting result, the preliminary input result is adjusted in combination with the input box category information of the multiple input boxes to obtain the sorting result. Among them, adjusting the preliminary sorting result can include making the sorting of input boxes of similar categories adjacent. Among them, the input boxes of similar categories can be input boxes with the same content in the category name, or the input boxes of similar categories can be input boxes with semantically similar category names.

[0096] It should be noted that when there are multiple input boxes in the interface currently displayed by the electronic device, it is not necessary to fill in each input box. For example, the categories that need to be filled can be stored in advance. In this case, when the interface is subjected to image recognition, only the input boxes of the categories that need to be filled can be filled with content. Among them, the categories that need to be filled can be defined by the user. In addition, the categories that need to be filled can be stored locally in the electronic device, or they can be stored in the cloud after being associated with the user account. In addition, the categories that need to be filled can also be stored locally in the electronic device and synchronously stored in the cloud. In this case, if the electronic device or the cloud updates the categories that need to be filled, the update results can be synchronized to the other end to keep the categories that need to be filled stored locally in the electronic device and in the cloud consistent.

[0097] S330: Filling the target contents corresponding to the target input boxes into the target input boxes in order based on the sorting result.

[0098] Among them, in the process of filling the target content in multiple target input boxes respectively based on the sorting results, the multiple target input boxes can be filled in multiple times. Among them, each process of inputting the target content into the target input box can be understood as an input process. Optionally, the target input box corresponding to the Nth input process can be clicked by means of a simulated operation to obtain the input focus corresponding to the Nth input process. Then, the target content corresponding to the Nth input process is input into the target input box corresponding to the input focus by means of a simulated operation, where N is a natural number greater than or equal to 1. Afterwards, the target input box corresponding to the N+1th input process can also be clicked by means of a simulated operation to obtain the input focus corresponding to the N+1th input process. By means of a simulated operation, the target content corresponding to the N+1th input process is input into the target input box corresponding to the input focus.

[0099] Among them, in the current input process, the target input box corresponding to the current input process is clicked by means of simulated operation, so that the target input box corresponding to the current input process obtains input focus, and the target content corresponding to the current input process is input into the target input box that obtains the input focus by means of simulated operation. Optionally, the simulated operation method includes the auxiliary click function of the barrier-free service. In this way, the target input box corresponding to the current input process can be clicked by means of the auxiliary click function of the barrier-free service, so that the target input box corresponding to the current input process obtains input focus. Optionally, the simulated operation method can also include the auxiliary input method of the barrier-free service, and then the target content corresponding to the current input process can be input into the target input box that obtains input focus by means of the auxiliary input method of the barrier-free service. It should be noted that the auxiliary input method of the barrier-free service can be to directly input content (for example, target content) into the input focus, then by clicking the target input box by means of the auxiliary click function of the barrier-free service, the target input box can obtain input focus, so that the target content can be successfully input into the target input box.

[0100] As a way, Fig.11 As shown, the steps of the content input method provided in the embodiment of the present application also include:

[0101] S331: In response to a trigger operation, identifying an input box in a current interface of the electronic device.

[0102] S332: Obtain the position information and input box category information of the identified input box.

[0103] S333: Based on the position information of the identified input box, obtain a target input box from the identified input box.

[0104] S334: By means of a simulation operation, a target input box corresponding to the Nth input process is clicked to obtain an input focus corresponding to the Nth input process.

[0105] S335: Inputting the target content corresponding to the Nth input process into the target input box corresponding to the input focus by means of simulation operation, where N is a natural number greater than or equal to 1.

[0106] S336: By means of a simulation operation, the target input box corresponding to the N+1th input process is clicked to obtain the input focus corresponding to the N+1th input process.

[0107] S337: Input the target content corresponding to the N+1th input process into the target input box corresponding to the input focus by means of a simulated operation.

[0108] In this embodiment, the target input box may be clicked by simulating a click operation, or the target content may be input into the target input box by simulating filling.

[0109] This embodiment provides a content input method, so that the acquisition of the target input box, the confirmation of the target content, and the input of the target content can be automatically completed in the above manner, thereby reducing the steps of manual operation by the user and improving the user experience. Moreover, in the present application, because the position information and the category information of the input box are obtained by image recognition, the present application can also be applied to more types of interfaces, thereby having better versatility. Moreover, in the present embodiment, when there are multiple input boxes identified, the content can be automatically input into the multiple input boxes in sequence, thereby realizing one-click filling of multiple input boxes in the interface.

[0110] See also Fig.12 The present application provides a content input method, which is applied to an electronic device, and the method includes:

[0111] S410: In response to the interface switching operation, identifying an input box in the current interface of the electronic device.

[0112] Among them, the interface switching operation can be understood as the operation of performing interface switching. It should be noted that in some cases, if there are many input boxes that need to be input, the multiple input boxes can be displayed in multiple interfaces. In this case, after completing the content input in the input box in the interface currently displayed by the electronic device, it is necessary to trigger the interface switching operation to trigger the display of the remaining input boxes. For example, Fig.13 As shown, the interface displayed on the electronic device is as follows Fig.10 In the case shown in the left image, if the interface switching operation is performed, the interface displayed after the interface switching operation is performed can be Fig.10 The interface shown on the right.

[0113] It should be noted that some interfaces may not support interface switching. For example, an interface that is already the last page, or an interface that only has one page. Fig.13 , Fig.13 The interface shown in the image on the right is the last page. If you continue to display Fig.13In the case of the interface shown in the image on the right, if the interface switching operation is triggered, the interface displayed by the electronic device will not change. Therefore, after the electronic device performs the interface switching operation, the displayed interface may be completely different from the content in the interface before the switch, or it may be partially the same, or it may be completely the same. Then as a method, in response to the interface switching operation, the similarity between the current interface of the electronic device and the interface before the interface switching operation is performed can be obtained, and if the similarity is less than or equal to the similarity threshold, the current interface of the electronic device is identified.

[0114] It should be noted that if the interface displayed after the electronic device performs an interface switching operation has a high degree of similarity with the interface displayed before the interface switching operation is performed, for example, the similarity is greater than the similarity threshold, then it means that the interface displayed by the electronic device before the interface switching operation is performed does not support interface switching. Correspondingly, if the interface displayed after the electronic device performs an interface switching operation has a low degree of similarity with the interface displayed before the interface switching operation is performed, for example, the similarity is less than or equal to the similarity threshold, then it means that there are unfilled input boxes in the interface displayed after the interface switching operation is performed, and image recognition of the interface can be performed again to fill the unfilled input boxes.

[0115] In the embodiment of the present application, the interface switching operation can be performed manually by the user or simulated by the electronic device. Among them, the user's manual operation steps can be reduced by simulating the execution by the electronic device, so as to further improve the intelligence level in the process of content input.

[0116] S420: Obtaining the position information and input box category information of the identified input box.

[0117] S430: Acquire a target input box from the identified input box based on the position information of the identified input box.

[0118] S440: Inputting target content into the target input box, the target content being content corresponding to the input box category information of the target input box.

[0119] It should be noted that the interface switching operation in the embodiment of the present application may be triggered after the electronic device has performed image recognition on the interface once, for example, Fig.14 As shown, a content input method provided by an embodiment of the present application may include:

[0120] S441: In response to a trigger operation, identifying an input box in a current interface of the electronic device to identify position information and input box category information of the input box in the displayed interface.

[0121] S442: acquiring a target input box from the identified input box based on the position information of the identified input box;

[0122] S443: Input the target content into the target input box, where the target content is the content corresponding to the input box category information of the target input box.

[0123] S444: In response to the interface switching operation, image recognition is performed on the interface displayed after the electronic device performs the interface switching operation to identify position information and input box category information of the input box in the displayed interface.

[0124] After executing S444, the identified input boxes can be filled in based on the method provided by the aforementioned content. In addition, after executing S444 once, S444 can be executed again until the content input to all input boxes is completed.

[0125] The present embodiment provides a content input method, so that the acquisition of the target input box, the confirmation of the target content, and the input of the target content can be completed automatically, thereby reducing the steps of manual operation by the user and improving the user experience. Moreover, in the present application, because the position information and the category information of the input box are obtained by image recognition, the present application can also be applied to more types of interfaces, thereby having better versatility. Moreover, in the present embodiment, the electronic device can identify the currently displayed interface in response to the interface switching operation trigger, so that when content input needs to be performed across interfaces, the electronic device can still execute automatically, avoiding the user from manually turning pages, thereby further improving the user experience.

[0126] See also Fig.15 The present application provides a content input device 500, which runs on an electronic device. The device 500 includes:

[0127] The interface recognition unit 510 is used to recognize an input box in the current interface of the electronic device in response to a trigger operation.

[0128] As a method, the interface recognition unit 510 is specifically used to perform image recognition on the interface displayed after the electronic device performs the interface switching operation in response to the interface switching operation, so as to identify the position information and input box category information of the input box in the displayed interface.

[0129] Optionally, the interface identification unit 510 is specifically used to obtain the similarity between the current interface of the electronic device and the interface before performing the interface switching operation in response to the interface switching operation. If the similarity is less than or equal to the similarity threshold, the current interface of the electronic device is identified.

[0130] The information acquisition unit 520 is used to acquire the position information and input box category information of the identified input box.

[0131] The target acquisition unit 530 is configured to acquire a target input box from the identified input box based on the position information of the identified input box.

[0132] The content input unit 540 is used to input target content into the target input box, where the target content is content corresponding to the input box category information of the target input box.

[0133] As one mode, the trigger operation includes a click operation acting on the input box. In this mode, the target acquisition unit 530 is specifically used to match the action position of the click operation with the position information of the identified input box; and the input box whose position information successfully matches the action position information of the click operation is used as the target input box.

[0134] As one approach, the content input unit 540 is specifically configured to display candidate content corresponding to the input box category information of the target input box; and to input the content selected from the candidate content as the target content into the target input box.

[0135] As a method, the content input unit 540 is specifically used to obtain content pre-stored in the electronic device, and the pre-stored content corresponds to the user of the electronic device; the content in the pre-stored content corresponding to the input box category information of the target input box is used as the target content and input into the target input box.

[0136] As a method, the content input unit 540 is specifically used to input the target content into the target input box through the auxiliary input method of the barrier-free service in the electronic device.

[0137] As a method, there are multiple input boxes identified. In this method, the target acquisition unit 530 is specifically used to select the target input box corresponding to the current input process from the identified input boxes based on the position information of the multiple input boxes identified. Correspondingly, the content input unit 540 is specifically used to input the target content corresponding to the current input process into the target input box corresponding to the current input process, and perform the next input process.

[0138] Optionally, the target acquisition unit 530 is specifically used to sort the multiple identified input boxes based on the position information and the specified direction of the multiple identified input boxes to obtain a sorting result; based on the sorting result, select the target input box corresponding to the current input process from the identified input boxes, wherein the sorting of the target input box corresponding to the subsequent input process is adjacent to the sorting of the target input box corresponding to the previous input process, and is after the sorting of the target input box corresponding to the previous input process.

[0139] Optionally, the content input unit 540 is specifically used to click the target input box corresponding to the current input process through the auxiliary click function of the accessibility service, so that the target input box corresponding to the current input process obtains the input focus; through the auxiliary input method of the accessibility service, the target content corresponding to the current input process is input into the target input box that obtains the input focus.

[0140] Optionally, the trigger operation includes: a click operation on an input box in the displayed interface; or a touch operation on a displayed specified function control; or a voice control instruction of specified content.

[0141] As a method, the content input unit 540 is also used to trigger identity authentication if it is detected that the target content is private content; if the identity authentication is successful, the target content is input into the target input box.

[0142] The present embodiment provides a content input device, through which the position information and the category information of the input box in the interface can be obtained by image recognition of the interface, and then the target to be currently inputted can be determined as the target input box according to the position information of the input box, and then the target content can be obtained according to the input box category information of the target input box, so as to automatically input the target content into the target input box, so that the acquisition of the target input box, the confirmation of the target content and the input of the target content can be completed automatically, thereby reducing the steps of manual operation by the user and improving the user experience. Moreover, in the present application, because the position information and the category information of the input box are obtained by image recognition, the present application can also be applied to more types of interfaces, thereby having better versatility.

[0143] It should be noted that the device embodiments in the present application correspond to the aforementioned method embodiments, and the specific implementation principles of each unit in the device embodiments are similar to the principles in the aforementioned method embodiments. The specific contents in the device embodiments can be found in the method embodiments, and will not be repeated in the device embodiments.

[0144] The following will be combined Fig.16 An electronic device provided by the present application is described.

[0145] See also Fig.16Based on the above content input method and device, the embodiment of the present application also provides an electronic device 1000 that can execute the above content input method. The electronic device 1000 includes one or more (only one is shown in the figure) processors 105, a memory 104, an audio playback module 106 and an audio acquisition device 108 that are coupled to each other. Among them, the memory 104 stores a program that can execute the content of the above embodiment, and the processor 105 can execute the program stored in the memory 104.

[0146] Among them, the processor 105 may include one or more processing cores. The processor 105 uses various interfaces and lines to connect various parts of the entire electronic device 1000, and executes various functions and processes data of the electronic device 1000 by running or executing instructions, programs, code sets or instruction sets stored in the memory 104, and calling data stored in the memory 104. Optionally, the processor 105 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 105 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 105, but may be implemented separately through a communication chip.

[0147] The memory 104 may include a random access memory (RAM) or a read-only memory (ROM). The memory 104 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 104 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc.

[0148] Furthermore, in addition to the aforementioned components, the electronic device 1000 may further include a network module 110 and a sensor module 112 .

[0149] The network module 110 is used to realize information interaction between the electronic device 1000 and other devices. For example, a connection can be established with other audio playback devices or other electronic devices, and information interaction is performed based on the established connection. As a way, the network module 110 of the electronic device 1000 is a radio frequency module, which is used to receive and send electromagnetic waves, realize the mutual conversion of electromagnetic waves and electrical signals, and thus communicate with a communication network or other devices. The radio frequency module may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity modules (SIM) cards, memories, etc. For example, the radio frequency module can interact with external devices through electromagnetic waves sent or received.

[0150] The sensor module 112 may include at least one sensor. Specifically, the sensor module 112 may include but is not limited to: a pressure sensor, a motion sensor, an acceleration sensor, and other sensors.

[0151] Among them, the pressure sensor may be a sensor that detects the pressure generated by pressing on the electronic device 1000. That is, the pressure sensor detects the pressure generated by contact or pressing between the user and the electronic device 1000, for example, the pressure generated by contact or pressing between the user's ear and the electronic device 1000. Therefore, the pressure sensor can be used to determine whether contact or pressing occurs between the user and the electronic device 1000, and the magnitude of the pressure.

[0152] Among them, the acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary, and can be used for applications that recognize the posture of the electronic device 1000 (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. In addition, the electronic device 1000 can also be equipped with other sensors such as gyroscopes, barometers, hygrometers, thermometers, etc., which will not be repeated here.

[0153] The audio collection device 110 is used to collect audio signals. Optionally, the audio collection device 110 includes a plurality of audio collection devices, which may be microphones.

[0154] Please refer to Fig.17 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 1100 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0155] The computer readable storage medium 1100 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 1100 includes a non-transitory computer-readable storage medium. The computer readable storage medium 1100 has storage space for program code 1110 that executes any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 1110 can be compressed, for example, in an appropriate form.

[0156] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0157] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0158] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0159] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, which can be embodied in any computer-readable medium for use by an instruction execution system, apparatus or device (such as a computer-based system, a system including a processor or other system that can fetch instructions from an instruction execution system, apparatus or device and execute instructions), or used in combination with these instruction execution systems, apparatuses or devices.

[0160] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0161] In summary, the present application provides a content input method, device and electronic device, which, in response to a trigger operation, identifies an input box in the current interface of the electronic device, identifies the position information and input box category information of the input box in the displayed interface, and then can obtain a target input box from the identified input box based on the position information of the identified input box, so as to input the target content into the target input box, wherein the target content is the content corresponding to the input box category information of the target input box. Thus, through the above-mentioned method, the interface can be image-recognized to obtain the position information and input box category information of the input box in the interface, and then the target to be currently inputted can be determined as the target input box according to the position information of the input box, and then the target content is obtained according to the input box category information of the target input box, so as to automatically input the target content into the target input box, so that the acquisition of the target input box, the confirmation of the target content and the input of the target content can be automatically completed, thereby reducing the steps of manual operation by the user and improving the user experience. Moreover, in the present application, because the position information and input box category information of the input box are obtained by image recognition, the present application can also be applied to more types of interfaces, thereby having better versatility.

[0162] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical feature diagrams therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A content input method, It is characterized in that Applied to electronic equipment, the method comprises: In response to a trigger operation, identifying an input box in a current interface of the electronic device; Obtaining the position information and input box category information of the identified input box; Based on the position information of the identified input box, obtaining a target input box from the identified input box; A target content is input into the target input box, wherein the target content is content corresponding to the input box category information of the target input box.

2. The method according to claim 1, It is characterized in that The trigger operation includes a touch operation acting on the input box, and acquiring a target input box from the identified input box based on the position information of the identified input box includes: Based on the action position information of the touch operation and the position information of the identified input box, a target input box is obtained from the identified input box.

3. The method according to claim 1, It is characterized in that The step of inputting the target content into the target input box includes: Display candidate content corresponding to the input box category information of the target input box; The content selected from the candidate content is used as the target content and input into the target input box.

4. The method according to claim 1, It is characterized in that The step of inputting the target content into the target input box includes: Acquiring content pre-stored in the electronic device; The content corresponding to the input box type information of the target input box among the pre-stored content is used as the target content and input into the target input box.

5. The method according to claim 3, It is characterized in that The pre-stored content includes one or more of identity information, address information, and work information.

6. The method according to any one of claims 1 to 5, It is characterized in that The step of inputting the target content into the target input box includes: The target content is input into the target input box by means of simulated operation.

7. The method according to claim 1, It is characterized in that The acquiring a target input box from the identified input box based on the position information of the identified input box includes: If the number of input boxes identified in the current interface is greater than or equal to 2, sorting the input boxes based on the position information of the identified input boxes to obtain a sorting result; The inputting the target content into the target input box comprises: Based on the sorting result, the target contents corresponding to the target input boxes are filled into the target input boxes in sequence.

8. The method according to claim 1, It is characterized in that The inputting the target content into the target input box comprises: By simulating the operation, click the target input box corresponding to the Nth input process to obtain the input focus corresponding to the Nth input process; By means of simulation operation, the target content corresponding to the Nth input process is input into the target input box corresponding to the input focus, where N is a natural number greater than or equal to 1.

9. The method according to claim 8, It is characterized in that After inputting the target content corresponding to the Nth input process into the target input box corresponding to the input focus in the manner of simulating the filling operation, the following further comprises: By means of simulation operation, click the target input box corresponding to the N+1th input process to obtain the input focus corresponding to the N+1th input process; By means of simulated operation, the target content corresponding to the N+1th input process is input into the target input box corresponding to the input focus.

10. The method according to claim 1, It is characterized in that The triggering operation includes: A click operation on an input box in the displayed interface; or A touch operation on a displayed control of a specified function; or Specifies the voice control command for the content.

11. The method according to claim 10, It is characterized in that The designated function control is displayed in suspension on the screen; or The designated function control is displayed in a side toolbar; or The designated function control is displayed in a drop-down toolbar.

12. The method according to claim 1, It is characterized in that The step of identifying an input box in a current interface of the electronic device in response to a trigger operation includes: In response to the interface switching operation, an input box in the current interface of the electronic device is identified.

13. The method according to claim 12, It is characterized in that The step of identifying an input box in a current interface of the electronic device in response to an interface switching operation includes: In response to an interface switching operation, obtaining a similarity between a current interface of the electronic device and an interface before the interface switching operation is performed; If the similarity is less than or equal to the similarity threshold, the current interface of the electronic device is identified.

14. The method according to claim 12, It is characterized in that The step of identifying an input box in a current interface of the electronic device in response to an interface switching operation includes: In response to an interface switching operation triggered by a user, identifying an input box in a current interface of the electronic device; or In response to an interface switching operation triggered by the electronic device through a simulation operation, an input box in a current interface of the electronic device is identified.

15. The method according to claim 1, It is characterized in that Before inputting the target content into the target input box, the method further includes: If it is detected that the target content includes sensitive information, it triggers authentication; If the identity authentication is successful, the target content is input into the target input box.

16. A content input device, It is characterized in that Running on an electronic device, the device comprises: An interface recognition unit, configured to recognize an input box in a current interface of the electronic device in response to a trigger operation; An information acquisition unit, used to acquire the position information and input box category information of the identified input box; a target acquisition unit, configured to acquire a target input box from the identified input box based on the position information of the identified input box; The content input unit is used to input target content into the target input box, where the target content is content corresponding to the input box category information of the target input box.

17. An electronic device, It is characterized in that including one or more processors and memory; One or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1 to 15.

18. A computer-readable storage medium storing a program code executable by a processor, It is characterized in that The computer-readable storage medium includes stored program code, wherein when the program code is executed, the method according to any one of claims 1 to 15 is executed.

Images