An interface operation method, device, equipment, terminal and storage medium

Abstract

An embodiment of the present application provides an interface operation method, device, electronic device, intelligent terminal, and computer storage medium. The method is applied to an intelligent terminal including an operation interface, and the method includes: after receiving an enabling instruction for a visual impairment assistance function from a user, generating an operation graphic on the operation interface; taking a screenshot of the current operation graphic to obtain a first picture when the operation graphic is dragged to a target position; performing a zoom operation on the content in the first picture to obtain a second picture; receiving a first click operation on a target content in the second picture by the user, and performing a corresponding delegation operation according to the first click operation.

Description

Technical Field

[0001] This application relates to the technical field of intelligent terminals, and in particular, to an interface operation method, apparatus, electronic device, intelligent terminal, and computer storage medium. Background Art

[0002] With the development of technology, smart phones have become an essential part of people's lives. People can use smart phones to read news, buy tickets, make payments, shop, etc., making life more convenient and improving the quality of life.

[0003] However, a considerable number of elderly people have become marginalized from smart phones. These elderly people hold smart phones, but the functions therein have become mere decorations. They may probably only use them for making calls and sending and receiving messages, and do not enjoy the convenience brought by smart phones. Most of the reasons for the above situation are that due to visual impairments, the elderly cannot see the text on the phone interface clearly, resulting in inconvenient operation for the elderly. It can be seen that how to help the elderly with visual impairments solve the problem of inconvenient operation of the phone interface is an urgent problem to be solved. Summary of the Invention

[0004] This application provides an interface operation method, apparatus, electronic device, intelligent terminal, and computer storage medium.

[0005] The technical solution of this application is implemented as follows:

[0006] An embodiment of this application provides an interface operation method, which is applied to an intelligent terminal including an operation interface. The method includes:

[0007] After receiving an enabling instruction from the user for the visually impaired assistance function, generate an operation graphic on the operation interface;

[0008] When the operation graphic is dragged to a target position, take a screenshot of the current operation graphic to obtain a first picture; perform a zoom operation on the content in the first picture to obtain a second picture;

[0009] Receive a first click operation from the user on the target content in the second picture, and perform a corresponding delegation operation according to the first click operation.

[0010] In some embodiments, the method further includes:

[0011] After receiving a second click operation from the user on the second picture, transform the shape of the current operation graphic to obtain a transformed operation graphic;

[0012] Take a screenshot of the transformed operation graphic to obtain a target picture;

[0013] Identify the target picture to obtain an identification result;

[0014] Process the identification result in a set manner.

[0015] In some embodiments, the method further includes:

[0016] After transforming the shape of the current operation graphic, generate a quick operation item on the operation interface; the quick operation item includes at least one of: reading text, searching, and canceling;

[0017] The processing the identification result in a set manner includes:

[0018] Process the identification result according to the quick operation item.

[0019] In some embodiments, the method further includes:

[0020] Obtain the distance between the user and the operation interface;

[0021] When it is determined that the distance does not meet the set requirements, prompt the user to turn on the visual impairment assistance function.

[0022] In some embodiments, the prompting the user to turn on the visual impairment assistance function includes:

[0023] Prompt the user to turn on the visual impairment assistance function by voice.

[0024] In some embodiments, when the operation graphic is dragged to the target position, taking a screenshot of the current operation graphic includes:

[0025] Obtain the duration after the operation graphic is dragged to the target position, and take a screenshot of the current operation graphic when the duration is greater than the set time.

[0026] In some embodiments, the activation instruction is generated after receiving the user's shaking operation on the intelligent terminal.

[0027] An embodiment of the present application also proposes an interface operation device, which is applied to an intelligent terminal including an operation interface. The device includes a generation module, a obtaining module, and an execution module, where,

[0028] The generation module is configured to generate an operation graphic on the operation interface after receiving an activation instruction for the visual impairment assistance function from the user;

[0029] A obtaining module, configured to take a screenshot of the current operation graphic to obtain a first picture when the operation graphic is dragged to a target position; and perform a zoom operation on the content in the first picture to obtain a second picture.

[0030] An execution module, configured to receive a first click operation of the user on target content in the second picture, and perform a corresponding entrusted operation according to the first click operation.

[0031] An embodiment of the present application provides an electronic device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it implements the interface operation method provided by the foregoing one or more technical solutions.

[0032] An embodiment of the present application provides an intelligent terminal, which includes the foregoing interface operation device or the foregoing electronic device.

[0033] An embodiment of the present application provides a computer storage medium, which stores a computer program; after the computer program is executed, it can implement the interface operation method provided by the foregoing one or more technical solutions.

[0034] An embodiment of the present application proposes an interface operation method, device, electronic device, intelligent terminal, and computer storage medium. The method is applied to an intelligent terminal including an operation interface. The method includes: after receiving an enabling instruction of the visual impairment assistance function from the user, generating an operation graphic on the operation interface; taking a screenshot of the current operation graphic to obtain a first picture when the operation graphic is dragged to a target position; performing a zoom operation on the content in the first picture to obtain a second picture; receiving a first click operation of the user on target content in the second picture, and performing a corresponding entrusted operation according to the first click operation.

[0035] It can be seen that after the visual impairment assistance function is enabled in the embodiment of the present application, the user can freely drag the generated operation graphic on the operation interface, and take a screenshot of the operation graphic when the operation graphic is dragged to the target position; at this time, according to the user's needs, the content in the screenshot can be enlarged or reduced for display; that is, the content in the operation graphic can be adaptively adjusted; and when receiving the click operation of the user, a corresponding entrusted operation can be performed, that is, it will not affect the user's operation of the interface. In this way, problems such as the elderly being unable to see the interface text clearly due to visual impairment and unable to click on the target in the click area can be solved, and the convenience of the elderly in operating the interface of an intelligent terminal (such as a smart phone) can be improved. Description of the Drawings

[0036] Figure 1AIt is a schematic flowchart of an interface operation method in an embodiment of the present application;

[0037] Figure 1B It is a schematic diagram of a scenario for generating an opening instruction by shaking left and right in an embodiment of the present application;

[0038] Figure 1C It is a schematic diagram of a scenario for generating an operation graphic and a multiple option on an operation interface in an embodiment of the present application;

[0039] Figure 1D It is a schematic flowchart of a process for prompting a user to enable a visual impairment assistance function in an embodiment of the present application;

[0040] Figure 2A It is another schematic flowchart of an interface operation in an embodiment of the present application;

[0041] Figure 2B It is a schematic diagram of a scenario for generating a quick operation item on an operation interface in an embodiment of the present application;

[0042] Figure 3 It is a schematic diagram of the composition structure of an interface operation device in an embodiment of the present application;

[0043] Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Detailed implementation manners

[0044] The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the embodiments provided herein are only used to explain the present application and are not used to limit the present application. In addition, the embodiments provided below are partial embodiments for implementing the present application, rather than all embodiments for implementing the present application. Without conflict, the technical solutions described in the embodiments of the present application can be implemented in any combined manner.

[0045] It should be noted that in the embodiments of the present application, the term "comprising", "including" or any other variant thereof is intended to cover a non-exclusive inclusion, so that a method or device including a series of elements not only includes the clearly recited elements, but also includes other elements not explicitly listed, or further includes elements inherent to the implementation of the method or device. Without further limitation, an element defined by the statement "including one..." does not exclude the existence of other related elements in the method or device including the element (such as steps in a method or units in a device, and the unit can be a part of a circuit, a part of a processor, a part of a program or software, etc.).

[0046] As used herein, the term "and / or" is merely a description of the relationship between associated objects, indicating that there can be three relationships. For example, I and / or J can represent three cases: I exists alone, I and J exist simultaneously, and J exists alone. Additionally, the term "at least one" as used herein means any one of a plurality or any combination of at least two of a plurality. For example, including at least one of I, J, and R can mean including any one or more elements selected from the set consisting of I, J, and R.

[0047] For example, the interface operation method provided by an embodiment of the present application includes a series of steps. However, the interface operation method provided by the embodiment of the present application is not limited to the recorded steps. Similarly, the interface operation device provided by the embodiment of the present application includes a series of modules. However, the interface operation device provided by the embodiment of the present application is not limited to including the explicitly recorded modules, and may also include modules required for obtaining relevant task data or processing based on task data.

[0048] Embodiments of the present application can be applied to a computer system composed of a terminal device and a server, and can operate together with many other general or special computing system environments or configurations. Here, the terminal device can be a thin client, a thick client, a handheld or laptop device, a microprocessor-based system, a set-top box, a programmable consumer electronics product, a network personal computer, a small computer system, etc. The server can be a small computer system, a large computer system, and a distributed cloud computing technology environment including any of the above systems, etc.

[0049] Electronic devices such as terminal devices and servers can achieve corresponding functions through the execution of program modules. Generally, program modules can include routines, programs, object programs, components, logics, data structures, etc., which perform specific tasks or implement specific abstract data types. The computer system / server can be implemented in a distributed cloud computing environment, where tasks are executed by remote processing devices linked through a communication network. In a distributed cloud computing environment, program modules can be located on local or remote computing system storage media including storage devices.

[0050] In the related art, it is extremely difficult for the elderly to learn the operation interface of a smart phone in terms of text size and color, and operation. Although many senior universities also offer courses related to the operation of smart phones, many elderly people with visual impairments still have difficulty learning. This is largely because the text is small and the clickable area is small, causing inconvenience to the elderly in operation.

[0051] In view of the above technical problems, the following embodiments are proposed.

[0052] In some embodiments of the present application, the interface operation method can be implemented by a processor in the interface operation device. The above-mentioned processor can be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor.

[0053] Figure 1A is a schematic flowchart of an interface operation method in an embodiment of the present application. As Figure 1A shown, the method includes the following steps:

[0054] Step 100: After receiving an enabling instruction from the user for the visually impaired assistance function, generate an operation graphic on the operation interface.

[0055] In an embodiment of the present application, the interface operation method can be applied to an intelligent terminal including an operation interface. Here, the intelligent terminal can be a smart phone, a tablet, a smart wearable device, etc. Hereinafter, a smart phone will be taken as an example for illustration.

[0056] Exemplarily, after the user starts an application (APP) on the intelligent terminal, if the user needs to enable the visually impaired assistance function, the user sends an enabling instruction for the visually impaired assistance function to the intelligent terminal; then, the intelligent terminal can receive the enabling instruction from the user for the visually impaired assistance function.

[0057] In some embodiments, the enabling instruction can be generated after receiving a shaking operation of the intelligent terminal by the user. The shaking operation can be a left - right shake or an up - down shake; referring to Figure 1B , a schematic diagram of a scenario for generating an enabling instruction by a left - right shake is shown. Exemplarily, sensors can be set on the intelligent terminal, such as an acceleration sensor and a touch sensor, etc. The intelligent terminal can determine whether it has received the enabling instruction from the user for the visually impaired assistance function by receiving signals related to the enabling instruction transmitted by the sensors. It should be noted that if the user has finished using the visually impaired assistance function subsequently and wants to turn off the function, similar to the enabling instruction, the user can also generate a disabling instruction by performing a shaking operation on the intelligent terminal to turn off the visually impaired assistance function.

[0058] Exemplarily, after the smart terminal receives an enabling instruction from the user for the visually impaired assistance function, the visually impaired assistance function is started. At this time, an operation graphic is automatically generated on the operation interface of the smart terminal; here, the operation graphic is a hollow graphic, and the shape of the hollow graphic is not limited. For example, it can be a circular hollow graphic, a square hollow graphic, etc.

[0059] Step 101: When the operation graphic is dragged to the target position, take a screenshot of the current operation graphic to obtain a first picture; perform a scaling operation on the content in the first picture to obtain a second picture.

[0060] Exemplarily, after the operation graphic is generated on the operation interface, the user can use a finger to touch the operation graphic and freely drag it on the operation interface; here, the user can use a single finger or two fingers to touch the operation graphic.

[0061] Here, the target position indicates the position where the user needs to perform the next operation; it can be understood that when the initial position where the operation graphic is generated is the target position, at this time, the user does not need to drag the operation graphic; when the initial position where the operation graphic is generated is not the target position, at this time, the user can drag the operation graphic to the target position according to their own needs.

[0062] In the embodiments of the present application, when the operation graphic is dragged to the target position, a screenshot of the current operation graphic will be taken; it can be understood that in order to reduce unnecessary operation counts, when the operation graphic is being dragged, no screenshot will be taken of it; in addition, when the operation graphic is being dragged, the shape of the operation graphic will not change, and a loading animation is displayed inside the graphic.

[0063] In some embodiments, when the operation graphic is dragged to the target position, taking a screenshot of the current operation graphic may include: obtaining the duration after the operation graphic is dragged to the target position, and when the duration is greater than the set time, taking a screenshot of the current operation graphic.

[0064] In the embodiments of the present application, after obtaining the duration after the operation graphic is dragged to the target position, the duration can be compared with the set time to obtain a comparison result; when it is determined according to the comparison result that the duration is greater than the set time, a screenshot of the current operation graphic is taken; otherwise, continue to wait until the obtained duration is greater than the set time to perform the screenshot operation.

[0065] Exemplarily, the embodiments of the present application do not limit the method for obtaining the duration. For example, it can be obtained by means of a listening function, or by other means.

[0066] Here, the setting of the set time can be adjusted according to the actual situation. For example, it can be set to about 2 seconds. This is because 2 seconds is a relatively appropriate interval value. If the interval is too long, it will seem rather drawn - out, and if the interval is too short, it may occur that the screenshot is taken before moving to the target position, affecting the user experience.

[0067] Exemplarily, the process of taking a screenshot of the operation graphic to obtain the first picture can be as follows: First, obtain a boundary position of the operation graphic, which is defaulted to the coordinate value of the upper - left corner position. Then, according to this coordinate value and the preset size of the operation graphic (such as the height and width of the operation image), take a screenshot to generate the first picture. Here, there is no limitation on the picture format of the first picture. For example, it can be in the Portable Network Graphics (PNG) format or other formats.

[0068] Exemplarily, after obtaining the first picture, if the smart terminal receives a zoom - in / zoom - out instruction from the user for the first picture, it can also perform corresponding zoom - in / zoom - out operations on the content in the first picture.

[0069] In the embodiments of the present application, there is no limitation on the generation method of the zoom - in / zoom - out instruction. In one embodiment, it can be generated after receiving the user's gesture zoom - in / zoom - out operation. In another embodiment, it can also be generated by generating a multiple option while generating the operation graphic on the operation interface and then generating the instruction after receiving the user's click on a certain multiple in the multiple option.

[0070] Here, the multiple option can include a magnification item and a reduction item. Exemplarily, the values of the magnification item and the reduction item can be set according to the actual situation, and the embodiments of the present application do not limit this. For example, the magnification item can include multiples such as 1.5, 2.0, 2.5, etc., and the reduction item can include multiples such as 1, 0.8, 0.5, etc.

[0071] It can be understood that for the convenience of user operation, the operation graphic and the multiple option can be generated at a fixed position on the operation interface each time. Here, there is no limitation on the actual position of the fixed position on the operation interface. For example, the operation graphic can be generated at the upper - left corner of the operation interface each time, and the multiple option can be generated below the operation graphic. Refer to Figure 1C , the circular hollowed - out graphic at the upper - left corner of the operation interface is the generated operation graphic, and 2.0, 1.5, 1, 0.8, 0.5 below the operation graphic are the generated multiple options.

[0072] Exemplarily, after the user can click on a certain multiple in the multiple options according to their own needs, the smart terminal will perform a corresponding zoom operation on the first picture according to the multiple selected by the user to obtain the second picture. For example, if the multiple selected by the user is 2.0, the smart terminal will magnify the content in the first picture by 2 times (corresponding to the second picture) and display it on the operation interface.

[0073] It can be seen that after taking a screenshot of the operation graphic located at the target position in the embodiment of the present application, the user can magnify or reduce the display of the content in the screenshot according to the gesture zoom operation or select any multiple in the multiple options; that is, the size of the content of interest can be adjusted targeted according to the user's own needs. In this way, the problem that the elderly cannot see the interface text clearly due to visual impairment can be solved.

[0074] Step 102: Receive a first click operation of the user on the target content in the second picture, and perform a corresponding delegation operation according to the first click operation.

[0075] In the embodiment of the present application, after obtaining the second picture according to the above steps, the user can click on the target content in the second picture according to their own needs. Then, the smart terminal can receive the first click operation of the user on the target content in the second picture; here, the first click operation can be a two-finger simultaneous click or a three-finger simultaneous click; the target content can be content related to clicking a link or submitting a form, etc., and the embodiment of the present application does not limit this.

[0076] Exemplarily, when the user needs to perform a first click operation on the target content of the second picture, the user can click on the target content simultaneously with two fingers or three fingers; at this time, the smart terminal obtains the upper left corner coordinate value of the second picture, and then, according to this position coordinate value and the multiple selected by the user before, calculates the actual click position of the user's current click position relative to the operation interface. For example, the multiple selected by the user before is 2.0, that is, the second picture is a picture magnified by 2 times from the original screenshot (corresponding to the first picture). Assuming that the click coordinates (x, y) of the user on the target content in the second picture are (100, 100), then the actual click coordinates on the operation interface should be (x0, y0) = (50, 50); that is to say, if the user performs a first click operation on the content at (x, y) in the second picture, the content at (x0, y0) on the current operation interface will have an action similar to the first click operation. At this time, the smart terminal will perform a corresponding delegation operation on the content at (x0, y0).

[0077] It can be seen that after the screenshot is enlarged or reduced according to the user's needs in the embodiment of the present application, by performing a click operation on the content in the screenshot, the delegated operation of the corresponding content of the actual operation interface can be realized, such as link clicking, form submission, etc., that is, it does not affect the user's operation of the actual operation interface.

[0078] The embodiment of the present application provides an interface operation method, device, electronic device, intelligent terminal and computer storage medium. The method is applied to an intelligent terminal including an operation interface, and the method includes: after receiving an enabling instruction for the visual impairment assistance function from the user, generating an operation graphic on the operation interface; taking a screenshot of the current operation graphic to obtain a first picture when the operation graphic is dragged to a target position; performing a scaling operation on the content in the first picture to obtain a second picture; receiving a first click operation on the target content in the second picture by the user, and performing a corresponding delegated operation according to the first click operation. It can be seen that after the visual impairment assistance function is enabled in the embodiment of the present application, the user can freely drag the generated operation graphic on the operation interface, and take a screenshot of the operation graphic when the operation graphic is dragged to the target position; at this time, the content in the screenshot can be enlarged or reduced according to the user's needs; that is, the content in the operation graphic can be adaptively adjusted; and when receiving the click operation of the user, the corresponding delegated operation can be performed, that is, it does not affect the user's operation of the interface. In this way, problems such as the elderly being unable to see the interface text clearly due to visual impairment and unable to click on the target in the click area can be solved, and the convenience of the elderly operating the interface of an intelligent terminal (such as a smart phone) can be improved.

[0079] Exemplarily, before the user enables the visual impairment assistance function, the intelligent terminal can determine whether to enable the visual impairment assistance function according to the distance between the user and the operation interface. Figure 1D It is a schematic flowchart of a process for prompting the user to enable the visual impairment assistance function in the embodiment of the present application. As Figure 1D shown, it may include the following steps:

[0080] Step 1001: Obtain the distance between the user and the operation interface;

[0081] Step 1002: Prompt the user to enable the visual impairment assistance function when it is determined that the distance does not meet the set requirements.

[0082] Exemplarily, before the user enables the visually impaired assistance function, the smart terminal may request the user to enable the camera and voice permissions. After obtaining the camera permission, the distance between the user and the operation interface can be obtained through the camera. Then, the smart terminal determines whether the distance meets the set requirements. Here, the set requirements represent the normal visual distance range between the user and the operation interface. The value of the normal visual distance range can be set according to the actual situation, and the embodiments of the present application do not limit this. For example, it can be between 28 cm and 30 cm.

[0083] In the embodiments of the present application, when the smart terminal determines that the distance between the user and the operation interface does not meet the set requirements, it indicates that the current user is likely to have a visual impairment. At this time, the user needs to be prompted to enable the visually impaired assistance function. On the contrary, when the smart terminal determines that the distance between the user and the operation interface meets the set requirements, it indicates that the current user does not have a visual impairment. At this time, there is no need to remind the user to enable the visually impaired assistance function.

[0084] Exemplarily, the user can be prompted to enable the visually impaired assistance function by voice. Here, when prompting the user by voice, the user will also be prompted about the way to enable the visually impaired assistance function, that is, by shaking left and right or up and down.

[0085] Further, after the user enables the visually impaired assistance function, the camera obtains the distance between the user and the operation interface again and determines whether the distance meets the set requirements. If not, the size of the content in the generated operation graphic is automatically adjusted, or the user is reminded by voice to make adjustments until the distance between the user and the operation interface meets the set requirements. It can be seen that after the user enables the visually impaired assistance function, fine adjustments are made by judging the distance between the user and the operation interface through the camera, and the best assistance effect can be achieved.

[0086] In some embodiments, Figure 2A is another schematic flowchart of the interface operation in the embodiments of the present application. As Figure 2A shown, it may include the following steps:

[0087] Step 200: After receiving the second click operation of the user on the second picture, transform the shape of the current operation graphic to obtain the transformed operation graphic;

[0088] Step 201: Take a screenshot of the transformed operation graphic to obtain the target picture; identify the target picture to obtain the recognition result;

[0089] Step 202: Process the recognition result in a set manner.

[0090] Exemplarily, in the case where the operation graphic is a circular hollow graphic, if the user has a question about the content in the second picture, the user can perform a second click operation on the second picture; here, the second click operation and the above-mentioned first click operation are two different click operations. If the first click operation is a two-finger simultaneous click, the second click operation is a three-finger simultaneous click; conversely, if the first click operation is a three-finger simultaneous click, the second click operation is a two-finger simultaneous click; it can be understood that, for the convenience of the user's operation, the user can be reminded of the type of click operation by voice.

[0091] In the embodiment of the present application, after receiving the second click operation of the user on the second picture, the shape of the operation graphic is transformed to obtain a transformed operation graphic; for example, the operation graphic can be transformed from a circular hollow graphic into a draggable square hollow graphic (the transformed operation graphic), refer to Figure 2B ; at this time, the user can freely drag the transformed square hollow graphic.

[0092] Exemplarily, after obtaining the transformed operation graphic, a screenshot of the transformed operation graphic is taken to obtain a target picture; then, optical character recognition (OCR) is performed on the target picture to obtain a recognition result; afterwards, the recognition result is processed in a set manner.

[0093] In some embodiments, the above method may further include: after transforming the shape of the current operation graphic, generating a quick operation item in the operation interface; the quick operation item includes at least one of reading text, searching, and canceling.

[0094] Exemplarily, after transforming the shape of the current operation graphic to obtain a transformed operation graphic, first, it is determined whether the transformed operation graphic is being dragged. If so, wait until the dragging of the transformed operation graphic ends; if not, further determine whether the time when the transformed operation graphic ends dragging reaches a set value. If so, generate a quick operation item at a set position in the operation interface; if not, continue to wait until the time when the dragging ends reaches the set value. Here, the position of the set position in the operation interface is not limited, as long as it is ensured that it does not overlap with the transformed image. For example, it can be in the lower left corner, lower right corner, etc. of the operation interface.

[0095] Here, the value of the above set value can be set according to the actual situation, and the embodiment of the present application does not limit this. For example, it can be set to 600 ms.

[0096] Further, in combination with Figure 2B, after generating a quick operation item on the operation interface, the user can select any one of reading text, searching, and canceling according to their own needs. After that, the intelligent terminal processes the above recognition results according to the operation method selected by the user. For example, if the user selects to read text, the intelligent terminal returns a voice result. Similarly, if the user selects to search, the intelligent terminal returns a search result, so as to solve the troubles caused by the user's inability to understand or the problem of exiting the APP due to this.

[0097] Figure 3 It is a schematic structural diagram of the interface operation device according to an embodiment of the present application. As shown in FIG. 2, the device includes: a generation module 300, an obtaining module 301, and an execution module 302, where:

[0098] The generation module 300 is configured to generate an operation graphic on the operation interface after receiving an enabling instruction of the visually impaired assistance function from the user;

[0099] The obtaining module 301 is configured to, when the operation graphic is dragged to a target position, take a screenshot of the current operation graphic to obtain a first picture; perform a zoom operation on the content in the first picture to obtain a second picture;

[0100] The execution module 302 is configured to receive a first click operation of the user on the target content in the second picture, and perform a corresponding delegation operation according to the first click operation.

[0101] In some embodiments, the execution module 302 is further configured to:

[0102] After receiving a second click operation of the user on the second picture, transform the shape of the current operation graphic to obtain a transformed operation graphic;

[0103] Take a screenshot of the transformed operation graphic to obtain a target picture;

[0104] Perform recognition on the target picture to obtain a recognition result;

[0105] Process the recognition result in a set manner.

[0106] In some embodiments, the execution module 302 is further configured to:

[0107] After transforming the shape of the current operation graphic, generate a quick operation item on the operation interface; the quick operation item includes at least one of reading text, searching, and canceling;

[0108] The execution module 302 is configured to process the recognition result in a set manner, including:

[0109] Process the recognition result according to the quick operation item.

[0110] In some embodiments, the device further includes a prompting module, which is used for:

[0111] Obtain the distance between the user and the operation interface;

[0112] When it is determined that the distance does not meet the set requirements, prompt the user to turn on the visual impairment assistance function.

[0113] In some embodiments, the prompting module for prompting the user to turn on the visual impairment assistance function includes:

[0114] Prompt the user to turn on the visual impairment assistance function by voice.

[0115] In some embodiments, the obtaining module 301 is used to take a screenshot of the current operation graphic when the operation graphic is dragged to the target position, including:

[0116] Obtain the duration after the operation graphic is dragged to the target position, and take a screenshot of the current operation graphic when the duration is greater than the set time.

[0117] In some embodiments, the enabling instruction is generated after receiving the shaking operation of the user on the smart terminal.

[0118] In practical applications, the above-mentioned generating module 300, obtaining module 301, executing module 302 and prompting module can all be implemented by a processor located in an electronic device, and the processor can be at least one of ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, and microprocessor.

[0119] In addition, each functional module in this embodiment can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional module.

[0120] When the integrated unit is implemented in the form of a software functional module and is not sold or used as an independent commodity, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment, in essence, or the part that contributes to the related technology, or all or part of this technical solution, can be embodied in the form of a software commodity. This computer software commodity is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks, or optical discs that can store program codes.

[0121] Specifically, the computer program instructions corresponding to an interface operation method in this embodiment can be stored on storage media such as optical discs, hard disks, and USB flash drives. When the computer program instructions corresponding to an interface operation method in the storage medium are read or executed by an electronic device, any of the interface operation methods of the foregoing embodiments is implemented.

[0122] Based on the same technical concept as the foregoing embodiment, refer to Figure 4 , which shows the electronic device 400 provided by the embodiment of the present application and may include: a memory 401 and a processor 402; wherein,

[0123] The memory 401 is used to store computer programs and data;

[0124] The processor 402 is used to execute the computer program stored in the memory to implement any of the interface operation methods of the foregoing embodiments.

[0125] In practical applications, the aforementioned memory 401 can be a volatile memory, such as RAM; or a non-volatile memory, such as ROM, flash memory, hard disk drive (HDD), or solid-state drive (SSD); or a combination of the above types of memories, and provide instructions and data to the processor 402.

[0126] The above-mentioned processor 402 may be at least one of an ASIC, a DSP, a DSPD, a PLD, an FPGA, a CPU, a controller, a microcontroller, and a microprocessor. It can be understood that for different audit management platforms, the electronic devices used to implement the functions of the above-mentioned processor may also be others, and the embodiments of the present application do not make specific limitations.

[0127] The embodiments of the present application further provide an intelligent terminal, which includes the foregoing interface operation device or the foregoing electronic device.

[0128] In some embodiments, the functions or modules included in the device provided by the embodiments of the present application can be used to execute the methods described in the foregoing method embodiments. The specific implementation can refer to the description of the foregoing method embodiments. For the sake of brevity, it will not be repeated here.

[0129] The descriptions of the foregoing embodiments tend to emphasize the differences between the embodiments. The same or similar parts can be referred to each other. For the sake of brevity, they will not be repeated in this article.

[0130] The methods disclosed in the method embodiments provided by the present application can be arbitrarily combined without conflict to obtain new method embodiments.

[0131] The features disclosed in the product embodiments provided by the present application can be arbitrarily combined without conflict to obtain new product embodiments.

[0132] The features disclosed in the method or device embodiments provided by the present application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0133] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a system, or a computer program product. Therefore, the present application can take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.

[0134] This application is described with reference to the flowcharts and / or block diagrams of methods, apparatuses (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as the combination of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to the processors of general-purpose computers, special-purpose computers, embedded processors, or other programmable data processing devices to generate a machine, such that the instructions executed by the processors of the computer or other programmable data processing devices produce means for implementing the functions specified in one or more flows of the flowchart and / or one or more blocks of the block diagram.

[0135] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are executed on the computer or other programmable device to generate a computer-implemented process, so that the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more flows of the flowchart and / or one or more blocks of the block diagram.

[0136] The above is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. An interface operation method, characterized in that, it is applied to an intelligent terminal including an operation interface, and the method includes: After receiving an enabling instruction from the user for the visually impaired assistance function, generating an operation graphic on the operation interface; When the operation graphic is dragged to a target position, taking a screenshot of the current operation graphic to obtain a first picture; performing a zoom operation on the content in the first picture to obtain a second picture; Receiving a first click operation from the user on the target content in the second picture, and performing a corresponding delegated operation according to the first click operation; After receiving a second click operation from the user on the second picture, transforming the shape of the current operation graphic to obtain a transformed operation graphic; Taking a screenshot of the transformed operation graphic to obtain a target picture; Identifying the target picture to obtain an identification result; Processing the identification result in a set manner.

2. The method according to claim 1, characterized in that, the method further includes: After transforming the shape of the current operation graphic, generating a quick operation item on the operation interface; the quick operation item includes at least one of: reading text, searching, and canceling; The processing the identification result in a set manner includes: Processing the identification result according to the quick operation item.

3. The method according to claim 1, characterized in that, the method further includes: Obtaining the distance between the user and the operation interface; When it is determined that the distance does not meet the set requirements, prompting the user to enable the visually impaired assistance function.

4. The method according to claim 3, characterized in that, the prompting the user to enable the visually impaired assistance function includes: Prompting the user to enable the visually impaired assistance function by voice.

5. The method according to claim 1, characterized in that, the taking a screenshot of the current operation graphic when the operation graphic is dragged to a target position includes: Obtaining the duration after the operation graphic is dragged to the target position, and taking a screenshot of the current operation graphic when the duration is greater than the set time.

6. The method according to claim 1, characterized in that, the enabling instruction is generated after receiving a shaking operation of the user on the intelligent terminal.

7. An interface operation device, characterized in that, it is applied to an intelligent terminal including an operation interface, and the device includes: A generating module, configured to generate an operation graphic on the operation interface after receiving an enabling instruction from the user for the visually impaired assistance function; A obtaining module, configured to take a screenshot of the current operation graphic to obtain a first picture when the operation graphic is dragged to a target position; performing a zoom operation on the content in the first picture to obtain a second picture; An executing module, configured to receive a first click operation from the user on the target content in the second picture, and perform a corresponding delegated operation according to the first click operation; The execution module is further configured to: after receiving the second click operation of the user on the second picture, transform the shape of the current operation graph to obtain a transformed operation graph; take a screenshot of the transformed operation graph to obtain a target picture; recognize the target picture to obtain a recognition result; process the recognition result in a set manner.

8. The apparatus according to claim 7, wherein, the execution module is further configured to: after transforming the shape of the current operation graph, generate a quick operation item on the operation interface; the quick operation item includes at least one of: reading text, searching, and canceling; the execution module is configured to process the recognition result in a set manner, including: processing the recognition result according to the quick operation item.

9. The apparatus according to claim 7, wherein, the apparatus further includes a prompt module, and the prompt module is configured to: acquire the distance between the user and the operation interface; in the case where it is determined that the distance does not meet the set requirements, prompt the user to turn on the visual impairment assistance function.

10. The apparatus according to claim 9, wherein, the prompt module is configured to prompt the user to turn on the visual impairment assistance function, including: prompting the user to turn on the visual impairment assistance function in a voice manner.

11. The apparatus according to claim 7, wherein, the obtaining module is configured to, when the operation graph is dragged to a target position, take a screenshot of the current operation graph, including: acquiring the duration after the operation graph is dragged to the target position, and taking a screenshot of the current operation graph when the duration is greater than the set time.

12. The apparatus according to claim 7, wherein, the activation instruction is generated after receiving the shaking operation of the user on the intelligent terminal.

13. An electronic device, wherein, the device includes a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, the method according to any one of claims 1 to 6 is implemented.

14. An intelligent terminal, wherein, the intelligent terminal includes the apparatus according to claim 7 or the electronic device according to claim 13.

15. A computer storage medium, on which a computer program is stored, wherein, when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images