Remote non-contact control method of computer equipment and related device

Abstract

The embodiment of the invention relates to the field of data processing, and provides a remote non-contact control method and related device for computer equipment, and the method comprises the steps: obtaining a first contact area, on a display screen, of infrared light emitted by a page turning pen controlled by a target user; extracting first display information of a first display area corresponding to the first contact area on a display screen; according to the first contact area and the first display information, determining selected information of a target user; generating a control instruction according to the selected information and control information received from the page turning pen; the control instruction is executed, the control instruction can be generated according to the contact area of the infrared light emitted by the page turning pen on the display screen and the control information of the page turning pen, and the control instruction is executed, so that the convenience of controlling the computer equipment is improved.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a remote non-contact control method and related device for computer equipment. Background Art

[0002] The functions of wireless presenters currently on the market are mainly focused on page turning and control during the presentation process, and the functions are single. In addition to the presentation scenario, wireless presenters can also be used to turn the active page of the computer device. However, in some special scenarios, if the computer device cannot add peripherals such as a mouse, the existing wireless presenter can only control the page turning and cannot perform other processing, which reduces the convenience of using the computer device. Summary of the Invention

[0003] The embodiments of the present application provide a remote non-contact control method and related device for a computer device, which can generate a control instruction based on the contact area of the infrared light emitted by the wireless presenter on the display screen and the control information of the wireless presenter, and execute the control instruction, thereby improving the convenience of controlling the computer device.

[0004] A first aspect of an embodiment of the present application provides a method for remote non-contact control of a computer device, the method comprising:

[0005] Acquire a first contact area on the display screen of the infrared light emitted by the wireless presenter controlled by the target user;

[0006] Extracting first display information of a first display area corresponding to the first contact area on the display screen;

[0007] Determining selected information of the target user according to the first contact area and the first display information;

[0008] Generate a control instruction according to the selected information and the control information received from the wireless presenter;

[0009] Execute the control instruction.

[0010] In a possible implementation, determining the selected information of the target user according to the first contact area and the first display information includes:

[0011] Completing the first display information to obtain second display information;

[0012] The selected information is determined according to the second display information and the first contact area.

[0013] In a possible implementation, determining the selected information according to the second presentation information and the first contact area includes:

[0014] Perform regional regularization on the first contact area to obtain a second contact area;

[0015] Extract the display information covered by the second contact area from the second display information to obtain reference display information;

[0016] Perform completion processing on the reference display information to obtain third display information;

[0017] Determine the selected information according to the semantic information of the third display information.

[0018] In a possible implementation manner, the performing regional regularization on the first contact area to obtain a second contact area includes:

[0019] Obtain the regional type information of the first contact area, and extract the convex areas of the first contact area to obtain k first convex areas;

[0020] Determine the selection intention information of the target user according to the k first convex areas;

[0021] Perform regional regularization on the first contact area according to the selection intention information and the regional type information to obtain the second contact area.

[0022] In a possible implementation manner, the generating a control instruction according to the selected information and the control information received from the page-turning pen includes:

[0023] Determine the control instruction type information according to the control information;

[0024] Generate the control instruction according to the control instruction type information and the selected information.

[0025] The second aspect of the embodiments of the present application provides a remote non-contact control device for a computer device, and the device includes:

[0026] An acquisition unit, configured to acquire a first contact area on the display screen of the infrared light emitted by the target user controlling the page-turning pen;

[0027] An extraction unit, configured to extract first display information of a first display area corresponding to the first contact area on the display screen;

[0028] A determination unit, configured to determine the selected information of the target user according to the first contact area and the first display information;

[0029] A generation unit, configured to generate a control instruction according to the selected information and the control information received from the page-turning pen;

[0030] An execution unit for executing the control instruction.

[0031] In a possible implementation manner, the determining unit is specifically configured to:

[0032] Perform a completion process on the first display information to obtain second display information;

[0033] Determine the selected information according to the second display information and the first contact area.

[0034] In a possible implementation manner, in terms of determining the selected information according to the second display information and the first contact area, the determining unit is specifically configured to:

[0035] Perform a regional regularization process on the first contact area to obtain a second contact area;

[0036] Extract the display information covered by the second contact area from the second display information to obtain reference display information;

[0037] Perform a completion process on the reference display information to obtain third display information;

[0038] Determine the selected information according to the semantic information of the third display information.

[0039] In a possible implementation manner, in terms of performing a regional regularization process on the first contact area to obtain a second contact area, the determining unit is specifically configured to:

[0040] Obtain the regional type information of the first contact area, and extract the protruding areas of the first contact area to obtain k first protruding areas;

[0041] Determine the selection intention information of the target user according to the k first protruding areas;

[0042] Perform a regional regularization process on the first contact area according to the selection intention information and the regional type information to obtain the second contact area.

[0043] In a possible implementation manner, the generating unit is configured to:

[0044] Determine the control instruction type information according to the control information;

[0045] Generate the control instruction according to the control instruction type information and the selected information.

[0046] A third aspect of the embodiments of the present application provides a terminal, including a processor, an input device, an output device, and a memory. The processor, the input device, the output device, and the memory are interconnected. Among them, the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to call the program instructions to execute the step instructions in the first aspect of the embodiments of the present application.

[0047] A fourth aspect of the embodiments of the present application provides a computer-readable storage medium. Among them, the computer-readable storage medium stores a computer program for electronic data exchange. Among them, the computer program enables a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application.

[0048] A fifth aspect of the embodiments of the present application provides a computer program product. Among them, the computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to enable a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product can be a software installation package.

[0049] Implementing the embodiments of the present application has the following beneficial effects:

[0050] By obtaining the first contact area of the infrared light emitted by the page-turning pen controlled by the target user on the display screen, extracting the first display information of the first display area corresponding to the first contact area on the display screen, determining the selected information of the target user according to the first contact area and the first display information, generating a control instruction according to the selected information and the control information received from the page-turning pen, and executing the control instruction. Therefore, it is possible to generate a control instruction according to the contact area of the infrared light emitted by the page-turning pen on the display screen and the control information of the page-turning pen, and execute the control instruction, improving the convenience when controlling a computer device. Description of the Drawings

[0051] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0052] Figure 1 This is a schematic structural diagram of a remote non-contact control system for a computer device provided by the embodiments of the present application;

[0053] Figure 2 This is a schematic flow diagram of a remote non-contact control method for a computer device provided by the embodiments of the present application.

[0054] Figure 3 A schematic structural diagram of a terminal provided by an embodiment of the present application;

[0055] Figure 4 A schematic structural diagram of a remote non-contact control device for a computer device provided by an embodiment of the present application. Specific embodiments

[0056] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0057] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices.

[0058] Referring to "embodiments" in the present application means that specific features, structures or characteristics described in connection with the embodiments can be included in at least one embodiment of the present application. The phrase appears in various positions in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described in the present application can be combined with other embodiments.

[0059] To better understand a remote non-contact control method for a computer device provided by an embodiment of the present application, the interaction working principle between a page-turning pen and a computer device in the existing solution will be briefly introduced below. In the existing solution, the page-turning pen is usually concentrated during a presentation, for example, PPT presentation, video display, etc. When it runs, it usually controls page turning during the presentation. In some special scenarios, for example, when the mouse of the computer device is damaged and cannot be replaced in time, the computer device usually cannot be used normally. At this time, although there is a page-turning pen that can perform page-turning control, etc., some complex selection functions, control functions after selection, etc. cannot be performed, resulting in a reduction in the convenience of using the computer device.

[0060] To solve the above problems, an embodiment of the present application provides a remote non-contact control method for a computer device, which can generate a control instruction based on the contact area of the infrared light emitted by the page-turning pen on the display screen and the control information of the page-turning pen, and execute the control instruction, improving the convenience when controlling the computer device.

[0061] Please refer to Figure 1 , Figure 1 which shows a schematic structural diagram of a remote non-contact control system for a computer device. As Figure 1 shown, the remote non-contact control system for the computer device includes: a computer device and a page-turning pen. Among them, the display screen of the computer device can obtain the infrared light emitted by the page-turning pen. The infrared light emitted by the page-turning pen is a direct beam of light, which has less divergence. There is a certain operating distance between the page-turning pen and the display screen. Beyond this operating distance, the recognition accuracy may be reduced. Therefore, during use, the distance between the page-turning pen and the display screen should be within this operating distance range. This range can be set through experimental data or historical data, etc.

[0062] The page-turning pen can be used to send infrared light to the display screen. The computer device can extract the landing area of the infrared beam on the display screen, as well as extract the corresponding display information, extract the selected information of the user according to the landing area and the display information, and finally generate a control instruction according to the control information of the page-turning pen and the selected information. The computer device executes the control instruction, so that a control instruction can be generated based on the contact area of the infrared light emitted by the page-turning pen on the display screen and the control information of the page-turning pen, and the control instruction is executed, improving the convenience when controlling the computer device.

[0063] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a remote non-contact control method for a computer device provided by an embodiment of the present application. As Figure 2 shown, the method includes:

[0064] 201. Obtain a first contact area on the display screen where the target user controls the infrared light emitted by the page-turning pen.

[0065] Among them, a general infrared light landing point detection method can be used to obtain the landing area of the infrared light emitted by the page-turning pen on the display screen, and this landing area is determined as the first contact area. Due to factors such as the divergence of the infrared light and some jitters of the target user during operation, this first contact area will be an irregular area. This area can span multiple display lines of the display screen, etc., or it can occupy extra display lines due to edge divergence. This display line can be understood as the display line when the display screen is displaying text, etc.

[0066] 202. Extract the first display information of the first display area corresponding to the first contact area on the display screen.

[0067] Since the first contact area is an irregular area, the corresponding first display area is also irregular. The first display area can be actually understood as the mapping of the first contact area on the display surface, with the same area and the same shape. The first display information can be understood as the display information covered by the first display area. The first display information may include incomplete display information. For example, the first display information includes the left half of the character "mu" in "target data". The specific reason for this incompleteness is the error caused by the user's operation jitter or the divergence of infrared light. Since there may be incomplete content, during subsequent processing, it is necessary to perform a complementation process to improve the accuracy.

[0068] 203. Determine the selected information of the target user according to the first contact area and the first display information.

[0069] Among them, the first display information can be complemented, and then the complemented first display information and the first contact area are used to determine the selected information of the target user, so as to improve the accuracy when determining the selected information.

[0070] 204. Generate a control instruction according to the selected information and the control information received from the page-turning pen.

[0071] The type of control instruction can be determined according to the control information, and the control instruction is generated according to the type of control instruction and the selected information.

[0072] 205. Execute the control instruction.

[0073] In this example, by obtaining the first contact area of the infrared light emitted by the target user controlling the page-turning pen on the display screen, extracting the first display information of the first display area corresponding to the first contact area on the display screen, determining the selected information of the target user according to the first contact area and the first display information, generating a control instruction according to the selected information and the control information received from the page-turning pen, and executing the control instruction. Therefore, a control instruction can be generated according to the contact area of the infrared light emitted by the page-turning pen on the display screen and the control information of the page-turning pen, and the control instruction is executed, which improves the convenience when controlling the computer device.

[0074] In a possible implementation, a method for determining the selected information of the target user according to the first contact area and the first display information includes:

[0075] A1. Complement the first display information to obtain second display information;

[0076] A2. Determine the selected information according to the second display information and the first contact area.

[0077] Among them, the method for completing the first display information can be to extract the incomplete display information in the first display information, extract the complete display information corresponding to the incomplete display information, and replace the corresponding incomplete display information in the first display information with the complete display information, so as to obtain the second display information. For example, if the incomplete display information is a partial picture of the first picture, then use the first picture as the complete display information corresponding to the incomplete display information and perform subsequent replacement processing.

[0078] The first contact area can be regularized to obtain a second contact area, and then the selected information can be determined through the second contact area and the second display information. Therefore, since the display screen usually displays text according to certain display lines and display areas, regularizing the area can better fit the display mode, etc., and further improve the accuracy of the obtained selected information.

[0079] In a possible implementation, a method for determining the selected information according to the second display information and the first contact area includes:

[0080] B1. Regularize the first contact area to obtain a second contact area;

[0081] B2. Extract the display information covered by the second contact area from the second display information to obtain reference display information;

[0082] B3. Complete the reference display information to obtain a third display information;

[0083] B4. Determine the selected information according to the semantic information of the third display information.

[0084] Among them, the method for performing regional regularization on the first contact area may be: extracting the first lateral distal point and the second lateral distal point of the first contact area in the horizontal direction, where the first lateral distal point may be the distal point on the left side, and the second lateral distal point may be the distal point on the right side; and extracting the third distal point and the fourth distal point of the first contact area in the vertical direction, where the third distal point is the distal point on the lower side in the vertical direction, and the fourth distal point is the distal point on the upper side in the vertical direction. After extracting the four distal points, then extract the contour areas between adjacent distal points of the four distal points respectively to obtain four first contours; extract the convex points on the outer side of each first contour to obtain four sets of contour convex points. The convex points on the outer side of the contour can be understood as having a higher contour amplitude relative to the inner side of the contour; after extracting the four sets of contour convex points, connect the convex points on the contour in each first contour adjacent to each other to obtain the first reference contact area. After obtaining the first reference contact area, extract the display area occupied in the first reference contour area, and determine the occupied display area as the second reference contact area; perform a complement processing on the second reference contact area to obtain the second contact area.

[0085] Specifically, when performing a complement processing on the second reference contact area to obtain the second contact area, it may be to perform a block processing on the display area. When performing the block processing, perform a block processing according to the character display blocks in the display area to obtain a plurality of display blocks. One character can be displayed in each display block (for example, when performing Chinese display, one Chinese character can be displayed in each display block). Therefore, each non-complete display block in the second reference contact area can be complemented to the corresponding complete display block, so as to obtain the second contact area.

[0086] Of course, it may also be to extract the regional type information of the first contact area and extract the convex areas of the first contact area to obtain a plurality of first convex areas, and perform regional regularization processing according to the selected intention information and regional type information determined by the plurality of convex areas to obtain the second contact area.

[0087] The covered display information can be extracted from the second display information in a regional coverage manner to obtain the reference display information. Since there will still be partial coverage during the coverage, the obtained reference display information needs to be complemented to obtain the third display information. Extract the semantic information of the third display information, and determine the selected information according to the semantic information. Specifically, the semantic information of the third display information can be extracted by using a general semantic extraction method. After extracting the semantic information, the content with complete semantic information is determined as the selected information, so as to improve the accuracy when determining the selected information.

[0088] In a possible implementation manner, a method for performing regional regularization on the first contact area to obtain a second contact area includes:

[0089] C1. Obtain the regional type information of the first contact area, and extract the convex areas of the first contact area to obtain k first convex areas;

[0090] C2. Determine the selection intention information of the target user according to the k first convex areas;

[0091] C3. Perform regional regularization processing on the first contact area according to the selection intention information and the regional type information to obtain the second contact area.

[0092] Among them, different shapes have their corresponding regional type information, so that the regional type information can be determined according to the regional shape of the first contact area.

[0093] The method for obtaining the convex area can be to obtain the contour convex points of the first contact area to obtain a set of contour convex points, and determine the area within a preset range of the contour convex points in the set of contour convex points as the first convex area. The preset range is set by empirical values or historical data.

[0094] Since when the target user makes a selection, there may be a situation where the user wants to select multiple display rows as the selected area. However, due to the user's desire for simple operation during the operation, only part of the content within the first display row and the last display row among the multiple display rows is selected, and then part of the content of the display rows between the first display row and the last display row is selected with a slash, a smooth curve, etc. At this time, it can be characterized that the target user has selected multiple display rows. Specifically, for example, starting from the starting position of the first display row, after selecting 5 characters, slanting down to select 4 middle rows, and then selecting 6 characters backward from a certain display block in the fifth display row as the starting position, it can be considered that all the content from the first display row to the fifth display row has been selected. In this way, it is used as the selection intention information of the target user. At this time, the first convex area can be the area within the preset range of the turning points of the first row and the turning points of the fifth display row. Then the second area after regularization processing is the area where all the content from the first display row to the fifth display row is located.

[0095] When in other first protruding regions, the region inclusion method can be adopted for region diffusion, which diffuses to the largest complete display block region that can be covered, and this complete display block region is used as the selected intention information of the target user. Finally, the selected intention information and the region type information are used to perform region regularization processing on the first contact region to obtain the second contact region. Specifically, the region type information can be used to correct the selected intention information to obtain the second contact region. During the correction process, the vertex display block processing can be performed on the region corresponding to the selected intention information, thereby obtaining the second contact region. Therefore, determining the second contact region based on the selected intention information and the region type information determined by k first protruding regions can greatly improve the accuracy during the regularization process.

[0096] In a possible implementation manner, a method for generating a control instruction according to the selected information and the control information received from the page-turning pen includes:

[0097] D1. Determine the control instruction type information according to the control information;

[0098] D2. Generate the control instruction according to the control instruction type information and the selected information.

[0099] Different control information has its corresponding control instruction type. For example, if the control information is to perform content search after selection, then the control instruction type information can be to search for the selected content at this time.

[0100] The control instruction can be generated by using the general instruction type information and the method of generating the control instruction according to the selected information, which improves the convenience.

[0101] Consistent with the above embodiments, please refer to Figure 3 , Figure 3 which is a schematic structural diagram of a terminal provided by an embodiment of the present application. As Figure 3 shown, it includes a processor, an input device, an output device, and a memory. The processor, the input device, the output device, and the memory are interconnected. Among them, the memory is used to store a computer program, and the computer program includes program instructions. The processor is configured to call the program instructions, and the above program includes instructions for performing the following steps;

[0102] Obtain the first contact region of the infrared light emitted by the target user controlling the page-turning pen on the display screen;

[0103] Extract the first display information of the first display region corresponding to the first contact region on the display screen;

[0104] Determine the selected information of the target user according to the first contact region and the first display information;

[0105] Generate a control instruction according to the selected information and the control information received from the page-turning pen;

[0106] Execute the control instruction.

[0107] The above mainly introduces the solution of the embodiment of the present application from the perspective of the execution process of the method side. It can be understood that in order to implement the above functions, the terminal includes the corresponding hardware structure and / or software module for executing each function. Those skilled in the art should easily realize that, combining the units and algorithm steps of each example described in the embodiments provided in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0108] The embodiment of the present application can divide the functional units of the terminal according to the above method examples. For example, each functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. It should be noted that the division of units in the embodiment of the present application is illustrative, only a logical function division, and there may be other division methods in actual implementation.

[0109] Consistent with the above, please refer to Figure 4 , Figure 4 FIG. Figure 4 shows a schematic structural diagram of a remote non-contact control device for a computer device provided by an embodiment of the present application. As

[0110] An obtaining unit 401, configured to obtain a first contact area on the display screen of the infrared light emitted by the target user controlling the page-turning pen;

[0111] An extracting unit 402, configured to extract first display information of a first display area corresponding to the first contact area on the display screen;

[0112] A determining unit 403, configured to determine the selected information of the target user according to the first contact area and the first display information;

[0113] A generating unit 404, configured to generate a control instruction according to the selected information and the control information received from the page-turning pen;

[0114] An executing unit 405, configured to execute the control instruction.

[0115] In a possible implementation, the determining unit 403 is specifically configured to:

[0116] Completing the first display information to obtain second display information;

[0117] The selected information is determined according to the second display information and the first contact area.

[0118] In a possible implementation, in determining the selected information according to the second presentation information and the first contact area, the determining unit 403 is specifically configured to:

[0119] performing region regularization processing on the first contact region to obtain a second contact region;

[0120] extracting the display information covered by the second contact area from the second display information to obtain reference display information;

[0121] Completing the reference display information to obtain third display information;

[0122] The selected information is determined according to the semantic information of the third display information.

[0123] In a possible implementation, in performing region regularization processing on the first contact region to obtain the second contact region, the determining unit 403 is specifically configured to:

[0124] Acquiring area type information of the first contact area, and extracting convex areas of the first contact area to obtain k first convex areas;

[0125] Determining selection intention information of the target user based on the k first protruding areas;

[0126] Performing region regularization processing on the first contact region according to the selection intention information and the region type information to obtain the second contact region.

[0127] In a possible implementation, the generating unit 404 is configured to:

[0128] Determining control instruction type information according to the control information;

[0129] The control instruction is generated according to the control instruction type information and the selected information.

[0130] An embodiment of the present application further provides a computer storage medium. The computer storage medium stores a computer program for electronic data exchange, and the computer program causes the computer to execute some or all of the steps of any remote non-contact control method of a computer device as described in the foregoing method embodiments.

[0131] An embodiment of the present application further provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program causes the computer to execute some or all of the steps of any remote non-contact control method of a computer device as described in the foregoing method embodiments.

[0132] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0133] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0134] In several embodiments provided by the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical or other form.

[0135] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place, or they can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0136] In addition, in each embodiment of the present application, the functional units can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated units can be implemented in the form of hardware or in the form of software program modules.

[0137] When the integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The aforementioned memory includes: various media such as USB flash drives, read-only memory (ROM), random access memory (RAM), mobile hard disks, magnetic disks, or optical discs that can store program codes.

[0138] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and this program can be stored in a computer-readable memory. The memory can include: flash drives, read-only memories, random access memories, magnetic disks, or optical discs, etc.

[0139] The above has introduced the embodiments of the present application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A remote non-contact control method for a computer device, characterized in that, The method includes: Obtaining a first contact area on the display screen of the infrared light emitted by the target user controlling the page-turning pen; Extracting first display information of a first display area corresponding to the first contact area on the display screen; Determining the selected information of the target user according to the first contact area and the first display information; Generating a control instruction according to the selected information and the control information received from the page-turning pen; Executing the control instruction.

2. The remote non-contact control method of the computer device according to claim 1, characterized in that The determining the selected information of the target user according to the first contact area and the first display information includes: Performing a complement processing on the first display information to obtain second display information; Determining the selected information according to the second display information and the first contact area.

3. The remote non-contact control method for a computer device according to claim 2, wherein The determining the selected information according to the second display information and the first contact area includes: Performing a regional regularization process on the first contact area to obtain a second contact area; Extracting the display information covered by the second contact area from the second display information to obtain reference display information; Performing a complement processing on the reference display information to obtain third display information; Determining the selected information according to the semantic information of the third display information.

4. The remote non-contact control method of the computer device according to claim 3, characterized in that, The performing a regional regularization process on the first contact area to obtain a second contact area includes: Obtaining the regional type information of the first contact area, and extracting the convex areas of the first contact area to obtain k first convex areas; Determining the selected intention information of the target user according to the k first convex areas; Performing a regional regularization process on the first contact area according to the selected intention information and the regional type information to obtain the second contact area.

5. The remote non-contact control method for a computer device according to any one of claims 1-4, characterized in that, The generating a control instruction according to the selected information and the control information received from the page-turning pen includes: Determining control instruction type information according to the control information; Generating the control instruction according to the control instruction type information and the selected information.

6. A remote non-contact control device for a computer device, characterized in that, The device includes: An obtaining unit, configured to obtain a first contact area on the display screen of the infrared light emitted by the target user controlling the page-turning pen; An extracting unit, configured to extract first display information of a first display area corresponding to the first contact area on the display screen; A determining unit, configured to determine the selected information of the target user according to the first contact area and the first display information; A generating unit, configured to generate a control instruction according to the selected information and the control information received from the page-turning pen; An executing unit, configured to execute the control instruction.

7. The remote non-contact control device for a computer device according to claim 6, wherein The determining unit is specifically configured to: Perform a complement processing on the first display information to obtain second display information; Determine the selected information according to the second display information and the first contact area.

8. The remote non-contact control device for a computer device according to claim 7, wherein In terms of determining the selected information according to the second display information and the first contact area, the determining unit is specifically configured to: Perform a regional regularization process on the first contact area to obtain a second contact area; Extract the display information covered by the second contact area from the second display information to obtain reference display information; Complete the reference display information to obtain the third display information; Determine the selected information according to the semantic information of the third display information.

9. A terminal, characterized in that, It includes a processor, an input device, an output device and a memory. The processor, the input device, the output device and the memory are interconnected. Among them, the memory is used to store computer programs, and the computer programs include program instructions. The processor is configured to call the program instructions to execute the remote non-contact control method of the computer device according to any one of claims 1-5.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and the computer program includes program instructions. When the program instructions are executed by the processor, the processor is caused to execute the remote non-contact control method of the computer device according to any one of claims 1-5.

Images