A processing method and apparatus

Abstract

Embodiments of the present application disclose a processing method and device, wherein the method comprises: obtaining an interactive display image to be identified, determining a target interactive region in the interactive display image; identifying a display parameter of a target interactive control in the target interactive region, and obtaining a trigger signal of the target interactive control responding to a specific operation based on at least the display parameter.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and to, but is not limited to, a processing method and apparatus. Background Technology

[0002] Game service software needs to automatically record exciting moments when a special move is unleashed in a game, or display a cool lighting effect animation on the keyboard when a specific game skill is recognized, to enhance the user's immersive experience. Currently, different games use different methods to obtain specific game skills, and most games do not have open interfaces for obtaining game data, making it impossible to recognize specific game skills. Summary of the Invention

[0003] In view of this, embodiments of this application provide a processing method and apparatus.

[0004] The technical solution of this application embodiment is implemented as follows:

[0005] In a first aspect, embodiments of this application provide a processing method, comprising: obtaining an interactive display image to be identified, determining a target interactive area in the interactive display image; identifying display parameters of a target interactive control in the target interactive area, so as to obtain a trigger signal for the target interactive control to respond to a specific operation based at least on the display parameters.

[0006] Secondly, embodiments of this application provide a processing apparatus, comprising: a determining module, configured to obtain an interactive display image to be identified and determine a target interactive area in the interactive display image; and an identifying module, configured to identify display parameters of a target interactive control in the target interactive area, so as to obtain a trigger signal for the target interactive control to respond to a specific operation based at least on the display parameters.

[0007] In this embodiment, an interactive display image to be identified is first obtained, a target interactive area in the interactive display image is determined, and then the display parameters of the target interactive control in the target interactive area are identified, so as to obtain the trigger signal of the target interactive control responding to a specific operation based at least on the display parameters. This solves the problem in the prior art where different systems use different methods to obtain the trigger signal of a specific operation, and most systems do not have open interfaces for obtaining system data, making it impossible to identify the trigger signal of a specific operation. This method does not rely on system-provided state data; the system can autonomously identify the trigger signal of the target interactive control responding to a specific operation. This identification method is not constrained by the system data interface, effectively improving identification efficiency. Attached Figure Description

[0008] Figure 1 A schematic diagram illustrating the implementation flow of a processing method provided in an embodiment of this application;

[0009] Figure 2 A schematic diagram illustrating the implementation flow of a processing method provided in an embodiment of this application;

[0010] Figure 3 A schematic diagram illustrating the implementation flow of a processing method provided in an embodiment of this application;

[0011] Figure 4A A schematic diagram of a skill control area provided in an embodiment of this application;

[0012] Figure 4B A schematic diagram of a skill control area provided in an embodiment of this application;

[0013] Figure 4C A schematic diagram of a skill control area provided in an embodiment of this application;

[0014] Figure 4D A schematic diagram of the outline of a skill control area provided in an embodiment of this application;

[0015] Figure 4E A schematic diagram of the outline of a skill control area provided in an embodiment of this application;

[0016] Figure 4F A schematic diagram of the outline of a skill control area provided in an embodiment of this application;

[0017] Figure 4G A schematic diagram of the outline of a skill control area provided in an embodiment of this application;

[0018] Figure 4H The diagram shown is a state position diagram of each skill trigger control in a skill control area after a unified size, provided in an embodiment of this application.

[0019] Figure 4I This is a binarized image of a skill control region provided in an embodiment of this application;

[0020] Figure 4J This is a binarized image of a skill control region provided in an embodiment of this application;

[0021] Figure 5 This is a schematic diagram of the composition structure of the processing device provided in the embodiments of this application;

[0022] Figure 6 This is a schematic diagram of a hardware entity of an electronic device provided in an embodiment of this application. Detailed Implementation

[0023] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of the invention will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.

[0024] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0025] In the following description, the terms "first, second, third" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, third" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0026] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0027] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0028] It should be understood that the embodiments described herein are merely illustrative of the technical solutions of this application and are not intended to limit the technical scope of this application.

[0029] This application provides a processing method, such as... Figure 1 As shown, the method includes:

[0030] Step S110: Obtain the interactive display image to be identified, and determine the target interactive area in the interactive display image;

[0031] Here, the interactive display image to be identified can be an image displayed on an electronic device that can be interacted with by the user. For example, the interactive display image can be a game interface displayed on an electronic device, which needs to include an interactive area for user interaction; it can also be an online teaching software display image displayed on an electronic device that includes a user interactive area; or it can be a drawing software interface displayed on an electronic device that includes a user interactive area.

[0032] The target interactive area in an interactive display image refers to the area that can be interacted with by the user. For example, it could be the skill control area set on a game interface; it could be the control area that the user can operate on the display image of online teaching software; or it could be the area provided for the user to manipulate or click on in drawing software.

[0033] During implementation, it is necessary to determine the target interactive area in the interactive display image to be identified. For example, if the interactive display image is a game interface, the skill control area is determined; if the interactive display image is an online teaching software display image, the control area that the user can operate is determined; if the interactive display image is a drawing software interface, the interactive area that can be provided to the user for manipulation or clicking is determined.

[0034] Step S120: Identify the display parameters of the target interactive control in the target interactive area, so as to obtain the trigger signal of the target interactive control responding to a specific operation based at least on the display parameters.

[0035] Here, the target interactive area includes at least one target interactive control, which can be clicked by the user. Clicking the control generates a trigger signal in response to a specific action. The target interactive control includes display parameters, which can vary based on the user's actions on the control.

[0036] For example, when the target interaction area is the skill control area of ​​the game interface, the target interaction control can be a skill trigger control, which is provided for the user to click to control the character in the game to release game skills. When the user clicks the skill trigger control, the display parameters set on the skill trigger control will change. For example, if the user clicks the skill trigger control to trigger the character's ultimate move, the display parameters will be presented as countdown numbers. Here, "ultimate move" is a gaming term, generally referring to the last skill in the game. The term "ultimate move" originates from fighting games and originally referred to a super special move.

[0037] When the target interactive area is a control area for displaying images in online teaching software, the target interactive control can be a control provided by the online teaching software for raising a hand to speak or leaving a message, which is provided for users to click to interact with the teacher; when the user clicks the control, the display parameters set on the control will change, and the form of change is not limited.

[0038] When the target interactive area is an interactive area provided by the drawing software interface for manipulation or clicking, the target interactive control can be a manipulation or clicking control of the drawing software, which is provided to the user for manipulation or clicking to complete the drawing; when the user manipulates or clicks the control, the display parameters set on the control will change, and the form of change is not limited.

[0039] During implementation, the system identifies the display parameters of the target interactive control and determines the trigger signal for the target interactive control to respond to a specific operation based on the identified display parameters. For example, in a game scenario, the system can identify the display parameters on a skill trigger control. If the displayed parameters are numbers presented in the form of a countdown, it can determine that the character should unleash a powerful attack.

[0040] In this embodiment, an interactive display image to be identified is first obtained, a target interactive area in the interactive display image is determined, and then the display parameters of the target interactive control in the target interactive area are identified, so as to obtain the trigger signal of the target interactive control responding to a specific operation based at least on the display parameters. This solves the problem in the prior art where different systems use different methods to obtain the trigger signal of a specific operation, and most systems do not have open interfaces for obtaining system data, making it impossible to identify the trigger signal of a specific operation. This method does not rely on system-provided state data; the system can autonomously identify the trigger signal of the target interactive control responding to a specific operation. This identification method is not constrained by the system data interface, effectively improving identification efficiency.

[0041] This application provides a processing method, such as... Figure 2 As shown, the method includes:

[0042] Step S210: Obtain the interactive display image of the first number of frames, and determine the rate of change of the first region in the interactive display image;

[0043] Here, the first region can include all interactively displayed images, or any region of the interactively displayed images. The rate of change is the ratio of the amount of change to the time taken for that change to occur; that is, the ratio of the amount of change in the image within the first region to the time taken for that change to occur.

[0044] During implementation, it is necessary to first acquire the interactive display images of the first number of frames, and then determine the rate of change of the first region. For example, if the interactive display image is a game interface, all areas of the game interface except for the skill control area will change as the game progresses. It is necessary to first determine the area that will change as the first region, and then acquire the rate of change of the first region.

[0045] Step S220: If the rate of change reaches a first threshold, acquire a second number of interactive display images to determine the target interactive area based at least on the second number of interactive display images;

[0046] Here, the first threshold can be determined by the user based on the actual situation. When the rate of change of the first region reaches the first threshold, it means that the change of the first region has reached the condition that the target interactive region can be determined by using the rate of change.

[0047] During implementation, once the change in the first region reaches a point where the rate of change can be used to determine the target interactive region, a second number of interactive display images are acquired. Here, the first number can be less than or equal to the second number. The system can determine the target interactive region based on the second number of interactive display images, or it can determine the target interactive region using the acquired first number of interactive display images. Here, the target interactive region is the region whose rate of change meets the requirement; that is, the region in the interactive display image with a smaller rate of change than the first region can be identified as the target interactive region. For example, in a game scenario, since the skill control area does not change significantly as the game progresses, the region in the game interface with a rate of change that meets the requirement can be identified as the skill control area.

[0048] Step S230: Identify the display parameters of the target interactive control in the target interactive area, so as to obtain the trigger signal of the target interactive control responding to a specific operation based at least on the display parameters;

[0049] Step S240: Based on the trigger signal, output target content corresponding to the response content triggered by the target interactive control is output on the input component and / or light-emitting component of the electronic device; and / or,

[0050] Step S250: Based on the trigger signal, perform the operation of recording the display content output in response to the triggering of the target interactive control.

[0051] Here, the input components of the electronic device can be a keyboard, a mouse, etc., and the light-emitting components can be keyboard lights on the keyboard or light-emitting components on the mouse.

[0052] During implementation, the system can utilize the input components and / or light-emitting components of electronic devices to output the target output content triggered by the target interactive control, and record the operation of displaying the content output in response to the triggering of the target interactive control. For example, in a game scenario, when a character is determined to unleash a powerful attack, the system can draw an RGB animation on the RGB keyboard backlight, or automatically record the screen to capture exciting moments.

[0053] In this embodiment, a first number of interactive display images are first acquired, and the rate of change of a first region in the interactive display images is determined. Then, if the rate of change reaches a first threshold, a second number of interactive display images are acquired, and the target interactive region is determined based at least on the second number of interactive display images. In this way, when the rate of change of the first region reaches the first threshold, the region in the interactive display image whose change meets the requirements can be effectively determined as the target interactive region, reducing performance consumption.

[0054] In this embodiment, based on the trigger signal, the input component and / or light-emitting component of the electronic device outputs target output content corresponding to the response content triggered by the target interactive control; and / or, based on the trigger signal, an operation is performed to record the display content output in response to the triggering of the target interactive control. In this way, the acquired trigger signal can be used to bring users many useful or eye-catching functions, such as drawing an RGB animation in the RGB keyboard backlight when a powerful move is released, displaying a cool lighting effect animation on the keyboard, or saving a video to record a wonderful moment, enhancing the user's immersive operating experience.

[0055] Step 230 in the above embodiments, "determining the target interactive region based at least on the interactive display images of the second number of frames," may include at least one of the following steps:

[0056] Step 231: Determine feature points in the interactive display image of the second number of frames whose rate of change is lower than a second threshold; determine first contour information based at least on the feature points; and determine the target interactive region based on the first contour information; or,

[0057] Here, feature points can be pixels or coordinate points. The image is divided into several small squares, each of which can be called a pixel. Coordinate points can be points on the image including their position coordinates. The second threshold can be set by the user according to actual needs. Since the target interaction area can be determined based on the first contour information, the first contour information can also be called the contour information of the target interaction area.

[0058] During implementation, the contour information of the target interactive area can be determined based on pixels or coordinates in the interactive image whose rate of change is lower than a second threshold. For example, in a game scenario, since the game is in progress, the pixels or coordinates on the contour of the skill control area do not change. Therefore, the contour information of the skill control area of ​​the game interface can be determined based on pixels or coordinates in the game interface with a rate of change lower than the second threshold in a second number of frames.

[0059] Step 232: Determine feature points in the interactive display image of the second number of frames whose rate of change is lower than a second threshold; determine first contour information and first position information based at least on the feature points; determine the target interactive region based on the first contour information and the first position information; the first position information at least characterizes the positional distribution of the feature points in the interactive display image; or,

[0060] Here, the first location information is used to determine the position of the target interactive area in the interactive display image. When the feature points are coordinate points, feature points that can characterize the first contour information are determined, that is, the positional distribution of the target interactive area in the interactive display image can be determined.

[0061] Step 233: Determine feature points in the interactive display images of the second number of frames that have the same resolution threshold or the same size, and whose rate of change is lower than a third threshold; determine second contour information based at least on the feature points; and determine the target interactive region based on the second contour information; or,

[0062] In some embodiments, the interactive display images of the second number of frames include interactive display images with the same resolution threshold, different resolution thresholds, the same size, and different sizes. For example, when a user uses an electronic device, they may adjust the screen's distribution rate, display ratio, etc., resulting in the system acquiring interactive display images of different resolutions and / or different sizes. The system needs to determine the second contour information based on feature points with a rate of change lower than a third threshold in interactive display images with the same resolution or the same size, and then determine the target interactive area based on the second contour information.

[0063] Step 234: Determine feature points in the interactive display images of the second number of frames that have the same resolution threshold or the same size and whose rate of change is lower than a third threshold. Determine second contour information and second position information based on the feature points. Determine the target interactive region based on the second contour information and the second position information. The second position information at least characterizes the positional distribution of the feature points in the interactive display images with the same resolution threshold.

[0064] Here, the second location information is used to determine the location of the target interactive region in an interactive display image with the same resolution threshold. When the feature points are coordinate points, feature points that can characterize the second contour information are determined; that is, the positional distribution of the target interactive region in the interactive display image can be determined.

[0065] In this embodiment, feature points with a change rate lower than a second threshold in the interactive display image of the second number of frames are first determined, and then the first contour information and / or first position information of the target interactive area can be effectively determined based on the feature points.

[0066] In this embodiment of the application, when the interactive display images of the second number of frames include interactive display images with the same resolution threshold, different resolution thresholds, the same size, and different sizes, feature points with a change rate lower than the third threshold in the interactive display images of the second number of frames with the same resolution threshold or the same size are first determined. Then, based on the feature points, the second contour information and / or the second position information of the target interactive area can be effectively determined.

[0067] This application provides a processing method, such as... Figure 3 As shown, the method includes:

[0068] Step S310: Obtain attribute information of the currently output display image; obtain an interactive display image to be identified based at least on the attribute information; determine a target interactive area in the interactive display image based at least on the indication information in the attribute information, wherein the attribute information includes application information that outputs the interactive display image, and the indication information for the target interactive area is different for different applications; or,

[0069] Here, the attribute information of the displayed image can include indicative information, that is, information representing the type of the displayed image, or it can be the image's identifier or name. For example, in a game scenario, the attribute information of the displayed image could be, for instance, "League of Legends" or "Honor of Kings." Since the skill control area positions differ between different games, but are the same within the same game, the skill control area can be determined based on the game's name.

[0070] Step S320: Based on at least one selection operation performed by the target user on the electronic device, an interactive display image to be identified is obtained, and the second region determined by the selection operation is determined as the target interactive region, wherein the size of the second region is equal to or smaller than the size of the interactive display image;

[0071] During implementation, the system can first obtain the target interaction area selected by the user. For example, in the scenario of displaying images in online teaching software, the user can select and define the control area.

[0072] Step S330: Obtain the position and / or size of the target interaction area;

[0073] During implementation, steps 231 to 234 in the above embodiments can be referred to to obtain the position and / or size of the target interactive area.

[0074] Step S340: If the position and / or size indicate that the target interactive area does not meet the scaling condition, obtain the position distribution information of the target interactive control in the target interactive area, and obtain the display parameters of the target interactive control based on the position distribution information; and / or,

[0075] Here, the target interactive control can be a control set in the target interactive area to provide the user with a click or operation trigger signal. For example, in a game scene, the target interactive control can be a skill trigger control. The system can obtain the position distribution information of the skill trigger control in the skill control area. Since the display parameters can be located on the corresponding skill trigger control, the display parameters of the skill trigger control can be obtained based on this position distribution information.

[0076] Step S350: If the position and / or size indicate that the target interactive area meets the scaling condition, adjust the target interactive area to a uniform size, and obtain its display parameters based on the obtained position distribution information of the target interactive control;

[0077] During implementation, if the position and / or size indicate that the target interactive area meets the scaling conditions, the target interactive area can be adjusted to a uniform size, and the display parameters of the target interactive control can be obtained at a relatively fixed position in the target interactive area.

[0078] Step S360: Obtain the trigger signal for the target interactive control to respond to a specific operation based at least on the display parameters.

[0079] In this embodiment, attribute information of the currently output display image can be obtained, and the target interactive area in the interactive display image can be effectively determined based on this attribute information. Furthermore, the target interactive area can be effectively determined based on at least one selection operation performed by the target user on the electronic device, improving the recognition efficiency of the target interactive area.

[0080] In this embodiment, if the position and / or size indicate that the target interactive area meets the scaling conditions, the target interactive area is adjusted to a uniform size, and its display parameters are obtained based on the obtained position distribution information of the target interactive control. This allows for the effective acquisition of the display parameters of the target interactive control at a relatively fixed position within the target interactive area, improving the efficiency of display parameter recognition.

[0081] Step S360 in the above embodiments, "obtaining the trigger signal for the target interactive control to respond to a specific operation based at least on the display parameters," may include at least one of the following steps:

[0082] Step 361: Obtain display parameters for at least two frames of the target interactive control image. If the changes in the display parameters satisfy the corresponding conditions, determine that the target interactive control has performed a specific operation and generate the trigger signal; or,

[0083] Here, the corresponding conditions can be set by the user based on the actual situation. For example, in a game scenario, if the displayed parameters appear as countdown numbers, it can be determined that the user has clicked the skill trigger control to unleash a powerful attack.

[0084] During implementation, the system first needs to acquire the display parameters of at least two frames of the target interactive control image. Then, if the changing display parameters meet the corresponding conditions, it can be determined that the target interactive control has been aware of a specific operation, generating a trigger signal. For example, to acquire the signal of releasing a powerful move in a game scene, at least two frames of display parameters need to be acquired. If the display parameters are determined to be changing countdown numbers, it can be determined that the character in the game is releasing a powerful move.

[0085] Step 362: Obtain a target sample of the target interactive control performing a specific operation; if the display parameters match the target sample, determine that the target interactive control is performing a specific operation and generate the trigger signal.

[0086] Here, the target sample can be a sample that can determine whether a specific operation is performed on the target interactive control. For example, in the scenario of displaying images in online teaching software, the target sample can be set as the change sample corresponding to the display parameters of the control when the user triggers a scenario such as a hand-raising control to speak.

[0087] During implementation, the system first acquires the target sample, and then determines to generate a trigger signal if the display parameters match the target sample. For example, the system can determine that a user is raising their hand to speak if the display parameters of the "raise hand to speak" control match the change sample generated when the user triggers the control.

[0088] Step 363: Obtain the binarized image of the target interactive control. If the display parameters of the binarized image of the target interactive control match the first sample, but do not match other samples in the obtained sample set; wherein, the sample set is the set of samples corresponding to the target interactive control at each time between two adjacent trigger times, and the first sample is the sample of the target interactive control in the state of waiting to be triggered;

[0089] Here, image binarization can be the process of setting the grayscale value of pixels in an image to 0 or 255, thus presenting the entire image with a distinct black and white effect. In digital image processing, image binarization greatly reduces the amount of data in the image, thereby highlighting the outline of the target. The sample set can include samples of the target interactive control at each time between two adjacent triggering moments. For example, the game's sample set can include samples of skill triggering controls at each time between two adjacent triggering moments, and these samples can be numbers from 1 to 10.

[0090] During implementation, since the target interactive control can be an RGB image, the system can first binarize the RGB image and then match the binarized display parameters against a first sample. Then, it matches each sample in the sample set to determine whether the target interactive control should process the triggered state.

[0091] Step 364: Obtain input operation information acting on the electronic device, and obtain the trigger signal for the target interactive control to respond to a specific operation based on the input operation information and the display parameters.

[0092] Here, the input information from the electronic device can be information triggered by the user pressing keyboard keys, mouse actions, or voice input. The system can determine whether to receive a trigger signal based on this input information and display parameters.

[0093] In this embodiment, display parameters of at least two frames of target interactive control images are obtained. If the changes in the display parameters satisfy a corresponding condition, it is determined that the target interactive control is performing a specific operation, and the trigger signal is generated. This allows for setting change parameters that meet requirements, thus effectively determining the trigger signal.

[0094] In this embodiment, a target sample of the target interactive control performing a specific operation is obtained. If the display parameters match the target sample, it is determined that the target interactive control is performing a specific operation, and the trigger signal is generated. This allows for the determination of the target sample based on actual conditions, effectively identifying the trigger signal and improving the efficiency of trigger signal determination.

[0095] In this embodiment, a binarized image of the target interactive control is obtained. If the display parameters of the binarized image of the target interactive control match a first sample, but do not match other samples in the obtained sample set, then by using the binarized image and the sample set, a trigger signal can be efficiently determined when the display parameters match the first sample. Similarly, when the display parameters match other samples in the sample set, a non-triggered signal or other corresponding system states can be efficiently determined.

[0096] In this embodiment, input operation information applied to the electronic device is obtained, and a trigger signal for the target interactive control to respond to a specific operation is obtained based on the input operation information and the display parameters. This allows for more accurate and efficient determination of the trigger signal using the user's input operation information and display parameters.

[0097] Gaming laptop sales are growing rapidly. Gamers appreciate powerful performance, cool lighting effects, and the ability to share exciting gameplay videos. As a result, gaming PC manufacturers have developed various service software around these user needs. A core technology for these features is obtaining information about whether a hero's ultimate ability has been used. Currently, some games have opened APIs to directly obtain game data, such as League of Legends, the most popular PC game. However, this API only provides hero skill level information; information about when a hero uses their ultimate ability is not shared. Another example is Dota 2, which uses a socket communication mechanism to obtain information about when a hero uses their ultimate ability, but this method may require authorization from the game company. These solutions vary across different games, making data acquisition methods particularly complex. More importantly, most games do not provide open APIs for obtaining game data.

[0098] Taking an interactive display image as the game interface, the target interactive area as the skill control area, and the target interactive control as a skill trigger control as an example, this application provides a method for identifying a game character releasing a powerful skill. The method includes:

[0099] Step 401: Capture the skill control area of ​​the game interface;

[0100] In some embodiments, the system does not directly perform contour localization and skill state recognition. Instead, it can first calculate the rate of change through sampling. When the rate of change exceeds a certain threshold, it can start contour localization of the skill control area to reduce performance consumption.

[0101] The skill control area in a game is usually fixed in a relative position, but the size and position of the skill control area will vary depending on the resolution. Alternatively, users can adjust the size of the skill control area. Figure 4A , 4B As shown in 4C, the size and position of the skill control area 41 are different. Therefore, the location and size of the skill control area are crucial. By observing that the skill control area's outline is on the game map, its outer contour remains constant, while the map changes as it moves, the outline position and size of the skill control area can be calculated.

[0102] Here, the contour recognition and localization of the skill control area can be achieved using the following method: The map in the game scene is constantly changing, while the skill control area floats above the map with a relatively fixed position. By comparing a set of images (only erasing the changing points each time; if a point is already marked as a changing point, the comparison is not repeated), the contour matrix and position of the skill control area can be calculated. Figure 4D , 4E The black box 42 included in 4F and 4G is the outline area of ​​the skill control area marked by software algorithm (Note: Although the position of the skill control area is relatively fixed, its size and resolution are variable, so calculating the outline and position is very important).

[0103] In some embodiments, after the system acquires the game interface, it can pre-capture the approximate location of the skill control area (capture local content), then sample and calculate the rate of change. When the rate of change is greater than a certain threshold, the outline position and skill state are calculated to improve the system performance.

[0104] Here, through the contour positioning described above, the location and size of the current skill control area have been determined. Then, by scaling it to a uniform size, the specific state of the skill control area can be processed from a relatively fixed position, such as... Figure 4H The diagram shown is a state position diagram of each skill trigger control 421 to 427 in a uniformly sized skill control area 42 provided in an embodiment of this application.

[0105] Step 402: Extract feature values ​​of the skill control area using image processing methods;

[0106] During implementation, the location and size of the skill control area (various resolutions and user-adjustable interface sizes) are obtained as described above and uniformly mapped into a fixed-size image. The key feature values ​​of specific skills are contained in a fixed position within this uniform-size image, thereby obtaining information about the skill feature values.

[0107] If the extracted feature values ​​of the skill control area match the sample of skill release feature values, it means the skill has been released. For example, after a character in a game releases a powerful skill, a countdown timer will appear, indicating the skill's cooldown. After releasing a powerful skill, you have to wait for a period of time before you can release it again. Therefore, the appearance of a countdown timer indicates that a powerful skill has been released. If the extracted feature values ​​of the skill control area match the sample of a non-skill release feature value, it means the skill has not been released. This can reduce the number of matchmaking attempts and improve efficiency in the game.

[0108] In some embodiments, such as Figure 4I and 4JThis application provides a binarized image of a skill control area after a series of image processing steps. This image is present for most of the game's runtime, except for a small portion of the time spent releasing powerful skills. Therefore, if the skill control area matches... Figure 4I The image shown indicates that no ultimate skill was released, so there's no need to continue comparing and matching the numerical samples of ultimate skill release signals. If the skill control area matches... Figure 4J The image shown illustrates the unleashing of a powerful attack.

[0109] In some embodiments, matching samples and high-frequency non-matching samples can be combined to improve matching speed. For example, a fixed pattern when a skill feature value does not appear can be used as a signal of whether a special move has been used, reducing the number of matching attempts and improving efficiency.

[0110] Step 403: Based on the feature values ​​of the skill control area, obtain the signal of the character releasing the ultimate move in the game.

[0111] During implementation, the signal of a character releasing a special move can be used to bring many useful or eye-catching functions to game players, such as drawing an RGB animation on the RGB keyboard backlight when the special move is released, or saving a video to record the exciting moment.

[0112] This application proposes a method for identifying the release of ultimate skills in games. It identifies skill release information through feature values. Under different screen resolutions, the method identifies the outline and position of the skill control area by analyzing the change rate of the map outside the skill control area. Based on the position and outline of the skill control area, it obtains the signal that the user clicks the skill trigger control to trigger the character's ultimate skill release. Thus, based on the feature values ​​or information of the ultimate skill release, and by locating the position and size of the skill control area according to the change values ​​of the skill control area and non-skill control areas, it supports scenarios with multiple resolutions and varying skill control area sizes. Local content is captured and pre-processed using the change rate. Algorithms such as incorporating non-matching non-skill release samples during matching improve efficiency. This method can autonomously identify ultimate skill release information without relying on game-provided state data, offering a unified and highly efficient approach.

[0113] Based on the foregoing embodiments, this application provides a processing device, which includes various modules, each module including sub-modules, and each sub-module including units. It can be implemented by a processor in an electronic device; of course, it can also be implemented by specific logic circuits. In the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), etc.

[0114] Figure 5This is a schematic diagram of the composition structure of the processing device provided in the embodiments of this application, as shown below. Figure 5 As shown, the device 500 includes:

[0115] The determining module 501 is used to obtain the interactive display image to be identified and determine the target interactive area in the interactive display image;

[0116] The identification module 502 is used to identify the display parameters of the target interactive control in the target interactive area, so as to obtain the trigger signal of the target interactive control responding to a specific operation based at least on the display parameters.

[0117] In some embodiments, the determining module 501 includes a first determining submodule and a second determining submodule, wherein the first determining submodule is configured to acquire a first number of interactive display images and determine the rate of change of a first region in the interactive display images; the second determining submodule is configured to acquire a second number of interactive display images if the rate of change reaches a first threshold, so as to determine the target interactive region based at least on the second number of interactive display images.

[0118] In some embodiments, the determining submodule includes a first determining unit, a second determining unit, a third determining unit, and a fourth determining unit, wherein the first determining unit is configured to determine feature points in the interactive display image of the second number of frames with a change rate lower than a second threshold, determine first contour information based at least on the feature points, and determine the target interactive region based on the first contour information; the second determining unit is configured to determine feature points in the interactive display image of the second number of frames with a change rate lower than a second threshold, determine first contour information and first position information based at least on the feature points, and determine the target interactive region based on the first contour information and the first position information, wherein the first position information at least characterizes the positional distribution of the feature points in the interactive display image; the third determining unit is configured to determine the target interactive region based on the first contour information and the first position information; the second determining unit is configured to determine feature points in the interactive display image with a change rate lower than a second threshold, determine first contour information and first position information based at least on the feature points, and determine the target interactive region based on the first contour information and the first position information, wherein the first position information at least characterizes the positional distribution of the feature points in the interactive display image; the third determining unit is configured to determine the target interactive region based on the first contour information and the first position information. The first unit is used to determine feature points in the interactive display images of the second number of frames that have the same resolution threshold or the same size and have a rate of change lower than a third threshold, determine second contour information based at least on the feature points, and determine the target interactive region based on the second contour information; the second determining unit is used to determine feature points in the interactive display images of the second number of frames that have the same resolution threshold or the same size and have a rate of change lower than a third threshold, determine second contour information and second position information based on the feature points, and determine the target interactive region based on the second contour information and the second position information, wherein the second position information at least characterizes the positional distribution of the feature points in the interactive display images with the same resolution threshold.

[0119] In some embodiments, the determining module 501 includes a third determining submodule and a fourth determining submodule. The third determining submodule is configured to obtain attribute information of the currently output display image, obtain an interactive display image to be identified based at least on the attribute information, and determine a target interactive area in the interactive display image based at least on indication information in the attribute information. The attribute information includes application information that outputs the interactive display image, and the indication information for the target interactive area differs for different applications. The fourth determining submodule is configured to obtain the interactive display image to be identified based on at least one selection operation performed by the target user on the electronic device, and determine a second area determined by the selection operation as the target interactive area. The size of the second area is equal to or smaller than the size of the interactive display image.

[0120] In some embodiments, the identification module 502 includes a first obtaining submodule, a second obtaining submodule, and a third obtaining submodule, wherein the first obtaining submodule is used to obtain the position and / or size of the target interactive area; the second obtaining submodule is used to obtain the position distribution information of the target interactive control in the target interactive area if the position and / or size indicates that the target interactive area does not meet the scaling conditions, and obtain the display parameters of the target interactive control based on the position distribution information; the third obtaining submodule is used to adjust the target interactive area to a uniform size if the position and / or size indicates that the target interactive area meets the scaling conditions, and obtain its display parameters based on the obtained position distribution information of the target interactive control.

[0121] In some embodiments, the identification module 502 further includes a fifth determining submodule and a sixth determining submodule, wherein the fifth determining submodule is used to obtain display parameters of at least two frames of target interactive control images, and if the change parameters of the display parameters meet the corresponding conditions, determine that the target interactive control has performed a specific operation and generate the trigger signal; the sixth determining submodule is used to obtain a target sample of the target interactive control performing a specific operation, and if the display parameters match the target sample, determine that the target interactive control has performed a specific operation and generate the trigger signal.

[0122] In some embodiments, the recognition module 502 is further configured to obtain a binarized image of the target interactive control. If the display parameters of the binarized image of the target interactive control match a first sample, they do not match other samples in the obtained sample set. The sample set is a set of samples corresponding to the target interactive control at each time between two adjacent trigger times, and the first sample is a sample of the target interactive control in a state to be triggered.

[0123] In some embodiments, the identification module 502 is further configured to obtain input operation information acting on the electronic device, and obtain a trigger signal for the target interactive control to respond to a specific operation based on the input operation information and the display parameters.

[0124] In some embodiments, the device further includes an output module for outputting target output content corresponding to the response content triggered by the target interactive control on the input component and / or light-emitting component of the electronic device based on the trigger signal; and / or, performing an operation based on the trigger signal to record the display content output in response to the triggering of the target interactive control.

[0125] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0126] It should be noted that, in the embodiments of this application, if the above methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of software products. These computer software products are stored in a storage medium and include several instructions to cause electronic devices (such as mobile phones, tablets, laptops, desktop computers, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0127] Correspondingly, embodiments of this application provide a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps in the processing method provided in the above embodiments.

[0128] Correspondingly, embodiments of this application provide an electronic device, Figure 6 A schematic diagram of a hardware entity of an electronic device provided in an embodiment of this application, such as... Figure 6 As shown, the hardware entity of the device 600 includes a memory 601 and a processor 602. The memory 601 stores a computer program that can run on the processor 602. When the processor 602 executes the program, it implements the steps in the processing method provided in the above embodiments.

[0129] The memory 601 is configured to store instructions and applications executable by the processor 602, and can also cache data to be processed or already processed (e.g., image data, audio data, voice communication data and video communication data) of the processor 602 and various modules in the electronic device 600, and can be implemented by flash memory or random access memory (RAM).

[0130] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0131] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.

[0132] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0133] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.

[0134] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.

[0135] In addition, each functional unit in the various embodiments of this application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.

[0136] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.

[0137] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device (which may be a mobile phone, tablet computer, laptop computer, desktop computer, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROM, magnetic disks, or optical disks.

[0138] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0139] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0140] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0141] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A processing method, comprising: Obtain the interactive display image to be identified, and determine the target interactive area in the interactive display image; Identify the display content data corresponding to the positional distribution information of the target interactive controls in the target interactive area; When the change in the displayed content data matches the matching sample, a trigger signal is obtained for the target interactive control to respond to a specific operation, so as to provide the user with corresponding functional services using the trigger signal. The change in the displayed content data is the change of the countdown number.

2. The method according to claim 1, wherein determining the target interactive region in the interactive display image comprises: Acquire a first number of interactive display images and determine the rate of change of a first region in the interactive display images; If the rate of change reaches a first threshold, a second number of interactive display images are acquired to determine the target interactive area based at least on the second number of interactive display images.

3. The method according to claim 2, wherein, Determining the target interactive region based at least on the interactive display images of the second number of frames includes: In the interactive display image of the second number of frames, feature points with a change rate lower than a second threshold are identified; first contour information is determined based at least on the feature points; and the target interactive region is determined based on the first contour information; or, Determine feature points in the interactive display image of the second number of frames whose rate of change is lower than a second threshold; determine first contour information and first position information based at least on the feature points; determine the target interactive region based on the first contour information and the first position information; the first position information at least characterizes the positional distribution of the feature points in the interactive display image; or In the interactive display images of the second number of frames, feature points with the same resolution threshold or the same size and a rate of change lower than a third threshold are identified. Second contour information is determined based at least on these feature points, and the target interactive region is determined based on the second contour information; or, Feature points with the same resolution threshold or the same size in the interactive display images of the second number of frames with a rate of change lower than a third threshold are identified. Second contour information and second position information are determined based on the feature points. The target interactive region is determined based on the second contour information and the second position information. The second position information at least characterizes the positional distribution of the feature points in the interactive display images with the same resolution threshold.

4. The method according to claim 1, wherein determining the target interactive region in the interactive display image comprises: Obtain attribute information of the currently output display image; obtain an interactive display image to be identified based at least on the attribute information; determine a target interactive area in the interactive display image based at least on the indication information in the attribute information, wherein the attribute information includes application information that outputs the interactive display image, and the indication information for the target interactive area is different for different applications; or, An interactive display image to be identified is obtained based on at least one selection operation performed by the target user on the electronic device, and the second region determined by the selection operation is defined as the target interactive region, wherein the size of the second region is equal to or smaller than the size of the interactive display image.

5. The method according to any one of claims 1 to 4, wherein identifying the display content data corresponding to the positional distribution information of the target interactive controls in the target interactive area includes: Obtain the position and / or size of the target interactive area; If the position and / or size indicate that the target interactive area does not meet the scaling conditions, obtain the position distribution information of the target interactive control in the target interactive area, and obtain the display content data of the target interactive control based on the position distribution information; and / or, If the position and / or size indicate that the target interactive area meets the scaling conditions, the target interactive area is adjusted to a uniform size, and the display content data is obtained based on the obtained position distribution information of the target interactive control.

6. The method according to claim 5, wherein, The step of obtaining the trigger signal for the target interactive control to respond to a specific operation when the displayed content data matches the matching sample includes: Obtain display content data for at least two frames of the target interactive control image; if the change parameters of the display content data satisfy a corresponding condition, determine that the target interactive control has performed a specific operation, and generate the trigger signal; or, Obtain a target sample of the target interactive control performing a specific operation. If the displayed content data matches the target sample, determine that the target interactive control is performing a specific operation and generate the trigger signal.

7. The method according to claim 6, wherein, Also includes: Obtain the binarized image of the target interactive control. If the display content data of the binarized image of the target interactive control matches the first sample, it does not match other samples in the obtained sample set. The sample set is a collection of samples corresponding to the target interactive control at each time between two adjacent trigger times, and the first sample is a sample of the target interactive control in a state to be triggered.

8. The method according to claim 5, wherein, The step of obtaining the trigger signal for the target interactive control to respond to a specific operation when the displayed content data matches the matching sample includes: Obtain input operation information applied to the electronic device, and obtain a trigger signal for the target interactive control to respond to a specific operation based on the input operation information and the display content data.

9. The method according to any one of claims 1 to 8, wherein, It also includes: outputting target output content corresponding to the response content triggered by the target interactive control on the input component and / or light-emitting component of the electronic device based on the trigger signal; and / or, Based on the trigger signal, the operation of recording the display content output in response to the triggering of the target interactive control is executed.

10. A processing apparatus, comprising: The determination module is used to obtain the interactive display image to be identified and determine the target interactive area in the interactive display image; The identification module is used to identify the display content data corresponding to the position distribution information of the target interactive controls in the target interactive area; The acquisition module is used to acquire the trigger signal of the target interactive control responding to a specific operation when the displayed content data matches the matching sample, so as to provide the user with corresponding functional services using the trigger signal, wherein the change in the displayed content data is the change of the countdown number.

Images