Virtual scene-based operation recognition method, device, equipment, medium and product

Abstract

The present application provides a method, device, equipment, computer-readable storage medium and computer program product for operation recognition based on a virtual scene; the method includes: obtaining operation data corresponding to a control operation performed on a virtual object in a virtual scene; analyzing the operation data to obtain the operation characteristics of the control operation; based on the operation characteristics, recognizing the control operation to obtain a recognition result; wherein the recognition result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by a terminal, or based on the interface of the virtual scene displayed by an external device of the terminal. Through the present application, the recognition accuracy can be improved and the recognition cost can be reduced.

Description

[0001] Priority statement

[0002] This application claims priority to application number 202111455340.X, filing date December 1, 2021, and title: Virtual scene-based operation identification method, device, equipment, medium and product. Technical Field

[0003] The present application relates to computer technology, and in particular to a method, device, equipment, computer-readable storage medium and computer program product for operation recognition based on a virtual scene. Background Art

[0004] In mobile virtual scene applications such as mobile game applications, in order to take care of the end game players (players who use computers to play games), a special gameplay method that allows users to use external devices (such as simulators) on the computer to play mobile games has been added. However, since the operation on the computer is more flexible and convenient than the operation on the mobile terminal (such as smartphones), in order to ensure fairness, when matching players before the game, players using computer simulators can only be matched with players who also use computer simulators, and players using mobile phones will only be matched with players who also use mobile phones. In view of the convenience of computer operation, some players who register to use mobile phones use peripherals to cheat, such as connecting the mobile phone to the computer, and using the keyboard and mouse to operate the computer simulator to fight with other players using mobile phones, which is extremely unfair to other players using mobile phones.

[0005] The related technology uses special detection equipment to detect whether the player using the mobile phone has connected to an external device, such as determining whether the player using the mobile phone has connected to an external device on the cheating blacklist for identification. However, given the limited number of external devices in the blacklist, if the external device used by the player is not on the blacklist, it will be mistakenly believed that the external device is legal, and the recognition accuracy is low. Moreover, due to the diversity of external devices and the rapidity of updates, the blacklist directory needs to be continuously updated as external devices are continuously updated, resulting in high costs. Summary of the invention

[0006] The embodiments of the present application provide a virtual scene-based operation recognition method, apparatus, device, computer-readable storage medium, and computer program product, which can improve recognition accuracy and reduce recognition costs.

[0007] The technical solution of the embodiment of the present application is implemented as follows:

[0008] The present application provides an operation recognition method based on a virtual scene, comprising:

[0009] Acquire operation data corresponding to the control operation performed on the virtual object in the virtual scene;

[0010] Analyzing the operation data to obtain the operation characteristics of the control operation;

[0011] Based on the operation feature, identifying the control operation to obtain an identification result;

[0012] The recognition result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or is input based on the interface of the virtual scene displayed by an external device of the terminal.

[0013] The embodiment of the present application provides an operation recognition device based on a virtual scene, comprising:

[0014] An acquisition module, used to acquire operation data corresponding to the control operation performed on the virtual object in the virtual scene;

[0015] An analysis module, used for analyzing the operation data to obtain the operation characteristics of the control operation;

[0016] an identification module, used to identify the control operation based on the operation feature and obtain an identification result;

[0017] The recognition result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or is input based on the interface of the virtual scene displayed by an external device of the terminal.

[0018] In the above scheme, the identification module is also used to obtain the operation characteristics corresponding to the target type of operation when the target type of operation is input based on the display interface of the terminal or the external device when the control operation is used to control the virtual object to perform a target type of operation; and identify the control operation by combining the operation characteristics of the control operation with the operation characteristics corresponding to the target type of operation to obtain the identification result.

[0019] In the above scheme, the analysis module is also used to analyze the operation data corresponding to the orientation adjustment operation when the target type operation is an orientation adjustment operation, and obtain at least one of the following operation characteristics of the orientation adjustment operation: an adjustment direction corresponding to the orientation adjustment operation, and a trigger position corresponding to the orientation adjustment operation; when the orientation adjustment operation is input based on the display interface of the external device, the operation characteristics corresponding to the orientation adjustment operation include: the number of adjustable directions is the target number, there is a trigger position for each adjustable direction, and the adjustment direction corresponding to each orientation adjustment belongs to the target number of adjustable directions.

[0020] In the above scheme, the identification module is also used to, when the operating characteristics of the azimuth adjustment operation include the adjustment direction, match the adjustment direction of the azimuth adjustment operation with the adjustable directions of the target number to obtain a matching result; when the matching result indicates that the adjustment direction does not belong to the adjustable directions of the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal; or, when the operating characteristics of the azimuth adjustment operation include the trigger position, match the trigger position of the azimuth adjustment operation with the trigger position of the adjustable directions of the target number to obtain a matching result; when the matching result indicates that the trigger position does not belong to the trigger position of the adjustable directions of the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0021] In the above scheme, the identification module is also used to determine the number of different adjustment directions corresponding to the multiple orientation adjustment operations based on the operation characteristics of the multiple orientation adjustment operations when the operation data includes operation data corresponding to the multiple orientation adjustment operations; when the number is greater than the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the number is not greater than the target number, match the adjustment direction of each orientation adjustment operation with the adjustable direction of the target number to obtain a matching result; when the matching result indicates that there are adjustable directions that do not belong to the target number among the adjustment directions corresponding to the multiple orientation adjustment operations, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0022] In the above scheme, the analysis module is also used to analyze the operation data corresponding to the displacement operation when the target type operation is a displacement operation on the virtual object, to obtain the displacement trajectory of the displacement operation, and to use the displacement trajectory as the operation feature of the control operation; when the displacement operation is input based on the display interface of the external device, the operation characteristic corresponding to the displacement operation is that the corresponding displacement trajectory is a smooth straight line.

[0023] In the above scheme, the identification module is also used to determine whether the displacement trajectory obtained by analysis is a smooth straight line; when the displacement trajectory obtained by analysis is a smooth straight line, it is determined that the control operation is input based on the interface of the virtual scene displayed by the external device; when the displacement trajectory obtained by analysis is not a smooth straight line, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0024] In the above scheme, the analysis module is also used to analyze the operation data of multiple orientation adjustment operations when the control operation is an orientation adjustment operation for the virtual object and the operation data includes operation data of multiple orientation adjustment operations, obtain the angle difference between adjacent orientation adjustment operations, and use the angle difference between adjacent orientation adjustment operations as the operation feature of the control operation; the identification module is also used to determine that the control operation is input based on the interface of the virtual scene displayed on the terminal when at least one of the obtained angle differences is not the target angle difference.

[0025] In the above scheme, the acquisition module is also used to perform external device detection on the terminal to obtain a detection result; when the detection result indicates that the terminal has an associated external device and the associated external device is an unknown external device, the operation data corresponding to the control operation performed on the virtual object in the virtual scene is obtained.

[0026] In the above scheme, after identifying the control operation and obtaining the identification result, the device also includes: a sending module, used to send the identification result to the server, so that the server obtains the operation mode corresponding to the current login account, and combines the operation mode and the identification result to determine the legality of the control operation.

[0027] In the above scheme, the device also includes: a receiving module, used to receive the violation prompt information sent by the server, and display the violation prompt information; wherein the violation prompt information is used to prompt that the control operation is a violation operation.

[0028] An embodiment of the present application provides an electronic device, including:

[0029] A memory for storing executable instructions;

[0030] The processor is used to implement the virtual scene-based operation recognition method provided in the embodiment of the present application when executing the executable instructions stored in the memory.

[0031] An embodiment of the present application provides a computer-readable storage medium storing executable instructions for causing a processor to execute instructions to implement the virtual scene-based operation recognition method provided in the embodiment of the present application.

[0032] An embodiment of the present application provides a computer program product, including a computer program or instructions, characterized in that when the computer program or instructions are executed by a processor, the virtual scene-based operation recognition method provided in the embodiment of the present application is implemented.

[0033] The embodiments of the present application have the following beneficial effects:

[0034] Through the embodiments of the present application, there is no need to resort to special detection equipment, and the recognition result can be obtained by analyzing and identifying the operation characteristics corresponding to the control operation. Since the operation characteristics can well reflect whether the control operation is input based on the interface of the virtual scene displayed by the terminal or the interface of the virtual scene displayed by the external device of the terminal, the recognition accuracy is improved. Since the recognition method provided by the embodiments of the present application does not rely on the blacklist of the external device, there is no need to update the blacklist directory as the external device is continuously updated, thereby reducing the recognition cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 A schematic diagram of the architecture of a virtual scene-based operation recognition system 100 provided in an embodiment of the present application;

[0036] Figure 2 A schematic diagram of the structure of an electronic device 500 provided in an embodiment of the present application;

[0037] Figure 3 A flowchart of a virtual scene-based operation recognition method provided in an embodiment of the present application;

[0038] Figure 4 A schematic diagram of a displacement trajectory provided in an embodiment of the present application;

[0039] Figure 5 A schematic diagram of an interface of a virtual scene displayed on a computer provided in an embodiment of the present application;

[0040] Figure 6 A schematic diagram of an interface of a virtual scene displayed on a mobile phone provided in an embodiment of the present application;

[0041] Figure 7 A schematic diagram of displaying violation prompt information provided in an embodiment of the present application;

[0042] Figure 8 A flowchart of a virtual scene-based operation recognition method provided in an embodiment of the present application;

[0043] Fig. 9 A detection schematic diagram provided for an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.

[0045] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0046] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0047] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0048] 1) Client: an application running in the terminal to provide various services, such as video playback client, game client, etc.

[0049] 2) Mobile terminals, including but not limited to handheld portable gaming devices on mobile phones; mobile terminal games refer to games that run game programs on mobile terminals, and players perform control operations on objects in the game scene through the mobile terminals.

[0050] 3) A virtual scene is a virtual scene displayed (or provided) when an application is running on a terminal. The virtual scene can be a simulation of the real world, a semi-simulated and semi-fictional virtual environment, or a purely fictional virtual environment. A virtual scene can be any of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional virtual scene. The embodiment of the present application does not limit the dimension of the virtual scene. For example, the virtual scene may include the sky, land, ocean, etc. The land may include environmental elements such as deserts and cities, and users can control virtual objects to move in the virtual scene.

[0051] 4) Virtual objects, images of various people and objects that can interact in a virtual scene, or movable objects in a virtual scene. The movable objects can be virtual characters, virtual animals, cartoon characters, etc., such as characters and animals displayed in a virtual scene. The virtual object can be a virtual image in the virtual scene that represents the user. A virtual scene can include multiple virtual objects, each of which has its own shape and volume in the virtual scene and occupies a part of the space in the virtual scene.

[0052] 5) Scene data, which represents feature data in a virtual scene. For example, it may include the position of a virtual object in the virtual scene, the waiting time required to configure various functions in the virtual scene (depending on the number of times the same function can be used within a specific time), and the attribute values ​​of various states of virtual objects in the game, such as health points and magic points.

[0053] The embodiments of the present application provide an operation recognition method, device, equipment, computer-readable storage medium and computer program product based on a virtual scene, which can improve the recognition accuracy and reduce the recognition cost. In order to facilitate easier understanding of the operation recognition method based on a virtual scene provided by the embodiments of the present application, the exemplary implementation scenario of the operation recognition method based on a virtual scene provided by the embodiments of the present application is first described. The virtual scene in the operation recognition method based on a virtual scene provided by the embodiments of the present application can be completely based on the output of the terminal device, or based on the collaborative output of the terminal device and the server. In some embodiments, the virtual scene can also be an environment for game characters to interact, for example, it can be an environment for game characters to fight in a virtual scene, and by controlling the actions of the game characters, both parties can interact in the virtual scene, so that users can relieve life stress during the game.

[0054] See also Figure 1 , Figure 1 The schematic diagram of the architecture of the virtual scene-based operation identification system 100 provided in the embodiment of the present application is that, to support an exemplary application, the terminal (terminal 400-1 and terminal 400-2 are shown as examples) is connected to the server 200 via the network 300. The network 300 can be a wide area network or a local area network, or a combination of the two, and a wireless link is used to realize data transmission.

[0055] Among them, the server 200 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and basic cloud computing services such as big data and artificial intelligence platforms. The terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a camera, etc., but is not limited to this. The terminal and the server can be directly or indirectly connected by wired or wireless communication, which is not limited in the embodiments of the present application.

[0056] In some embodiments, a client is run on the terminal. During the operation of the client, virtual scene data is obtained, and the virtual scene data is rendered. The rendered virtual scene including a role-playing is output. The virtual scene can be an environment for game characters to interact, such as plains, streets, valleys, etc. for game characters to fight. Before outputting the virtual scene, scene information needs to be loaded to output the field of view of the virtual object as a virtual scene, wherein the virtual object can be a game character controlled by the user, that is, the virtual object is controlled by the real user, and will move in the virtual scene in response to the real user's operation of the controller (such as a touch screen, voice-controlled switch, keyboard, mouse, and joystick, etc.). For example, when the real user moves the joystick to the right, the virtual object will move to the right in the virtual scene. It can also remain still, jump, and control the virtual object to perform shooting operations, etc.

[0057] The client in the terminal obtains operation data corresponding to the control operation performed on the virtual object in the virtual scene; analyzes the operation data to obtain the operation characteristics of the control operation; identifies the control operation based on the operation characteristics to obtain an identification result; wherein the identification result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or is input based on the interface of the virtual scene displayed by an external device of the terminal; in this way, the identification result can be obtained by analyzing and identifying the operation data corresponding to the control operation without the aid of special detection equipment, thereby improving the identification accuracy and reducing the identification cost.

[0058] In some embodiments, after obtaining the recognition result, the terminal sends the recognition result to the server 200, so that the server obtains the operation mode corresponding to the current login account, and determines the legality of the control operation in combination with the operation mode and the recognition result. For example, when the control operation is illegal, a violation prompt message is sent to the terminal in time to prompt the player to stop the illegal operation. This maintains the ecological balance of the game, is conducive to improving the user experience, and then improves user stickiness and retention rate.

[0059] See also Figure 2 , Figure 2 The electronic device 500 is a schematic diagram of the structure of the electronic device 500 provided in the embodiment of the present application. In practical applications, the electronic device 500 may be Figure 1 The terminal or server 200 in the embodiment of the present invention is an electronic device. Figure 1 Taking the terminal shown as an example, an electronic device that implements the virtual scene-based operation recognition method of an embodiment of the present application is described. Figure 2The electronic device 500 shown includes: at least one processor 510, a memory 550, at least one network interface 520 and a user interface 530. The various components in the electronic device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 540 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 540 is not described in detail. Figure 2 Various buses are labeled as bus system 540 .

[0060] The processor 510 may be an integrated circuit chip having signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., wherein the general-purpose processor may be a microprocessor or any conventional processor, etc.

[0061] The user interface 530 includes one or more output devices 531 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 530 also includes one or more input devices 532, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0062] The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard disk drives, optical disk drives, etc. The memory 550 may optionally include one or more storage devices that are physically remote from the processor 510.

[0063] The memory 550 includes a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 550 described in the embodiment of the present application is intended to include any suitable type of memory.

[0064] In some embodiments, the memory 550 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.

[0065] Operating system 551, including system programs for processing various basic system services and performing hardware-related tasks, such as framework layer, core library layer, driver layer, etc., for implementing various basic services and processing hardware-based tasks;

[0066] A network communication module 552, used to reach other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 include: Bluetooth, Wireless Compatibility Certification (WiFi), and Universal Serial Bus (USB), etc.;

[0067] a presentation module 553 for enabling presentation of information via one or more output devices 531 (e.g., display screen, speaker, etc.) associated with the user interface 530 (e.g., a user interface for operating peripheral devices and displaying content and information);

[0068] The input processing module 554 is used to detect one or more user inputs or interactions from one of the one or more input devices 532 and translate the detected inputs or interactions.

[0069] In some embodiments, the virtual scene-based operation recognition device provided in the embodiments of the present application can be implemented in a software manner. Figure 2 An operation recognition device 555 based on a virtual scene stored in a memory 550 is shown, which may be software in the form of a program or plug-in, including the following software modules: an acquisition module 5551, an analysis module 5552, and an identification module 5553. These modules are logical, and therefore may be arbitrarily combined or further split according to the functions implemented. The functions of each module will be described below.

[0070] In other embodiments, the virtual scene-based operation identification device provided in the embodiments of the present application can be implemented in hardware. As an example, the virtual scene-based operation identification device provided in the embodiments of the present application can be a processor in the form of a hardware decoding processor, which is programmed to execute the virtual scene-based operation identification method provided in the embodiments of the present application. For example, the processor in the form of a hardware decoding processor can adopt one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs) or other electronic components.

[0071] Based on the above description of the virtual scene-based operation recognition system provided in the embodiment of the present application, the virtual scene-based operation recognition method provided in the embodiment of the present application is described below. In actual implementation, the method can be Figure 1 The terminal or server 200 shown is implemented separately, and can also be implemented by Figure 1 The terminal and server 200 shown are implemented in cooperation. Figure 1 and Figure 3 , Figure 3 A flowchart of a virtual scene-based operation recognition method provided in an embodiment of the present application is shown in FIG. Figure 1 The terminal shown alone implements the virtual scene-based operation recognition method provided in the embodiment of the present application for illustration.

[0072] Step 101: The terminal obtains operation data corresponding to the control operation performed on the virtual object in the virtual scene.

[0073] In actual applications, for virtual scenes on mobile devices (such as mobile games), when the terminal is not connected to an external device (such as a simulator), when the terminal logs in to the virtual scene and runs the virtual scene, the interface of the virtual scene is presented, and virtual objects and virtual joysticks or virtual buttons for controlling virtual objects are presented in the interface of the virtual scene. Users can perform control operations on virtual objects by triggering the virtual joysticks or virtual buttons, that is, the control operations in this case are input based on the interface of the virtual scene displayed by the terminal (corresponding to the mobile phone operation mode); when the terminal is connected to an external device (such as a simulator), users can perform control operations on virtual objects through the keyboard, mouse, real joystick, etc. of the external device, that is, the control operations in this case are input based on the interface of the virtual scene displayed by the external device of the terminal (corresponding to the simulator operation mode).

[0074] Among them, the simulator is a program installed on the computer, which is used to simulate the system environment of the mobile terminal (such as a smartphone) on the computer side, and run the virtual scene program (such as the game program) based on the simulated system environment to generate a virtual scene (such as the scene corresponding to the game client) for users to experience the mobile game. The simulator contains many components: a CPU simulator that simulates the mobile terminal, a simulator that maps the input of the virtual buttons, virtual joysticks and other controls in the virtual scene of the mobile terminal to the keyboard, mouse, real joystick and other devices on the computer, and a display and sound simulator, etc. When the simulator is running, it uses multiple components to achieve the purpose of running the program on the mobile terminal on the computer.

[0075] In some embodiments, during identification, an external device detection may be performed on the terminal first to obtain a detection result; when the detection result indicates that the terminal has an associated external device and the associated external device is an unknown external device, operation data corresponding to the control operation performed on the virtual object in the virtual scene is obtained.

[0076] Here, it is possible to first detect whether the terminal in the mobile terminal is connected to an external device. When it is determined based on the detection result that the terminal is connected to an external device, the external device connected to the terminal is matched with the external device in the cheating blacklist. When the external device connected to the terminal exists in the cheating blacklist, it is directly determined that the control operation is based on the recognition result input by the interface of the virtual scene displayed by the external device of the terminal, without executing Figure 3 The identification method shown is used to identify, which improves the identification efficiency; when the external device connected to the terminal does not exist in the cheating blacklist (that is, it is an unknown device), it is impossible to determine whether the operation data is input through the interface displayed by the terminal or through the interface of the virtual scene displayed by the external device of the terminal, and it is necessary to execute Figure 3 The identification method shown obtains the operation data of the control operation for further identification.

[0077] It can be understood that in the embodiments of the present application, the operation data corresponding to the control operations performed on the virtual objects are essentially user-related data. When the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.

[0078] Step 102: Analyze the operation data to obtain the operation characteristics of the control operation.

[0079] Step 103: Based on the operation characteristics, the control operation is identified to obtain an identification result.

[0080] The recognition result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or is input based on the interface of the virtual scene displayed by an external device of the terminal.

[0081] In some embodiments, the terminal can identify the control operation based on the operation characteristics and obtain the identification result in the following manner: when the control operation is used to control the virtual object to perform the target type of operation, the operation characteristics corresponding to the target type of operation are obtained when the target type of operation is input based on the display interface of the terminal or external device; the control operation is identified by combining the operation characteristics of the control operation with the operation characteristics corresponding to the target type of operation to obtain the identification result.

[0082] Here, the user can control the virtual object to move in the virtual scene, or control the virtual object to use virtual props or release virtual skills and other types of operations. Different types of operations correspond to different operation characteristics. For example, the operation characteristics corresponding to the operation of controlling the virtual object to "sprint" in the virtual scene are different from the operation characteristics corresponding to the operation of controlling the virtual object to "aim". At the same time, for the same type of operation, the operation characteristics in different operation modes are also different. For example, the operation characteristics corresponding to the operation of "sprinting" input through the display interface of the external device in the simulator operation mode are different from the operation characteristics corresponding to the operation of "sprinting" input through the display interface of the mobile phone (i.e., the terminal) in the mobile phone operation mode. Therefore, the operation characteristics of the acquired control operation are matched with the operation characteristics of the control operation in each operation mode to obtain a matching result. For example, when the matching result indicates that the operation characteristics of the acquired control operation match the operation characteristics of the control operation in the mobile phone operation mode, it is determined that the acquired control operation is input through the display interface of the mobile phone; when the matching result indicates that the operation characteristics of the acquired control operation match the operation characteristics of the control operation in the simulator operation mode, it is determined that the acquired control operation is input through the display interface of the external device, such as input to the game interface displayed on the computer through the keyboard and mouse.

[0083] In some embodiments, the terminal can analyze the operation data in the following manner to obtain the operation characteristics of the control operation: when the target type of operation is an azimuth adjustment operation, the operation data corresponding to the azimuth adjustment operation is analyzed to obtain at least one of the following operation characteristics of the azimuth adjustment operation: an adjustment direction corresponding to the azimuth adjustment operation, and a trigger position corresponding to the azimuth adjustment operation; when the azimuth adjustment operation is input based on a display interface of an external device, the operation characteristics corresponding to the azimuth adjustment operation include: the number of adjustable directions is a target number, each adjustable direction has a trigger position, and the adjustment direction corresponding to each azimuth adjustment belongs to the target number of adjustable directions.

[0084] Here, the orientation adjustment operation is used to adjust the position and direction of the virtual object in the virtual scene. The trigger position corresponding to the orientation adjustment operation is the trigger position for the virtual joystick. For example, in the mobile phone operation mode, the trigger position refers to the position of the virtual joystick in the display interface where the user touches his hand. In the simulator operation mode, the trigger position refers to the position of the virtual joystick in the display interface where the user clicks the mouse. When the orientation adjustment operation is based on the input of the display interface of the external device, that is, in the simulator operation mode, the movement buttons of the virtual joystick presented in the interface of the virtual scene have only the following 8 direction keys: up, down, left, right, left front, right front, left back and right back, that is, the number of adjustable directions is 8, and each adjustable direction has a trigger position, such as the coordinates in units of 1 are (0, 1), (0, -1), (-1, 0), (1, 0), (-0.71, 0.71), (0.71, 0.71), (-0.71, -0.71) and (0.71, -0.71). Each time the user adjusts the orientation, he can accurately operate any of the above 8 adjustable directions.

[0085] When the direction adjustment operation is input based on the display interface of the terminal, that is, in the mobile phone operation mode, it is difficult for the user to accurately operate the eight direction keys of up, down, left, right, left front, right front, left back and right back on the mobile phone as in the simulator operation mode. For example, when controlling the virtual object to move directly upward, since the move button is not directly in the upward direction key position, the user can only press the move button first and then slowly adjust the move button to the upward direction key position. In this adjustment process, the operation data corresponding to the control operation has random diversity, and the operation data corresponding to the control operation of the mobile phone is The trigger positions of the control data can be: (-0.1, -0.3), (-0.1, -0.3), (-0.1, -0.2), (-0.1, -0.2), (-0.2, -0.2), (-0.2, -0.2), (-0.2, -0.2), (-0.2, -0.2), (-0.3, -0.1), (-0.3, -0.1), (-0.3, -0.1), and so on. It can be seen that the operating characteristics of the control operations in the two modes are essentially different. Therefore, it is possible to identify whether the player is using a computer to control the mobile phone by judging the operating characteristics of the operating data of the operation control.

[0086] In some embodiments, the terminal may identify the control operation by combining the operating characteristics of the control operation with the operating characteristics corresponding to the target type of operation to obtain an identification result in the following manner: when the operating characteristics of the orientation adjustment operation include an adjustment direction, the adjustment direction of the orientation adjustment operation is matched with the adjustable directions of the target number to obtain a matching result; when the matching result indicates that the adjustment direction does not belong to the adjustable directions of the target number, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal; or, when the operating characteristics of the orientation adjustment operation include a trigger position, the trigger position of the orientation adjustment operation is matched with the trigger position of the adjustable directions of the target number to obtain a matching result; when the matching result indicates that the trigger position does not belong to the trigger position of the adjustable directions of the target number, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0087] Here, since the simulator operation mode has 8 fixed adjustable directions, if the matching result indicates that the adjustment direction does not belong to any of the 8 fixed adjustable directions, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal, such as the control operation is input through the display interface of the mobile phone; if the matching result indicates that the adjustment direction belongs to one of the 8 fixed adjustable directions, multiple control operations within the target time period can be obtained for identification. When the operation characteristics of the azimuth adjustment operation include a trigger position, the trigger position of the azimuth adjustment operation can be matched with the trigger positions of the 8 adjustable directions respectively, and when the matching result indicates that the trigger position of the azimuth adjustment operation does not belong to any of the trigger positions of the 8 fixed adjustable directions, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal, such as the control operation is input through the display interface of the mobile phone; if the matching result indicates that the trigger position of the azimuth adjustment operation does not belong to one of the trigger positions of the 8 fixed adjustable directions, the trigger positions of multiple control operations within the target time period can be obtained for further identification.

[0088] In some embodiments, the terminal can identify the control operation by combining the operating characteristics of the control operation with the operating characteristics corresponding to the target type of operation to obtain an identification result: when the operation data includes operation data corresponding to multiple orientation adjustment operations, determine the number of different adjustment directions corresponding to the multiple orientation adjustment operations based on the operating characteristics of the multiple orientation adjustment operations; when the determined number is greater than the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the determined number is not greater than the target number, match the adjustment directions of each orientation adjustment operation with the adjustable directions of the target number respectively to obtain a matching result; when the matching result indicates that among the adjustment directions corresponding to the multiple orientation adjustment operations, there are adjustable directions that do not belong to the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0089] In some embodiments, the operation data corresponding to the multiple azimuth adjustment operations can be periodically obtained, and the recognition results of each cycle are obtained based on the operation characteristics corresponding to the multiple azimuth adjustment operations of each cycle. The normal distribution satisfied by the change trend of the recognition results is determined according to the recognition results of each cycle, and the parameters of the normal distribution are used as the final recognition results, wherein the parameters include the mean of the recognition results and the variance of the recognition results. In actual implementation, the cycle can be divided based on the acquisition time or the acquisition quantity of the operation data. After obtaining the recognition results of the control operation in each cycle, the final recognition results of the control operation can be continuously updated. For example, the recognition result of the current cycle indicates that the control operation is input through the display interface of the mobile phone, and the next or interval multiple cycles are recalculated. When the recognition results of multiple consecutive cycles all indicate that the control operation is input through the display interface of the mobile phone, it is determined that the final recognition result indicates that the control operation is input through the display interface of the mobile phone. When determining whether the recognition results are consistent according to the normal distribution satisfied by the change trend of the recognition results, the final recognition result obtained by the recognition results of multiple cycles can accurately identify the operation mode through which the control operation is input, and avoid misjudgment caused by occasional jitter of the recognition results.

[0090] When obtaining the recognition result of each cycle, first determine whether the adjustment directions corresponding to the multiple azimuth adjustment operations in each cycle are the same. When the different adjustment directions exceed the 8 fixed adjustable directions of the simulator operation mode, such as collecting operation data of 20 azimuth adjustment operations in each cycle, the adjustment directions of these 20 azimuth adjustment operations are different, that is, there are 20 adjustment directions in total, which exceeds the 8 adjustable directions of the simulator operation mode. At this time, it can be determined that the control operation is input based on the interface of the virtual scene displayed on the terminal; when there are only 7 adjustment directions corresponding to the 20 azimuth adjustment operations collected in this cycle (there is overlap), which is less than the 8 adjustable directions of the simulator operation mode. At this time, the adjustment directions corresponding to these 20 azimuth adjustment operations can be The directions are matched with the 8 adjustable directions of the simulator operation mode respectively. When the matching result indicates that there are adjustment directions corresponding to multiple azimuth adjustment operations that do not belong to the 8 adjustable directions of the simulator operation mode, as long as there is one adjustment direction different from the 8 adjustable directions of the simulator operation mode among the adjustment directions corresponding to the 20 azimuth adjustment operations, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the matching result indicates that the adjustment directions corresponding to multiple azimuth adjustment operations all belong to the 8 adjustable directions of the simulator operation mode, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the external device associated with the terminal, such as input through the keyboard and mouse to the game interface displayed on the computer.

[0091] In some embodiments, operation data corresponding to multiple position adjustment operations may also be collected in the collection window, and the recognition result in the collection window may be determined based on the operation features corresponding to the multiple position adjustment operations in the collection window, wherein the types of sampling windows include: set time sampling window and set data volume sampling window. The set time sampling window means that the sampling time is fixed, such as the sampling time is 2 minutes, while the sampling data volume is not fixed, such as the sampling data volume is the number of operation data corresponding to the position adjustment operation collected within 2 minutes of sampling. For different players, even if the sampling time is the same, the corresponding sampling data volume may be different, or for the same player in different sampling time periods, the corresponding sampling data volume may also be different. The set data volume sampling window means that the sampling data volume is fixed, and the time is not fixed. For example, the sampling time required for sampling the same amount of operation data corresponding to the position adjustment operation of the same player in different time periods may be different.

[0092] In some embodiments, the terminal may also identify the control operation by combining the operating characteristics of the control operation with the operating characteristics corresponding to the target type of operation to obtain an identification result: when the operation data includes operating data corresponding to multiple orientation adjustment operations, determine the number of different trigger positions corresponding to the multiple orientation adjustment operations based on the operating characteristics of the multiple orientation adjustment operations; when the determined number is greater than the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the determined number is not greater than the target number, match the trigger positions of each orientation adjustment operation with the trigger positions of the target number respectively to obtain a matching result; when the matching result indicates that among the trigger positions corresponding to the multiple orientation adjustment operations, there are trigger positions that do not belong to the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0093] Here, the operation data corresponding to multiple azimuth adjustment operations can be collected periodically or in the collection window for identification when the corresponding adjustable direction is corresponding. Taking periodic collection as an example, when the identification result of each cycle is obtained, it is first determined whether the trigger positions corresponding to multiple azimuth adjustment operations in each cycle are the same. When the different trigger positions exceed the 8 fixed trigger positions of the simulator operation mode, such as collecting operation data of 20 azimuth adjustment operations in each cycle, the trigger positions of these 20 azimuth adjustment operations are different, that is, there are 20 trigger positions in total, which exceeds the 8 trigger positions of the simulator operation mode. At this time, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the trigger positions corresponding to the 20 azimuth adjustment operations collected in the cycle are only 7, which is less than the 8 trigger positions of the simulator operation mode. Trigger position. At this time, the trigger positions corresponding to the 20 azimuth adjustment operations can be matched with the 8 trigger positions of the simulator operation mode respectively. When the matching result indicates that among the trigger positions corresponding to multiple azimuth adjustment operations, there are 8 trigger positions that do not belong to the simulator operation mode, as long as there is one trigger position different from the 8 trigger positions of the simulator operation mode among the trigger positions corresponding to the 20 azimuth adjustment operations, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the matching result indicates that the trigger positions corresponding to multiple azimuth adjustment operations all belong to the 8 trigger positions of the simulator operation mode, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the external device associated with the terminal, such as input through the keyboard and mouse to the game interface displayed on the computer.

[0094] In some embodiments, the terminal may analyze the operation data in the following manner to obtain the operation characteristics of the control operation: when the target type of operation is a displacement operation on a virtual object, the operation data corresponding to the displacement operation is analyzed to obtain the displacement trajectory of the displacement operation, and the displacement trajectory is used as the operation characteristic of the control operation; when the displacement operation is input based on the display interface of an external device, the operation characteristic corresponding to the displacement operation is that the corresponding displacement trajectory is a smooth straight line.

[0095] In practical applications, the position operation of a virtual object is usually a continuous displacement operation. The displacement trajectory of the displacement operation in different operation modes is different. Figure 4 , Figure 4 The schematic diagram of the displacement trajectory provided in the embodiment of the present application shows that in (1), in the simulator operation mode, that is, when the displacement operation is input based on the display interface of the external device, since the user can accurately operate the 8 direction keys each time the displacement operation is performed, the displacement trajectory of the displacement operation on the virtual object is composed of displacement segments along multiple adjustable directions of the 8 adjustable directions, and each displacement segment is a smooth straight line; while in (2), in the mobile phone operation mode, that is, when the displacement operation is input based on the display interface of the terminal, it is difficult for the user to operate the 8 direction keys on the mobile phone as accurately as in the simulator operation mode, so the displacement trajectory of the displacement operation on the virtual object is composed of arc segments.

[0096] In some embodiments, the terminal can identify the control operation by combining the operating characteristics of the control operation with the operating characteristics corresponding to the target type of operation to obtain an identification result: determining whether the displacement trajectory obtained by analysis is a smooth straight line; when the displacement trajectory obtained by analysis is a smooth straight line, determining that the control operation is input based on the interface of the virtual scene displayed by the external device; when the displacement trajectory obtained by analysis is not a smooth straight line, determining that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0097] Here, based on Figure 4 The displacement trajectory in the simulator operation mode and the mobile phone operation mode is different. When the target type of operation is a displacement operation on a virtual object, a smooth straight line analysis is performed on the displacement trajectory of the displacement operation. When the displacement trajectory obtained by analysis is a smooth straight line, it can be determined that the control operation is input based on the interface of the virtual scene displayed by an external device, such as input through the keyboard and mouse to the game interface displayed on the computer; when the displacement trajectory obtained by analysis is not a smooth straight line, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal, such as input based on the game interface displayed on the mobile phone.

[0098] In some embodiments, the terminal can analyze the operation data in the following manner to obtain the operation characteristics of the control operation: when the control operation is an orientation adjustment operation for a virtual object, and the operation data includes operation data of multiple orientation adjustment operations, the operation data of the multiple orientation adjustment operations are analyzed to obtain the angle difference between adjacent orientation adjustment operations, and the angle difference between adjacent orientation adjustment operations is used as the operation characteristic of the control operation; accordingly, the terminal can identify the control operation based on the operation characteristics in the following manner to obtain an identification result, including: when there is an angle difference that is not the target angle difference among at least one of the obtained angle differences, determining that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0099] Here, in the simulator operation mode, the movement buttons of the virtual joystick presented in the interface of the virtual scene have only the following 8 direction keys: up, down, left, right, left front, right front, left back and right back, that is, the number of adjustable directions is 8, and each adjustable direction has a trigger position, such as the coordinates are (0, 1), (0, -1), (-1, 0), (1, 0), (-0.71, 0.71), (0.71, 0.71), (-0.71, -0.71) and (0.71, -0.71), then it can be seen that in the simulator operation mode, the target angle difference between adjacent azimuth adjustment operations is 45 degrees, while in the mobile phone operation mode, it is difficult for the user to operate the 8 direction keys on the mobile phone as accurately as in the simulator operation mode. Therefore, it is difficult to ensure that the angle difference between adjacent azimuth adjustment operations in multiple azimuth adjustment operations based on mobile phone input is 45 degrees. Therefore, based on the angle difference between adjacent azimuth adjustment operations in multiple azimuth adjustment operations, it is possible to identify whether the player is using a computer to control the mobile phone. For example, when at least one of the angle differences between adjacent orientation adjustment operations in a plurality of orientation adjustment operations is not 45 degrees, such as 32 degrees, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0100] From the above, it can be seen that in the simulator operation mode, the target angle difference between each azimuth adjustment operation is 45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees, and 315 degrees. Therefore, the target angle difference set in the simulator operation mode can be determined to be [45 degrees, 90 degrees, 135 degrees, 180 degrees, 225 degrees, 270 degrees, and 315 degrees]. In actual implementation, when the operation data includes operation data corresponding to multiple azimuth adjustment operations, the angle difference between the multiple azimuth adjustment operations is determined based on the operation characteristics of the multiple azimuth adjustment operations. When each angle difference belongs to the target angle difference set, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the external device of the terminal, such as input through the keyboard and mouse to the game interface displayed on the computer; when there is at least one angle difference that does not belong to the target angle difference set, it can be determined that the control operation is input based on the interface of the virtual scene displayed by the terminal, rather than input through the keyboard and mouse to the game interface displayed on the computer.

[0101] In some embodiments, the terminal identifies the control operation, and after obtaining the identification result, it can also send the identification result to the server so that the server can obtain the operation mode corresponding to the current login account, and determine the legitimacy of the control operation based on the operation mode and the identification result.

[0102] Here, since the user needs to register the corresponding operation mode, such as the mobile phone operation mode and the simulator operation mode, when registering the virtual scene, if the operation mode registered by the current login account when logging in to the game is the simulator operation mode, and the recognition result indicates that the control operation is input based on the interface of the virtual scene displayed by the external device of the terminal (such as input by controlling the computer through input devices such as keyboard and mouse), then the control operation is determined to be legal; if the operation mode registered by the current login account when logging in to the game is the simulator operation mode, and the recognition result indicates that the control operation is input based on the interface of the virtual scene displayed by the terminal (such as input by finger touch operation terminal), then the control operation is determined to be illegal; if the operation mode registered by the current login account when logging in to the game is the mobile phone operation mode, and the recognition result indicates that the control operation is input based on the interface of the virtual scene displayed by the external device of the terminal, then the control operation is determined to be illegal; if the operation mode registered by the current login account when logging in to the game is the mobile phone operation mode, and the recognition result indicates that the control operation is input based on the interface of the virtual scene displayed by the terminal, then the control operation is determined to be legal.

[0103] In some embodiments, the terminal receives the violation prompt information sent by the server and displays the violation prompt information; wherein the violation prompt information is used to prompt that the control operation is a violation operation.

[0104] Here, when it is identified that the control operation is illegal, the server may send a violation prompt message to the terminal to indicate that the control operation is a violation operation, so as to present the violation prompt message in the game interface of the terminal, such as Figure 6 As shown, warnings are given through pop-up windows in the game interface, and players are urged to stop illegal operations. If the players do not stop illegal operations, they may be banned or subject to other penalties. This maintains the ecological balance of the game, helps improve user experience, and thereby increases user stickiness and retention rate.

[0105] Below, an exemplary application of the embodiment of the present application in an actual application scenario will be described. Taking a game in a virtual scene as an example, for mobile games, in order to ensure fairness, when matching players before the game, players using a computer simulator can only be matched with players who also use a computer simulator, and players using mobile phones will only be matched with players who also use mobile phones. In view of the convenience of computer-side operation, some players who are instructed to use mobile phones during registration use peripherals to cheat, such as connecting the mobile phone and the computer, and operating the computer simulator through input devices such as keyboards and mice to fight with other players using mobile phones, which is extremely unfair to other players using mobile phones. In order to solve this loophole, an embodiment of the present application provides an identification method, in which the client in the terminal analyzes the operation data corresponding to the control operation performed by the player in the game interface to identify whether the control operation is input through the game interface displayed on the mobile phone, or input through the keyboard and mouse to the game interface displayed on the computer.

[0106] The embodiments of the present application mainly involve the following functions: the function of realizing the determination in eight directions, the function of notifying the server after the determination is successful, and the function of adding a penalty mechanism.

[0107] 1. Eight-direction determination function

[0108] In actual applications, when controlling virtual objects in the game interface displayed by the computer simulator through input devices such as keyboards and mice, the movement buttons of the virtual joystick presented in the game interface only have the following 8 direction keys: up, down, left, right, left front, right front, left back and right back, and users can accurately operate any of the above 8 direction keys. When controlling virtual objects in the game interface displayed by the mobile phone through the touch screen input setting, although the user can touch any direction of the virtual joystick in the game interface through the touch screen, the above 8 direction keys cannot be operated as accurately as through the computer. This is because there is a difference in the operation method of the movement button in the two cases. Therefore, based on this feature, it is possible to identify whether the player is using the computer to control the mobile phone, and feedback the identification result to the server for certain punishment processing.

[0109] See also Figure 5 , Figure 5 The interface diagram of the virtual scene displayed on the computer provided in the embodiment of the present application, (1)-(4) respectively show the four direction keys of up, down, left and right. When the user controls the virtual object through computer operation, the above four keys can be accurately operated; based on this, the operation data corresponding to the control operation can only have four trigger positions: (0, 1), (0, -1), (-1, 0) and (1, 0); in addition, there are four direction keys of left front, right front, left back and right back, and the corresponding trigger positions are (-0.71, 0.71), (0.71, 0.71), (-0.71, -0.71) and (0.71, -0.71).

[0110] See also Figure 6 , Figure 6 A schematic diagram of an interface of a virtual scene displayed on a mobile phone provided in an embodiment of the present application. It is difficult for a user to use the mobile phone as in a real-time environment. Figure 5 For example, when controlling the virtual object to move directly upward, since the moving button is not directly in the upward direction, you can only press the moving button first, and then slowly adjust the moving button to the directly upward direction. During this adjustment process, the operation data corresponding to the control operation has random diversity. Assuming that the coordinate data of the X-axis is only -1 and 1, and the coordinate data of the Y-axis is also only 1 and -1, the operation data corresponding to the control operation of the mobile phone can be: (-0.1, -0.3), (-0.1, -0.3), (-0.1, -0.2), (-0.1, -0.2), (-0.2, -0.2), (-0.2, -0.2), (-0.2, -0.2), (-0.2, -0.2), (-0.3, -0.1), (-0.3, -0.1), (-0.3, -0.1). Therefore, it is possible to identify whether the player is using a computer to control the mobile phone by judging the number of operation data of the operation control. When the number does not exceed 8, it can be determined that the operation control is performed by the mouse, that is, the control operation is being performed by the player through the computer; otherwise, the control operation is performed by the player using the mobile phone.

[0111] 2. Function of notifying the server after successful determination

[0112] After the terminal obtains the recognition result, it sends the recognition result to the server. The server obtains the operation mode corresponding to the current login account when logging into the game, and refers to Table 1 to determine the legitimacy of the control operation based on the operation mode and the recognition result.

[0113] Table 1

[0114]

[0115] It can be seen from Table 1 that if the operation mode registered by the current login account when logging in to the game is simulator operation, and the recognition result indicates that the control operation is input by controlling the computer through input devices such as keyboard and mouse, then the control operation is determined to be legal; if the operation mode registered by the current login account when logging in to the game is simulator operation, and the recognition result indicates that the control operation is input through the interface displayed by the finger touch operation terminal, then the control operation is determined to be illegal; if the operation mode registered by the current login account when logging in to the game is mobile phone operation, and the recognition result indicates that the control operation is input through the computer through input devices such as keyboard and mouse, then the control operation is determined to be illegal; if the operation mode registered by the current login account when logging in to the game is mobile phone operation, and the recognition result indicates that the control operation is input through the interface displayed by the finger touch operation terminal, then the control operation is determined to be legal.

[0116] 3. Add a penalty mechanism

[0117] When the control operation is identified as illegal, the server may send a violation prompt message to the terminal to indicate that the control operation is an illegal operation, so as to present the violation prompt message in the game interface of the terminal, such as Figure 7 As shown, Figure 7 A schematic diagram of the display of violation prompt information provided in an embodiment of the present application, in which a warning is given through a pop-up window in the game interface, and the player is urged to stop the illegal operation. If the player does not stop the illegal operation, the player may be banned or other penalties may be imposed. This maintains the ecological balance of the game, is conducive to improving the user experience, and thereby improving user stickiness and retention rate.

[0118] Based on the above description, see Figure 8 , Figure 8 A flowchart of a virtual scene-based operation recognition method provided in an embodiment of the present application, the method comprising:

[0119] Step 201: The terminal logs into the game.

[0120] Step 202: The server determines whether the operation mode is the mobile phone operation mode.

[0121] Here, when the operation mode is the mobile phone mode, step 203 is executed; otherwise, step 201 is executed.

[0122] Step 203: The server records the operation mode as the mobile phone operation mode.

[0123] Step 204: The terminal obtains operation data corresponding to the control operation performed on the virtual object.

[0124] Here, when the user performs a control operation on a virtual object in the game interface by touching a moving button of a virtual joystick in the game interface, operation data corresponding to the moving button is obtained.

[0125] Step 205: The terminal determines a recognition result based on the operation data.

[0126] See also Fig. 9 , Fig. 9 The detection schematic diagram provided for the embodiment of the present application can move the operation data (such as the coordinate position) corresponding to the button in real time and periodically, and obtain the distance between the coordinates of the moving button and the center point of the area where the virtual joystick (such as the fire button) is located, and judge whether the distance between the two exceeds the radius of the area where the virtual joystick is located. When the distance between the two exceeds the radius of the area where the virtual joystick is located, the control operation is an invalid operation, that is, the control logic for controlling the virtual object cannot be triggered, such as A and B are the user's trigger positions; when the distance between the two does not exceed the radius of the area where the virtual joystick is located (OP), the control operation is a valid operation, which can trigger the control logic for controlling the virtual object.

[0127] The operation data of each control operation is obtained based on the above eight-direction determination function, and the coordinates corresponding to each operation data are recorded, such as (x0, y0), (x1, y1), ..., (x n ,y n ), delete the operation data with the same coordinates, if only Figure 5 If the 8 operation data shown are present, it can be determined that the control operation is the recognition result of the keyboard and mouse operation (i.e., the operation input through the keyboard and mouse) in the simulator operation mode, and step 206 is executed; otherwise, it is determined that the control operation is the recognition result of the input (i.e., the finger touch operation) in the mobile phone operation mode, and step 204 is executed.

[0128] When acquiring operation data, multiple operation data within the target time period can be continuously collected, and recognition can be performed based on multiple operation data within the target time period to improve recognition accuracy. Generally, the longer the target time period and the more operation data collected, the more accurate the recognition result. For example, taking the operation data collected three times with an interval of 10 seconds each as an example, if the number of operation data remaining in each of the three times does not exceed 8, then the control operation can be determined to be a keyboard and mouse operation. This recognition result; if the number of operation data remaining in two of the three times exceeds 8, and the number of operation data remaining in one of the three times does not exceed 8, then the control operation is determined to be a mobile phone operation.

[0129] It should be noted that in actual applications, it is possible that the player keeps pressing one position without moving. In order to prevent misjudgment, it is necessary to set a reasonable target time period and set a sufficient number of collection and detection times.

[0130] Step 206: The terminal sends the recognition result to the server.

[0131] Step 207: The server determines whether it is an illegal operation based on the identification result.

[0132] Here, when the control operation is determined to be an illegal operation based on the identification result, step 208 is executed; otherwise, the process ends.

[0133] Step 208: The server sends a violation prompt message for prompting that the control operation is a violation operation to the terminal for display.

[0134] In the above manner, without the need for specialized detection equipment, the recognition result can be obtained by analyzing and identifying the operation data corresponding to the control operation, thereby improving recognition accuracy and reducing recognition costs.

[0135] The following is a description of an exemplary structure of a virtual scene based operation recognition device 555 implemented as a software module according to an embodiment of the present application. In some embodiments, the operation recognition device 555 is stored in Figure 2 The software modules in the virtual scene-based operation recognition device 555 of the memory 550 may include:

[0136] The acquisition module 5551 is used to acquire operation data corresponding to the control operation performed on the virtual object in the virtual scene;

[0137] An analysis module 5552 is used to analyze the operation data to obtain the operation characteristics of the control operation;

[0138] An identification module 5553, configured to identify the control operation based on the operation feature and obtain an identification result;

[0139] The recognition result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or is input based on the interface of the virtual scene displayed by an external device of the terminal.

[0140] In some embodiments, the identification module is also used to obtain the operation characteristics corresponding to the target type of operation when the target type of operation is input based on the display interface of the terminal or the external device, when the control operation is used to control the virtual object to perform a target type of operation; and identify the control operation by combining the operation characteristics of the control operation with the operation characteristics corresponding to the target type of operation to obtain the identification result.

[0141] In some embodiments, the analysis module is also used to analyze the operation data corresponding to the orientation adjustment operation when the target type operation is an orientation adjustment operation, to obtain at least one of the following operation characteristics of the orientation adjustment operation: an adjustment direction corresponding to the orientation adjustment operation, and a trigger position corresponding to the orientation adjustment operation; when the orientation adjustment operation is input based on the display interface of the external device, the operation characteristics corresponding to the orientation adjustment operation include: the number of adjustable directions is the target number, there is a trigger position for each adjustable direction, and the adjustment direction corresponding to each orientation adjustment belongs to the target number of adjustable directions.

[0142] In some embodiments, the identification module is also used to, when the operating characteristics of the orientation adjustment operation include the adjustment direction, match the adjustment direction of the orientation adjustment operation with the adjustable directions of the target number to obtain a matching result; when the matching result indicates that the adjustment direction does not belong to the adjustable directions of the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal; or, when the operating characteristics of the orientation adjustment operation include the trigger position, match the trigger position of the orientation adjustment operation with the trigger position of the adjustable directions of the target number to obtain a matching result; when the matching result indicates that the trigger position does not belong to the trigger position of the adjustable directions of the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0143] In some embodiments, the identification module is also used to determine the number of different adjustment directions corresponding to the multiple orientation adjustment operations based on the operation characteristics of the multiple orientation adjustment operations when the operation data includes operation data corresponding to the multiple orientation adjustment operations; when the number is greater than the target number, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal; when the number is not greater than the target number, match the adjustment direction of each orientation adjustment operation with the adjustable direction of the target number to obtain a matching result; when the matching result indicates that there are adjustable directions that do not belong to the target number among the adjustment directions corresponding to the multiple orientation adjustment operations, determine that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0144] In some embodiments, the analysis module is also used to analyze the operation data corresponding to the displacement operation when the target type operation is a displacement operation on the virtual object, to obtain a displacement trajectory of the displacement operation, and to use the displacement trajectory as an operation feature of the control operation; when the displacement operation is input based on the display interface of the external device, the operation characteristic corresponding to the displacement operation is that the corresponding displacement trajectory is a smooth straight line.

[0145] In some embodiments, the identification module is also used to determine whether the displacement trajectory obtained by analysis is a smooth straight line; when the displacement trajectory obtained by analysis is a smooth straight line, it is determined that the control operation is input based on the interface of the virtual scene displayed by the external device; when the displacement trajectory obtained by analysis is not a smooth straight line, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal.

[0146] In some embodiments, the analysis module is also used to analyze the operation data of multiple orientation adjustment operations when the control operation is an orientation adjustment operation for the virtual object and the operation data includes operation data of multiple orientation adjustment operations, to obtain the angle difference between adjacent orientation adjustment operations, and to use the angle difference between adjacent orientation adjustment operations as the operation feature of the control operation; the identification module is also used to determine that the control operation is input based on the interface of the virtual scene displayed on the terminal when at least one of the obtained angle differences is not a target angle difference.

[0147] In some embodiments, the acquisition module is also used to perform external device detection on the terminal to obtain a detection result; when the detection result indicates that the terminal has an associated external device and the associated external device is an unknown external device, the operation data corresponding to the control operation performed on the virtual object in the virtual scene is obtained.

[0148] In some embodiments, after identifying the control operation and obtaining the identification result, the device also includes: a sending module for sending the identification result to a server so that the server obtains the operation mode corresponding to the current login account, and determines the legitimacy of the control operation in combination with the operation mode and the identification result.

[0149] In some embodiments, the device further includes: a receiving module, used to receive violation prompt information sent by the server, and display the violation prompt information; wherein the violation prompt information is used to prompt that the control operation is a violation operation.

[0150] The embodiment of the present application provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. The processor of the computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the above-mentioned virtual scene-based operation recognition method of the embodiment of the present application.

[0151] The present application embodiment provides a computer-readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the virtual scene-based operation recognition method provided by the present application embodiment, for example, Figure 3 The method shown.

[0152] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface storage, optical disk, or CD-ROM; or it may be various devices including one or any combination of the above memories.

[0153] In some embodiments, executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.

[0154] As an example, executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file storing other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).

[0155] By way of example, executable instructions may be deployed to be executed on one computing device, or on multiple computing devices located at one site, or on multiple computing devices distributed across multiple sites and interconnected by a communication network.

[0156] The above is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. An operation recognition method based on a virtual scene, characterized in that: The method comprises: Acquire operation data corresponding to the control operation performed on the virtual object in the virtual scene; Analyzing the operation data to obtain the operation characteristics of the control operation; Based on the operation feature, the control operation is identified to obtain an identification result, wherein the identification result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or based on the interface of the virtual scene displayed by an external device of the terminal; wherein, The step of identifying the control operation based on the operation feature to obtain an identification result includes: When the control operation is used to control the virtual object to perform a target type of operation, obtaining an operation characteristic of the target type of operation when the target type of operation is input based on an interface of the terminal or the external device; Combining the operation characteristics of the control operation with the operation characteristics of the target type operation, identifying the control operation to obtain the identification result; The analyzing the operation data to obtain the operation characteristics of the control operation includes: When the target type of operation is an azimuth adjustment operation, analyzing the operation data corresponding to the azimuth adjustment operation to obtain at least one of the following operation characteristics of the azimuth adjustment operation: an adjustment direction corresponding to the azimuth adjustment operation, and a trigger position corresponding to the azimuth adjustment operation; When the azimuth adjustment operation is input based on the display interface of the external device, the operation characteristics corresponding to the azimuth adjustment operation include: the number of adjustable directions is a target number, each adjustable direction has a trigger position, and the adjustment direction corresponding to each azimuth adjustment belongs to the target number of adjustable directions.

2. The method according to claim 1, characterized in that The combining the operation feature of the control operation with the operation characteristic of the target type operation to identify the control operation and obtain the identification result includes: When the operation feature of the orientation adjustment operation includes the adjustment direction, matching the adjustment direction of the orientation adjustment operation with the adjustable directions of the target number to obtain a matching result; When the matching result indicates that the adjustment direction does not belong to the target number of adjustable directions, determining that the control operation is input based on an interface of the virtual scene displayed by the terminal; Alternatively, when the operation feature of the azimuth adjustment operation includes the trigger position, the trigger position of the azimuth adjustment operation is matched with the trigger positions of the adjustable directions of the target number to obtain a matching result; When the matching result indicates that the trigger position does not belong to the target number of trigger positions of adjustable directions, it is determined that the control operation is input based on an interface of the virtual scene displayed by the terminal.

3. The method according to claim 1, characterized in that The combining the operation feature of the control operation with the operation characteristic of the target type operation to identify the control operation and obtain the identification result includes: When the operation data includes operation data corresponding to a plurality of the azimuth adjustment operations, determining the number of different adjustment directions corresponding to the plurality of the azimuth adjustment operations according to the operation characteristics of the plurality of the azimuth adjustment operations; When the number is greater than the target number, determining that the control operation is input based on the interface of the virtual scene displayed by the terminal; When the number is not greater than the target number, matching the adjustment directions of the azimuth adjustment operations with the adjustable directions of the target number to obtain a matching result; When the matching result indicates that among the adjustment directions corresponding to the plurality of the orientation adjustment operations, there are adjustable directions that do not belong to the target number, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal.

4. The method according to claim 1, characterized in that The analyzing the operation data to obtain the operation characteristics of the control operation includes: When the target type operation is a displacement operation for the virtual object, analyzing the operation data corresponding to the displacement operation to obtain a displacement trajectory of the displacement operation, and using the displacement trajectory as an operation feature of the control operation; When the displacement operation is input based on the display interface of the external device, the operation characteristic corresponding to the displacement operation is that the corresponding displacement trajectory is a smooth straight line.

5. The method according to claim 4, characterized in that The combining the operation feature of the control operation with the operation characteristic of the target type operation to identify the control operation and obtain the identification result includes: Determining whether the displacement trajectory obtained by analysis is a smooth straight line; When the displacement trajectory obtained by analysis is a smooth straight line, determining that the control operation is input based on the interface of the virtual scene displayed by the external device; When the displacement trajectory obtained by analysis is not a smooth straight line, it is determined that the control operation is input based on the interface of the virtual scene displayed by the terminal.

6. The method according to claim 1, characterized in that The analyzing the operation data to obtain the operation characteristics of the control operation includes: When the control operation is an orientation adjustment operation for the virtual object, and the operation data includes a plurality of operation data of the orientation adjustment operations, Analyzing the operation data of the plurality of azimuth adjustment operations to obtain angle differences between adjacent azimuth adjustment operations, and using the angle differences between adjacent azimuth adjustment operations as the operation feature of the control operation; The step of identifying the control operation based on the operation feature to obtain an identification result includes: When there is an angle difference value that is not a target angle difference value among at least one of the obtained angle differences, it is determined that the control operation is input based on an interface of the virtual scene displayed on the terminal.

7. The method according to claim 1, characterized in that The obtaining of operation data corresponding to the control operation performed on the virtual object in the virtual scene includes: Performing external device detection on the terminal to obtain a detection result; When the detection result indicates that the terminal has an associated external device and the associated external device is an unknown external device, operation data corresponding to the control operation performed on the virtual object in the virtual scene is obtained.

8. The method according to claim 1, characterized in that After identifying the control operation and obtaining the identification result, the method further includes: The recognition result is sent to the server so that the server obtains the operation mode corresponding to the current login account, and determines the legitimacy of the control operation in combination with the operation mode and the recognition result.

9. The method according to claim 8, characterized in that The method further comprises: Receiving the violation prompt information sent by the server, and displaying the violation prompt information; The violation prompt information is used to prompt that the control operation is a violation operation.

10. An operation recognition device based on a virtual scene, characterized in that: The device comprises: An acquisition module, used to acquire operation data corresponding to the control operation performed on the virtual object in the virtual scene; An analysis module, used for analyzing the operation data to obtain the operation characteristics of the control operation; an identification module, for identifying the control operation based on the operation feature to obtain an identification result, wherein the identification result is used to indicate that the control operation is input based on the interface of the virtual scene displayed by the terminal, or is input based on the interface of the virtual scene displayed by the external device of the terminal; wherein the identification of the control operation based on the operation feature to obtain the identification result includes: when the control operation is used to control the virtual object to perform a target type of operation, obtaining the operation characteristics of the target type of operation when the target type of operation is input based on the interface of the terminal or the external device; combining the operation characteristics of the control operation with the operation characteristics of the target type of operation, identifying the control operation based on the operation feature of the virtual object; and identifying the control operation based on the operation feature of the virtual object. The control operation is identified to obtain the identification result; the operation data is analyzed to obtain the operation characteristics of the control operation, including: when the target type of operation is an azimuth adjustment operation, the operation data corresponding to the azimuth adjustment operation is analyzed to obtain at least one of the following operation characteristics of the azimuth adjustment operation: an adjustment direction corresponding to the azimuth adjustment operation, and a trigger position corresponding to the azimuth adjustment operation; when the azimuth adjustment operation is input based on the display interface of the external device, the operation characteristics corresponding to the azimuth adjustment operation include: the number of adjustable directions is a target number, each of the adjustable directions has a trigger position, and the adjustment direction corresponding to each azimuth adjustment belongs to the target number of adjustable directions.

11. An electronic device, characterized in that: include: A memory for storing executable instructions; The processor is used to implement the virtual scene-based operation recognition method described in any one of claims 1 to 9 when executing the executable instructions stored in the memory.

12. A computer-readable storage medium, characterized in that: Executable instructions are stored, which are used to implement the virtual scene-based operation recognition method described in any one of claims 1 to 9 when executed by a processor.

13. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the virtual scene-based operation recognition method described in any one of claims 1 to 9 is implemented.

Images