Automatic tool selection for new players

By using machine learning algorithms in computer simulation controllers and simulation sources to identify inexperienced players and provide tool recommendations, the problem of inexperienced players having difficulty making choices in computer simulation games is solved, thus improving the gaming experience.

CN115038501BActive Publication Date: 2025-11-04SONY INTERACTIVE ENTERTAINMENT LLC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202180011789.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-02-06
Filing Date
2021-01-26
Publication Date
2025-11-04
Estimated Expiration
2041-01-26

AI Technical Summary

Technical Problem

Inexperienced players often struggle to make optimal choices in computer simulation games, leading to feelings of frustration.

Method used

By using computer-simulated controllers and simulation sources, machine learning algorithms are used to analyze player input, identify inexperienced players and recommend virtual tools to them, providing visual, auditory and tactile assistance.

Benefits of technology

It improves the gaming experience for inexperienced players, helping them survive longer in the simulation and reducing frustration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115038501B_ABST
    Figure CN115038501B_ABST
Patent Text Reader

Abstract

Assisting (306) a novice computer-simulated player in playing a simulation is performed by identifying (402) successful players in terms of simulation performance in previously played simulations. Virtual weapons selected by those players are identified (404) and a recommendation of weapons is presented (504) to the computer-simulated novice player.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates generally to technologically innovative, out-of-the-box solutions that must stem from computer technology and produce a concrete technical improvement. BACKGROUND

[0002] As understood herein, players of computer simulations, such as computer games, are often asked to select a virtual weapon for use in the game. As further understood herein, inexperienced players often do not make the best selection, resulting in frustration. SUMMARY

[0003] Accordingly, a system includes at least one computer simulation controller and at least one computer simulation source configured to receive input from the computer simulation controller to control a presentation of a computer simulation presented on at least one display. The computer simulation source includes at least one processor and at least one storage device accessible by the processor having instructions executable by the processor to identify at least a first successful performance in a simulation in at least one previously performed simulation in terms of performance of the simulation. The instructions are executable to identify at least one virtual tool used during the successful performance; and present a recommendation of the tool to a second player of the computer simulation.

[0004] The computer simulation source can include a network server in communication with the computer simulation controller over a computer network, and / or a computer game console in direct communication with the computer simulation controller.

[0005] In some examples, the instructions are executable to identify the virtual tool at least partially using at least one machine learning algorithm to process images of the previously performed simulation. In non-limiting embodiments, the instructions are executable to identify the second player as an inexperienced player in need of a recommendation at least partially using at least one machine learning algorithm to process information related to the second player. The virtual tool can include a virtual weapon or a virtual vehicle. The instructions can be executable to recommend a hand to use with the virtual tool to the second player.

[0006] In another aspect, a method includes identifying a player of a computer simulation as being in need of assistance in performing the simulation, and presenting a recommendation regarding performance of the simulation to the player on at least one display in response to identifying the player as being in need of assistance.

[0007] In non-limiting examples of the method, the recommendation can be visual and / or audible. In some embodiments, identifying the player as being in need of assistance can include receiving an inexperienced selection from at least one user interface (UI). In other embodiments, identifying the player as being in need of assistance can include analyzing at least some simulation commands input from the simulation controller.

[0008] In an example, the recommendation can include a recommendation regarding a tool to use, such as a virtual weapon or a virtual vehicle. The recommendation can include at least one instruction for proceeding to a simulated destination in the simulation.

[0009] In another aspect, an apparatus includes at least one computer storage device that is not a transitory signal, and the computer storage device in turn includes instructions executable by at least one processor to identify a player of a computer simulation as having a first characteristic, and in response to identifying the player as having the first characteristic, provide audio and / or video assistance to the player in performing the simulation using at least one display.

[0010] The details of the application, both as to its structure and operation, can be best understood with reference to the accompanying drawings, in which like reference numerals refer to like parts, and in which: BRIEF DESCRIPTION OF DRAWINGS

[0011] Figure 1 is a block diagram of an exemplary system including examples in accordance with the principles of the application;

[0012] Figure 2 is a screen shot of an exemplary user interface (UI) that enables a simulation player to indicate whether he is inexperienced;

[0013] Figure 3 is a flow chart of exemplary logic to identify whether a player is inexperienced based on game play;

[0014] Figure 4 and Figure 5 is a flow chart of exemplary logic to recommend tools and actions in accordance with the principles of the application; and

[0015] Figure 6 is a screen shot of an exemplary recommendation screen during a simulation. DETAILED DESCRIPTION

[0016] The present disclosure relates generally to computer ecosystems, including aspects of consumer electronics (CE) device networks, such as but not limited to computer simulation networks such as computer game networks, and standalone computer simulation systems. The systems herein can include server and client components connected over a network, such that data can be exchanged between the client and server components. The client components can include one or more computing devices, including a Sony PlayStation® 4 or PlayStation® 5, a Microsoft Xbox® One or Xbox® Series X|S, a Nintendo Switch®, or a personal computer (PC) running a game console emulator. The server components can include one or more computing devices, including a server computer running a game console emulator. or game console, virtual reality (VR) headset, augmented reality (AR) headset, portable television (e.g., smart TV, Internet-enabled TV), portable computer (such as a laptop computer and tablet computer), and other mobile devices (including smartphones and additional examples discussed below) made by Microsoft or Nintendo or other manufacturers. These client devices can operate under a variety of operating environments. For example, some client computers can employ a Linux operating system, an operating system from Microsoft, or a Unix operating system, or an operating system produced by Apple Computer or Google. These operating environments can be used to execute one or more browsing programs, such as a browser made by Microsoft or Google or Mozilla, or other browser program that can access websites hosted by Internet servers discussed below. In addition, the operating environments according to the principles of the present invention can be used to execute one or more computer game programs.

[0017] The servers and / or gateways can include one or more processors executing instructions that configure the servers to receive and transmit data over a network, such as the Internet. Alternatively, the clients and servers can be connected via a local intranet or virtual private network. The servers or controllers can be instantiated by examples of game consoles (such as Sony PlayStation®, Microsoft Xbox®, and Nintendo Wii®), personal computers, and the like.

[0018] Information can be exchanged between the clients and the servers over the network. To this end and for security, the servers and / or clients can include firewalls, load balancers, temporary storage, and proxies, as well as other network infrastructure for reliability and security. One or more servers can form an apparatus that implements a method of providing a secure community (such as an online social website) to members of a network.

[0019] As used herein, instructions refer to computer-implemented steps for processing information in the system. Instructions can be implemented in software, firmware or hardware and include any type of programmed step implemented using processing components.

[0020] The processor can be any conventional general purpose single- or multi-chip processors that can execute logic by means of various wires, such as address lines, data lines, and control lines, as well as registers and shift registers.

[0021] The software modules described by the flowcharts and user interfaces herein can include various subroutines, programs, and the like. Without limitation, logic stated as being performed by a particular module can be reallocated to other software modules and / or combined together in a single module and / or made available in a shareable library. ​

[0022] The inventive principles described herein can be implemented as hardware, software, firmware, or combinations thereof; as such, the illustrative components, blocks, modules, circuits, and steps are set forth in terms of their functionality.

[0023] In addition to those items already mentioned above, the logical blocks, modules, and circuits described below can be implemented or performed with general purpose processors, Digital Signal Processors (DSPs), Field Programmable Gate Arrays (FPGAs), or other programmable logic devices, such as Application Specific Integrated Circuits (ASICs), discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A processor can be implemented by a controller or state machine or a combination of computing devices.

[0024] The functions and methods described below, when implemented in software, can be written in an appropriate language such as, but not limited to, Java, C# or C++, and can be stored on or transmitted across one or more computer-readable storage media such as random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), compact discs (CD-ROMs), or other optical storage devices, magnetic storage devices, or any other storage devices comprising a removable thumb drive, etc. A connection can establish a computer-readable medium. Such connections can include, for example, wired connections including fiber optic and coaxial wires and digital subscriber line (DSL) and twisted pair wires. Such connections can include wireless communication connections, including infrared and radio.

[0025] Components included in one embodiment can be used in other embodiments in any appropriate combination. For example, any of the various components described herein and / or depicted in the Figures can be combined, interchanged or excluded from other embodiments.

[0026] A "system having at least one of A, B, and C" (likewise "a system having at least one of A, B, or C" and "a system having at least one of A, B, C") includes systems that have: A only; B only; C only; both A and B; both A and C; both B and C; and / or A, B, and C.

[0027] Reference will now be made to specific embodiments Figure 1, showing an example system 10, which can include one or more of the example devices mentioned above and described further below in accordance with the principles of the application. A first one of the example devices included in the system 10 is a consumer electronics (CE) device such as an audio video device (AVD) 12, such as but not limited to an Internet-enabled TV with a TV tuner (equivalently, a set-top box that controls a TV). Alternatively, however, the AVD 12 can be an appliance or a household item, e.g., a computerized Internet-enabled refrigerator, washer, or dryer. Alternatively, the AVD 12 can also be a computerized Internet-enabled ("smart") phone, tablet computer, notebook computer, computerized Internet-enabled wearable device such as, e.g., a computerized Internet-enabled watch, a computerized Internet-enabled bracelet, other computerized Internet-enabled device, a computerized Internet-enabled music player, a computerized Internet-enabled earpiece, a computerized Internet-enabled implantable device such as an implantable skin device, etc. Regardless, it is to be understood that the AVD 12 is configured to take the principles of the application (e.g., to communicate with other CE devices to take the principles of the application, to perform the logic described herein, and to perform any other functions and / or operations described herein).

[0028] Thus, to implement such principles, the AVD 12 can be built from some or all of the components shown. Figure 1 For example, the AVD 12 can include one or more displays 14, which can be implemented by a high-definition or ultra-high-definition "4K" or higher flat screen, and which can support touch for receiving user input signals via touch on the display. The AVD 12 can include one or more speakers 16 for outputting audio in accordance with the principles of the application, and at least one additional input device 18 such as, e.g., an audio receiver / microphone for inputting audible commands to the AVD 12, e.g., to control the AVD 12. The example AVD 12 can also include one or more network interfaces 20 for communicating over at least one network 22 such as the Internet, a WAN, a LAN, etc., under the control of one or more processors 24. A graphics processor 24A can also be included. Thus, the interface 20 can be, but is not limited to, a Wi-Fi transceiver, which is an example of a wireless computer network interface such as, but not limited to, a mesh network transceiver. It will be understood that the processor 24 controls the AVD 12 to take the principles of the application, including the other elements of the AVD 12 described herein such as, e.g., controlling the display 14 to present images on the display and to receive input from the display. Further, it is noted that the network interface 20 can be, e.g., a wired or wireless modem or router or other appropriate interface such as, e.g., a wireless telephony transceiver, or a Wi-Fi transceiver as mentioned above, etc.

[0029] In addition to the foregoing, the AVD 12 can also include one or more input ports 26, such as, for example, a High-Definition Multimedia Interface (HDMI) port or a USB port for physically connecting (e.g., using a wired connection) to another CE device and / or an earphone port for connecting earphones to the AVD 12 for presentation of audio from the AVD 12 to a user through the earphones. The input port 26 can be connected to a wired or satellite source 26a of audio video content via a wire or wirelessly, for example. Thus, the source 26a can be a separate or integrated set-top box or satellite receiver, for example. Alternatively, the source 26a can be a game console or disk player containing content that can be user's favorites for channel allocation purposes described further below. When implemented as a game console, the source 26a can include some or all of the components described below with respect to the CE device 44.

[0030] The AVD 12 can also include one or more computer memories 28 that are not transitory signals, such as disk-based or solid state storage devices, which in some cases are embodied as a separate device in the housing of the AVD, or as a personal video recording device (PVR) or video disk player inside or outside the housing of the AVD for playing back AV programs, or as a removable memory media. Also in some embodiments, the AVD 12 can include a location or positioning receiver, such as but not limited to a cell phone receiver, a GPS receiver, and / or an altimeter 30, configured to receive geographic position information from at least one satellite or cell tower, for example, and provide that information to the processor 24 and / or determine an altitude at which the AVD 12 is located in conjunction with the processor 24. However, it will be understood that another suitable location receiver other than a cell phone receiver, a GPS receiver, and / or an altimeter can be used to determine a location of the AVD 12 in, for example, all three dimensions, in accordance with the principles of the application.

[0031] Continuing the description of the AVD 12, in some embodiments, the AVD 12 can include one or more cameras 32 that can be, for example, thermal imaging cameras, digital cameras such as webcams, and / or cameras integrated into the AVD 12 and capable of being controlled by the processor 24 to gather pictures / images and / or video, in accordance with the principles of the application. A Bluetooth transceiver 34 and other near field communication (NFC) elements 36 can also be included on the AVD 12 for communicating with other devices using Bluetooth and / or NFC technology, respectively. An example NFC element can be a radio frequency identification (RFID) element.

[0032] Further, the AVD 12 can include one or more auxiliary sensors 37 (e.g., motion sensors such as accelerometers, gyroscopes, gyro meters, or magnetic sensors, infrared (IR) sensors, optical sensors, speed and / or cadence sensors, gesture sensors (e.g., for sensing gesture commands, etc.)) that provide input to the processor 24. The AVD 12 can include an over-the-air TV broadcast port 38 for receiving OTA TV broadcasts that provide input to the processor 24. In addition to the foregoing, it is noted that the AVD 12 can also include an infrared (IR) transmitter and / or IR receiver and / or IR transceiver 42, such as an IR Data Association (IRDA) device. A battery (not shown) can be provided for powering the AVD 12.

[0033] Still referring to Figure 1 In addition to the AVD 12, the system 10 can include one or more other CE device types. In one example, a first CE device 44 can be used to send computer game audio and video to the AVD 12 via commands sent directly to the AVD 12 and / or through a server described below, while a second CE device 46 can include similar components as the first CE device 44. In the illustrated example, the second CE device 46 can be configured as a VR headset worn by a player 47, as shown. In the illustrated example, only two CE devices 44, 46 are shown, it being understood that fewer or greater devices can be used. For example, the principles hereinafter discuss multiple players 47 communicating with each other through respective headsets during play of a computer game provided by a game console to one or more AVDs 12.

[0034] In the illustrated example, for purposes of illustrating the principles of the application, it is assumed that all three devices 12, 44, 46 are members of, for example, an in-home entertainment network, or at least are in proximity to each other at a location such as a house. However, the principles of the application are not limited to the particular location shown by the dashed line 48, unless explicitly required otherwise.

[0035] The exemplary, non-limiting first CE device 44 can be established by any of the above-described devices (e.g., a portable wireless laptop or notebook computer or game controller), and thus can have one or more of the components described hereinafter. The first CE device 44 can be a remote control (RC) for issuing AV play and pause commands to the AVD 12, for example, or it can be a more complex device such as a tablet computer, a game controller that communicates with the AVD 12 and / or a game console via a wired or wireless link, a personal computer, a wireless telephone, etc.

[0036] Accordingly, the first CE device 44 can include one or more displays 50 that can support touch for receiving user input signals via touch on the display. The first CE device 44 can include one or more speakers 52 for outputting audio in accordance with the principles of the application, and at least one additional input device 54, such as, for example, an audio receiver / microphone, for inputting, for example, audible commands to the first CE device 44 to control the device 44. The example first CE device 44 can also include one or more network interfaces 56 for communicating over the network 22 under the control of one or more CE device processors 58. A graphics processor 58A can also be included. Thus, the interface 56 can be, without limitation, a Wi-Fi transceiver, which is an example of a wireless computer network interface, including a mesh network interface. It is to be understood that the processor 58 controls the first CE device 44 to implement the principles of the application, including the other elements of the first CE device 44 described herein, such as, for example, controlling the display 50 to present images on the display and to receive input from the display. Further, it is noted that the network interface 56 can be, for example, a wired or wireless modem or router or other appropriate interface, such as, for example, a wireless telephony transceiver, or a Wi-Fi transceiver as mentioned above, and the like.

[0037] In addition to the foregoing, the first CE device 44 can also include one or more input ports 60, such as, for example, HDMI ports or USB ports, for physically connecting, e.g., using a wired connection, to another CE device and / or an earphone port for connecting earphones to the first CE device 44 for presenting audio from the first CE device 44 to a user through the earphones. The first CE device 44 can also include one or more tangible computer readable storage media 62, such as disk-based or solid state storage. Also in some embodiments, the first CE device 44 can include a location or positioning receiver, such as, but not limited to, a cell phone and / or GPS receiver and / or altimeter 64, configured to receive geographic position information from at least one satellite and / or cell tower, e.g., using triangulation, and provide that information to the CE device processor 58 and / or determine, in conjunction with the CE device processor 58, an altitude at which the first CE device 44 is located. However, it is to be understood that another suitable location receiver other than a cell phone and / or GPS receiver and / or altimeter can be used to determine, e.g., a location of the first CE device 44 in, e.g., all three dimensions, in accordance with the principles of the application.

[0038] Continuing with the description of the first CE device 44, in some embodiments, the first CE device 44 can include one or more cameras 66, which can be, for example, thermal imaging cameras, digital cameras such as webcams, and / or cameras integrated into the first CE device 44 and capable of being controlled by the CE device processor 58 to collect pictures / images and / or video, in accordance with the principles of the present application. Also included on the first CE device 44 can be a Bluetooth transceiver 68 and other near field communication (NFC) elements 70 for communicating with other devices using Bluetooth and / or NFC technology, respectively. An example NFC element can be a radio frequency identification (RFID) element.

[0039] In addition, the first CE device 44 can include one or more auxiliary sensors 72 (e.g., motion sensors such as accelerometers, gyroscopes, gyro meters, or magnetic sensors, infrared (IR) sensors, optical sensors, speed and / or cadence sensors, gesture sensors (e.g., for sensing gesture commands), etc.) that provide input to the CE device processor 58. The first CE device 44 can include still other sensors that provide input to the CE device processor 58, such as, for example, one or more climate sensors 74 (e.g., barometers, humidity sensors, wind sensors, light sensors, temperature sensors, etc.) and / or one or more biometric sensors 76. In addition to the foregoing, it is noted that, in some embodiments, the first CE device 44 can also include an infrared (IR) emitter and / or IR receiver and / or IR transceiver 78, such as an IR data association (IRDA) device. A battery (not shown) can be provided for powering the first CE device 44. The CE device 44 can communicate with the AVD 12 through any of the aforementioned communication modes and related components.

[0040] The second CE device 46 can include some or all of the components shown for the CE device 44. Either or both CE devices can be powered by one or more batteries.

[0041] Referring now to the at least one server 80 mentioned earlier, it includes at least one server processor 82, at least one tangible computer-readable storage medium 84 (such as a disk-based storage or solid state storage), and at least one network interface 86 that, under control of the server processor 82, allows for communication with other devices on the network 22, and indeed can facilitate communication between servers and client devices in accordance with the principles of the present application. It is noted that the network interface 86 can be, for example, a wired or wireless modem or router, a Wi-Fi transceiver, or other appropriate interface such as, for example, a wireless telephony transceiver. Figure 1

[0042] ​Accordingly, in some embodiments, the server 80 can be an Internet server or a field of servers, and can include and perform "cloud" functionality, such that the devices of the system 10 can access a "cloud" environment via the server 80 in example embodiments such as a networked gaming application. Alternatively, the server 80 can be implemented by one or more game consoles or other computers in the same room or nearby as the other devices shown in FIG. 1. Figure 1

[0043] The methods herein can be implemented as software instructions executed by a processor, a suitably configured application-specific integrated circuit (ASIC) or field-programmable gate array (FPGA) module, or any other convenient means as will be appreciated by those skilled in the art. Where employed, the software instructions can be embodied in a non-transitory device such as a CD ROM or flash drive. The software code instructions can alternatively be embodied as a transitory arrangement such as a radio or optical signal, or via download over the Internet.

[0044] Reference is now made to Figure 2 , which shows a user interface (UI) 200 that can be presented to a player of a video simulation such as a video game on a display 12 of, for example, Figure 1 The simulation system can include some or all of the components shown in Figure 1 and described above.

[0045] The UI 200 can be presented at the start of a computer simulation or based on some other trigger. As shown, the UI 200 can include a welcome message 202 and at least one selector 204 that a player can select to indicate that the player is not familiar with the computer simulation or in other words has no experience with the computer simulation. Such a player can colloquially be referred to as a "newbie". Note that the UI 200 can be presented audibly, whereby a conversational program can ask the player questions to determine whether the player is a "newbie".

[0046] In addition to or instead of allowing the player to indicate that he or she is a "newbie", Figure 3 ​An exemplary logic for automatically determining player inexperience is shown. Starting at box 300, one or more neural networks (NNs) (such as, but not limited to, convolutional NNs) are trained on the ground-based live simulation history of both experienced and inexperienced players. The simulation history can be obtained using stored records of player input commands to, for example, a simulation controller. Alternatively, the simulation history can be obtained by analyzing recorded video of completed simulations. "Experienced" players are those who have reached a success threshold during previous simulations, such as playing for a period of time greater than the threshold before the simulation terminates (e.g., due to the player being "killed"). Other success thresholds might be the number of simulation points reached, or the simulation complexity reaching the threshold level, etc. "Inexperienced" players are those who have failed to reach the "experienced" threshold or have failed to reach a threshold below the "experienced" threshold, meaning that a significant gap can be established between the abilities of experienced and inexperienced players during training if needed.

[0047] During training, the "first step" can be learned from both experienced and inexperienced players for any given simulation. This is just one example of the detailed attributes of a successful simulation and recognizes that a goal is to help inexperienced players survive in a new simulation for a period of time, rather than being terminated early in the simulation. By learning the initial inputs that successful players made to the game controller when playing past simulations, recommendations for "newbies" can be better tailored to allow them to enjoy new simulations for a longer period of time than in other ways. Furthermore, learning the first steps of players who lack the necessary success rate helps in identifying "newbies."

[0048] Once the neural network has been trained, it can be used at box 302 to track the first step of the currently simulated player. If the first step indicates that the player is inexperienced at decision diamond 304, the recommendation engine is invoked at box 306. Otherwise, the logic ends.

[0049] Figure 4 and Figure 5 This illustrates exemplary logic for assisting inexperienced players or "newbies" once they are identified as such. Figure 4 At box 400, access the history of past gameplay of the simulation discussed above, and select the most successful gameplay at box 402. Proceed to box 404, where image analysis of videos of past successful gameplay or input records of players using past successful gameplay, or other methods, identifies the tools (including virtual weapons, virtual vehicles, and hands using virtual weapons) selected and used by the players.

[0050] Other attributes of successful play can also be identified. For example, for each frame or simulation segment or chapter, not only can the virtual weapon used be identified, but the player's simulated motion through the simulated space can also be identified. In this way, not only can a "newbie" be assisted through the first chapter or segment of a simulation, but the "newbie" can also be assisted through subsequent chapters or segments.

[0051] Figure 5 Logic for recommending weapons or other tips to a player identified as a newbie is shown. Beginning at block 500, the player is identified as a newbie according to the principles described above. Moving to block 502, the past successful play information identified in the database is accessed, and then recommendations are made to the newbie player on a visual and / or audible and / or tactile display while the newbie is engaged in the simulation. Figure 4

[0052] The recommendations can take a variety of forms. In the simplest form, the recommendation can be a message to select a particular weapon. The recommendation can further describe which simulated hand the weapon should be held in. The recommendation can suggest a particular virtual vehicle or other tool. The suggestion can provide a ranked list of weapon usage from best to worst. The recommendation can be an instruction to change one weapon for another, or it can simply be a tip on the correct weapon. For example, if the correct weapon is a sword, then the recommendation can be to select the best cutting tool.

[0053] Figure 6 An example of a recommendation to a newbie using text and graphics is shown, it will be appreciated that audio and haptic feedback can also or instead be provided. As shown, a UI 600 can be presented showing the player's character 602, and if desired, an indication 604 of the direction in which the player's character 602 is moving. In the non-limiting example shown, the player's character 602 is moving towards a danger 606, in this case a ogre that can or can not be hidden from the player. Figure 6

[0054] The recommendation engine described above accordingly presents a message 608 to obtain the virtual weapon that the system has learned was an effective tool during past successful play of this simulation, in the example shown an axe. The recommendation 608 not only identifies the virtual tool to use, it also indicates at 610 the location to which the player's character 602 must return to obtain the tool.

[0055] It will be appreciated that while the principles of the application have been described with reference to some example implementations, these implementations are not intended to be limiting and that the subject matter claimed herein can be implemented using a variety of alternative arrangements.​​

Claims

1. A system for computer simulation, comprising: at least one computer simulation controller; at least one computer simulation source configured to receive input from the computer simulation controller to control presentation of a computer simulation presented on at least one display, the computer simulation source comprising at least one processor and at least one storage device accessible by the processor and comprising instructions executable by the processor to: identify, in at least one previously conducted simulation, at least a first successful performance by a first player in terms of performance of the simulation, at least in part by using image analysis of recorded video of the at least one previously conducted simulation to analyze the recorded video of the at least one previously conducted simulation to identify successful performance based on analyzing the recorded video, the successful performance based at least in part on identifying tools selected and used by a successful player of the at least one previously conducted simulation using image analysis comprising at least one machine learning algorithm; identify, using the image analysis, at least one virtual tool used in the first successful performance; and present a recommendation of the tool to a second player of the computer simulation.

2. The system of claim 1, wherein the computer simulation source comprises a network server in communication with the computer simulation controller over a computer network.

3. The system of claim 1, wherein the computer simulation source comprises a computer game console in direct communication with the computer simulation controller.

4. The system of claim 1, wherein the instructions are executable to: process images of the previously conducted simulation using at least in part at least one machine learning algorithm to identify the virtual tool.

5. The system of claim 1, wherein the instructions are executable to: process information related to the second player using at least in part at least one machine learning algorithm to identify the second player as a novice player in need of the recommendation.

6. The system of claim 1, wherein the virtual tool comprises a virtual weapon.

7. The system of claim 1, wherein the virtual tool comprises a virtual vehicle.

8. The system of claim 1, wherein the instructions are executable to: recommend to the second player a hand to use with the virtual tool.

9. A method for computer simulation, comprising: identifying a player of a computer simulation as being in need of assistance in performing the simulation; analyzing recorded video of at least one previously conducted simulation using image analysis of the recorded video of the at least one previously conducted simulation to identify successful performance based on analyzing the recorded video, the successful performance based at least in part on identifying tools selected and used by a successful player of the at least one previously conducted simulation using image analysis comprising at least one machine learning algorithm; presenting to the player on at least one audio-video device at least one recommendation regarding simulated performance in response to identifying the player as needing assistance and based on analyzing the recorded video to identify successful performance.

10. The method of claim 9, wherein the recommendation is visual.

11. The method of claim 9, wherein the recommendation is audible.

12. The method of claim 9, wherein identifying the player as needing assistance comprises receiving a selection of inexperienced from at least one user interface (UI).

13. The method of claim 9, wherein identifying the player as needing assistance comprises analyzing at least some simulated commands input from a simulation controller.

14. The method of claim 9, wherein the recommendation comprises a recommendation regarding a tool to use.

15. The method of claim 14, wherein the tool comprises a virtual weapon.

16. The method of claim 14, wherein the tool comprises a virtual vehicle.

17. The method of claim 9, wherein the recommendation comprises at least one instruction for proceeding to a simulated destination in the simulation.

18. An apparatus for computer simulation, comprising: at least one computer storage device that is not a transitory signal and comprises instructions executable by at least one processor to: identify a player of a computer simulation as having a first characteristic; analyze recorded video of at least one previously performed simulation using image analysis of the recorded video of the at least one previously performed simulation to identify successful performance based on analyzing the recorded video, the successful performance based at least in part on identifying tools selected and used by successful players of the at least one previously performed simulation using image analysis comprising at least one machine learning algorithm; in response to identifying the player as having the first characteristic and successful performance using image analysis of the recorded video, provide audio and / or video assistance to the player in performing the simulation using at least one display.

19. The apparatus of claim 18, wherein the first characteristic comprises being inexperienced in performing the computer simulation.

20. The apparatus of claim 18, wherein the assistance comprises at least one recommendation regarding a virtual tool the player should select in the simulation.

Citation Information

Patent Citations

  • Determining highlights in a game spectating system

    US10363488B1

  • User analysis system and method

    US20190329138A1