Online gaming platform voice communication system
By receiving, filtering and modifying voice messages in the online gaming platform, the need to protect user privacy and match virtual avatars is solved, and the matching and privacy protection between voice and virtual avatars is achieved, improving the user experience.
Patent Information
- Application Number
- CN201980084771.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-12-20
- Filing Date
- 2019-09-24
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2039-09-24
AI Technical Summary
In online gaming platforms, it is necessary to protect user privacy and provide a more entertaining voice communication experience, especially in the case of child users or other users who wish to conceal voice, it is difficult for the prior art to effectively modify voice audio to match the user's virtual avatar or Meet privacy needs.
By receiving and translating voice messages as text, identifying and filtering restricted parts, selectively modifying voice messages, including using audio filters to change tone or retaining original sound, and modifying voice features based on user age and parental instruction, providing them to the recipient user. The device associated with the account.
It has achieved the privacy protection and entertainment improvement of voice messages in online gaming platforms, ensuring that voice and virtual avatar characteristics match, and meeting the privacy and interaction needs of different user groups.
Smart Images

Figure CN113286641B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of communication within an online platform, and more particularly to a method, system and computer-readable medium for voice communication within an online gaming platform. Background Art
[0002] Online gaming platforms allow users to connect with each other, interact with each other (e.g., within a game), and share information with each other via the Internet. Users of online gaming platforms can participate in multiplayer gaming environments, design custom gaming environments, decorate avatars, exchange virtual items with other users, communicate with other users, etc.
[0003] To protect the user's privacy and / or provide a more entertaining gaming experience, voice communications in an online gaming environment may need to include modified voice audio to mask the actual sound of the user's voice and / or change the voice audio to reflect the user's character or avatar in the online gaming environment.
[0004] Based on the above requirements and other considerations, some implementation methods are proposed. Summary of the invention
[0005] Some embodiments include a method. The method includes: receiving a first voice message associated with a sender user account in an online gaming platform and a recipient user account in the online gaming platform; programmatically transcribing the first voice message into text; identifying one or more restricted portions of the text based on at least one of the sender user account or the recipient user account; and filtering portions of the first voice message corresponding to the one or more restricted portions of the text to obtain a filtered voice message.
[0006] The method also includes selectively modifying the filtered voice message to obtain a modified voice message; and providing the modified voice message to a device associated with the recipient user account.
[0007] In some embodiments, identifying the one or more restricted portions of the text includes: when the sender user account or the recipient user account is associated with a user age threshold, identifying a portion of the text that includes personally identifiable information associated with at least one user account of the online gaming platform. In some embodiments, identifying the one or more restricted portions of the text includes: when the sender user account is associated with a user age threshold and the recipient user account is not a confirmed acquaintance account of the sender user account within the online gaming platform, identifying one or more portions of the text that correspond to personally identifiable information.
[0008] In some embodiments, selectively modifying the first voice message includes: modifying the first voice message according to a voice chat information surface, the voice chat information surface including parameters, the parameters being used to modify the voice sound of the first voice message to have voice characteristics associated with a type of the voice chat information surface. In some embodiments, selectively modifying the first voice message includes: retaining the original sound of the first voice message if the sender user account is associated with a first user age threshold. In some embodiments, selectively modifying the first voice message includes: retaining the original sound of the first voice message if the sender user account is associated with a second user age threshold, the recipient user account includes an indication that one or more other users associated with the recipient user account are confirmed acquaintances of the user associated with the sender user account, or an authorization indication associated with the sender user account is received.
[0009] In some embodiments, the recipient user account includes the following statuses: unknown recipient, known recipient of a user associated with the sender user account within the online gaming platform, or known recipient of a user associated with the sender user account outside the online gaming platform, wherein the operations of identifying, filtering, and selectively modifying are based at least in part on the status of the recipient user account. In some embodiments, the modification operation is based on an age associated with the sender user account and an age associated with the recipient user account or a parental authorization received by the sender user account.
[0010] In some embodiments, the modification operation is based on an age associated with the sender user account and a parental authorization received by the sender user account. In some embodiments, the modification operation includes replacing the original voice audio in the modified voice message with a computer synthesized voice.
[0011] In some embodiments, the modifying operation includes applying an audio filter to change the pitch of the first voice message to mask the recognizable sound of the voice of the user associated with the sender user account. In some embodiments, the modifying operation can be implemented using audio filters to allow users within the online gaming platform to engage in more self-expression, such as by providing audio filters and an interface that allows users to select audio filters based on creative self-expression.
[0012] The method also includes determining whether to start a voice chat between the sender user account and the receiver user account according to the sender user account or the receiver user account, and performing identification, filtering, modification and provision operations if it is determined to start the voice chat.
[0013] Some embodiments include a system. The system includes: a memory; and a processing device, coupled to the memory, the processing device configured to perform the following operations: receiving a first voice message associated with a sender user account in an online gaming platform and a recipient user account in the online gaming platform; programmatically transcribing the first voice message into text; identifying one or more restricted portions of the text based on at least one of the sender user account or the recipient user account; and filtering portions of the first voice message corresponding to the one or more restricted portions of the text to obtain a filtered voice message.
[0014] The operation also includes selectively modifying the filtered voice message to obtain a modified voice message; and providing the modified voice message to a device associated with the recipient user account.
[0015] In some embodiments, identifying the one or more restricted portions of the text includes: when the sender user account or the recipient user account is associated with a user age threshold, identifying a portion of the text that includes personally identifiable information associated with at least one user account of the online gaming platform. In some embodiments, identifying the one or more restricted portions of the text includes: when the sender user account is associated with a user age threshold and the recipient user account is not a confirmed acquaintance account of the sender user account within the online gaming platform, identifying one or more portions of the text that correspond to personally identifiable information.
[0016] In some embodiments, selectively modifying the first voice message includes: modifying the first voice message according to a voice chat information surface, the voice chat information surface including parameters, which are used to modify the voice sound of the first voice message to have voice characteristics associated with the type of the voice chat information surface.
[0017] Some embodiments include a non-transitory computer-readable medium including instructions, in response to execution by a processing device, causing the processing device to perform the following operations: receiving a first voice message associated with a sender user account in an online gaming platform and a recipient user account in the online gaming platform; programmatically transcribing the first voice message into text; identifying one or more restricted portions of the text based on at least one of the sender user account or the recipient user account; filtering portions of the first voice message corresponding to the one or more restricted portions of the text, thereby obtaining a filtered voice message. The operation also includes selectively modifying the filtered voice message, thereby obtaining a modified voice message; and providing the modified voice message to a device associated with the recipient user account.
[0018] In some embodiments, selectively modifying the first voice message includes: retaining the original sound of the first voice message if the sender user account is associated with a first user age threshold. In some embodiments, selectively modifying the first voice message includes: retaining the original sound of the first voice message if the sender user account is associated with a second user age threshold, and the recipient user account includes an indication that one or more other users associated with the recipient user account are confirmed acquaintances of the user associated with the sender user account, or an authorization indication associated with the sender user account is received.
[0019] In some embodiments, the recipient user account includes the following statuses: unknown recipient, a known recipient of a user associated with the sender user account within the online gaming platform, or a known recipient of a user associated with the sender user account outside the online gaming platform, wherein the operations of identification, filtering, and selective modification are based at least in part on the status of the recipient user account. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] Various embodiments of the present application will be more fully understood from the detailed description given below and from the accompanying drawings of various embodiments of the present application.
[0021] Figure 1 An exemplary system structure of voice communication for an online gaming platform provided by an embodiment of the present application is shown.
[0022] Figure 2 A flow chart of an exemplary method for voice communication on an online gaming platform provided in an embodiment of the present application is shown.
[0023] Figure 3 A schematic diagram of a user interface and voice communication provided in an embodiment of the present application is shown.
[0024] Figure 4 A block diagram of an exemplary computing device provided by an embodiment of the present application is shown. DETAILED DESCRIPTION
[0025] Online gaming platforms (also referred to herein as "user-generated content platforms" or "user-generated content systems") provide users with a variety of ways to interact. For example, users of an online gaming platform can work together toward a common goal, share various virtual game items, send each other electronic messages, and so on. Users of an online gaming platform can play games using characters. An online gaming platform may also allow users of the platform to communicate with each other. For example, users of an online gaming platform may communicate with each other using voice messages (e.g., by voice "chatting"), text messages, video messages, or a combination of the above.
[0026] Voice communications within an online gaming environment may present one or more technical issues. For example, it may be necessary to modify the voice of certain users (e.g., children or other users who have chosen voice privacy) to disguise the user's actual voice. Some embodiments of the present application may provide modified voices to meet the need or request to modify the voice communications of one or more users. The modification may be performed at the request of the user or automatically based on specific criteria associated with the user's account (e.g., the age of the user sending the voice message, the age of the user receiving the voice message, parental authorization, etc.).
[0027] Furthermore, while an online gaming platform user may select an appearance for an avatar representing the user in an online game, it may be desirable for the user's voice communications to match the avatar's appearance (e.g., a robot avatar speaks with a robot voice, a pirate avatar speaks with a pirate voice, etc.) Some embodiments provide solutions to the technical problem of matching voice to user avatar features in an online gaming platform.
[0028] Figure 1 An example system architecture 100 according to some embodiments of the present application is shown. The system architecture 100 (also referred to herein as a "system") includes an online gaming platform 102, a first client device 110 (generally referred to herein as "client device 110"), a network 122, and a second client device 124. The online gaming platform 102 may include a gaming engine 104, one or more games 105, a voice communication module 106, a sender user account and / or a recipient user account 107, and a data storage 108, among other things. The client device 110 may include a gaming application 112 and be coupled to a microphone 114, an input device 116, and an output device 118. The client device 124 may include a gaming application 126 and be coupled to a microphone 128, an input device 130, and an output device 132.
[0029] The system structure 100 is provided for exemplary purposes only and is not limiting. In some embodiments, the system structure 100 may include Figure 1 The same, fewer, more or different elements configured in the same or different manner as shown.
[0030] According to one embodiment, the network 122 may include a public network (e.g., the Internet), a private network (e.g., a local area network LAN or a wide area network WAN), a wired network (e.g., an Ethernet network), a wireless network (e.g., an 802.11 network, a Wi-Fi network, or a wireless network WLAN), a cellular network (e.g., a Long Term Evolution LTE network), a router, a hub, a switch, a server computer, or a combination thereof.
[0031] According to one embodiment, the data storage 108 can be a non-transitory computer-readable memory (e.g., random access memory), a cache, a drive (e.g., a hard drive), a flash drive, a database system, or other types of components or devices capable of storing data. The data storage 108 can also include multiple storage components (e.g., multiple drives or multiple databases) across multiple computing devices (e.g., multiple server computers).
[0032] In some embodiments, the online gaming platform 102 may include a server having one or more computing devices (e.g., a cloud computing system, a rack-mounted server, a server computer, a physical server cluster, etc.). In some embodiments, the server may be included in the online gaming platform 102, be a stand-alone system, or be part of another system or platform.
[0033] In some embodiments, the online gaming platform 102 may include one or more computing devices (e.g., rack servers, router computers, server computers, personal computers, mainframe computers, laptop computers, tablet computers, desktop computers, etc.), data storage (e.g., hard disks, memories, databases), networks, software components, and / or hardware components that may be used to perform operations on the online gaming platform 102 and allow users to access the online gaming platform 102. The online gaming platform 102 may also include a website (e.g., a web page) or application backend software that may be used to provide users with access to content provided by the online gaming platform 102. For example, a user may access the online gaming platform 102 using a gaming application 112 on a client device 110.
[0034] In some embodiments, the online gaming platform 102 may be a social network providing connections between users or a user-generated content system that allows a user (e.g., an end user or consumer) to communicate with other users on the online platform 102, and the communication may include voice chat (e.g., synchronous and / or asynchronous voice communication), video chat (e.g., synchronous and / or asynchronous video communication), or text chat (e.g., synchronous and / or asynchronous text-based communication). In some embodiments of the present application, a "user" may be represented as a single individual. However, other embodiments of the present application include a "user" (e.g., creating a user) as an entity controlled by a group of users or an automated source. For example, a group of individual users united as a community or group in a user-generated content system may be considered a "user."
[0035] In some embodiments, the online game platform 102 may be a virtual game platform. For example, the game platform may provide single-player or multiplayer games to a community of users who access or interact with the game using a client device 110 through a network 122. In some embodiments, the game (also referred to as a "video game," "online game," or "virtual game") may be, for example, a two-dimensional (2D) game, a three-dimensional (3D) game (e.g., a 3D user-generated game), a virtual reality (VR) game, or an augmented reality (AR) game. In some embodiments, a user may participate in a game with other users. In some embodiments, a game may be played in real time with other users of the game.
[0036] In some embodiments, the game process may refer to the interaction of one or more players (e.g., 120 and / or 134) with the game (e.g., 105) or the presentation of the interaction on a display or other output device (such as 118 / 132) of a client device 110 or 124.
[0037] In some embodiments, the game 105 may include an electronic file that can be executed or loaded using software, firmware, or hardware configured to present game content (e.g., digital media items) to an entity. In some embodiments, the game application 112 may be executed and the game 105 may be presented in association with the game engine 104. In some embodiments, the game 105 may have a common set of rules or common goals, and the environments of the game 105 share a common set of rules or common goals. In some embodiments, different games may have different rules or goals.
[0038] In some embodiments, a game may have one or more environments (also referred to herein as "game environments" or "virtual environments"), where multiple environments may be linked. An example of an environment may be a three-dimensional (3D) environment. One or more environments of a game application 105 may be collectively referred to herein as a "world" or "game world" or "virtual world" or "universe". An example of a world may be the 3D world of a game 105. For example, a user may build a virtual environment that is linked to another virtual environment created by another user. Characters of a virtual game may cross a virtual boundary into an adjacent virtual environment.
[0039] It may be noted that a 3D environment or 3D world uses graphics that use a three-dimensional representation of geometric data representing the game content (or at least currently the game content appears as 3D content regardless of whether a 3D representation of geometric data is used). A 2D environment or 2D world uses graphics that use a two-dimensional representation of geometric data representing the game content.
[0040] In some embodiments, the online game platform 102 may host one or more games 105 and may allow users to interact with the games 105 using the game applications 112 of the client devices 110. Users of the online game platform 102 may play, create, interact or build games 105, communicate with other users, and / or create and build objects (e.g., also referred to as "items" or "game objects" or "virtual game items") of the games 105. For example, when generating user-generated virtual items, users may create characters, decorations for characters, one or more virtual environments for interactive games, or structures used in the games 105. In some embodiments, users may buy, sell or trade game virtual game objects with other users of the online game platform 102, such as platform currency (e.g., virtual currency). In some embodiments, the online game platform 102 may transmit game content to the game application (e.g., 112). In some embodiments, game content (also referred to herein as "content") may refer to any data or software instructions (e.g., game objects, games, user information, videos, images, commands, media items, etc.) associated with the online game platform 102 or the game application. In some embodiments, a game object (e.g., also referred to as an "item" or "object" or "virtual game item") may refer to an object used, created, shared, or otherwise described in a game application 105 / 112 of an online game platform 102. For example, a game object may include parts, models, characters, tools, weapons, clothing, buildings, vehicles, currency, flora, fauna, components of the above (e.g., windows of a building), and the like.
[0041] It can be noted that the online gaming platform 102 hosting the game 105 is provided for purposes of illustration and not limitation. In some embodiments, the online gaming platform 102 may host one or more media items, which may include communication messages from one user to one or more other users. The media items may include, but are not limited to, digital videos, digital movies, digital photos, digital music, audio content, melodies, website content, social media updates, e-books, e-magazines, digital newspapers, digital audiobooks, e-journals, web blogs, real simple syndication (RSS) feeds, electronic comic books, software applications, and the like. In some embodiments, the media item may be an electronic file that may be executed or loaded with a physical digital media item using software, firmware, or hardware configured to render.
[0042] In some embodiments, a game 105 may be associated with a particular user or a particular group of users (e.g., a private game), or may be broadly available to users of the online gaming platform 102 (e.g., a public game). In some example implementations, the online gaming platform 102 associates one or more games 105 with a particular user or group of users, and the online gaming platform 102 may use user account information (e.g., a user account identifier such as a username and password).
[0043] In some embodiments, the online gaming platform 102 or the client device 110 may include a game engine 104 or a gaming application 112. In some embodiments, the game engine 104 may be used for the development or execution of a game 105. For example, the game engine 104 may include a rendering engine ("renderer") for 2D, 3D, VR, or AR graphics, a physics engine, a collision detection engine (and collision response), a sound engine, scripting capabilities, an animation engine, an artificial intelligence engine, networking capabilities, streaming capabilities, location management capabilities, threading capabilities, scene graph capabilities, or video support for movies, among other capabilities. Components of the game engine 104 may generate commands (e.g., rendering commands, collision commands, physics commands, etc.) that help calculate and render the game. In some embodiments, the game engine 104 of the client device 110 may work independently, in collaboration with the game engine 104 of the online gaming platform 102, or a combination of both.
[0044] In some embodiments, both the online game platform 102 and the client device 110 execute game engines (104, 112, respectively). The online game platform 102 using the game engine 104 may perform some or all game engine functions (e.g., generating physics commands, rendering commands, etc.), or offload some or all game engine functions to the game engine 104 of the client device 110. In some embodiments, each game 105 may have a different ratio between the game engine functions executed on the online game platform 102 and the game engine functions executed on the client device 110. For example, the game engine 104 of the online game platform 102 may be used to generate physics commands when there is a collision between at least two game objects, while additional game engine functions (e.g., generating rendering commands) may be offloaded to the client device 110. In some embodiments, the ratio of game engine functions executed on the online game platform 102 and the client device 110 may change (e.g., dynamically) based on game process conditions. For example, if the number of users participating in the game process of a particular game 105 exceeds a threshold number, the online game platform 102 may execute one or more game engine functions previously executed by the client device 110.
[0045] For example, a user may play a game 105 on a client device 110 and may send a control instruction (e.g., user input, such as right, left, up, down, user selection, or character position and speed information, etc.) to the online game platform 102. After receiving the control instruction from the client device 110, the online game platform 102 may send a game process instruction (e.g., position and speed information of characters participating in a team game process or commands, such as commands, collision commands, etc.) to the client device 110 based on the control instruction. For example, the online game platform 102 may perform one or more logical operations (e.g., using the game engine 124) on the control instruction to generate a game process instruction for the client device 110. In other cases, the online game platform 102 may transmit one or more control instructions from one client device 110 to other client devices participating in the game 105. The client device 110 may use the game process instruction and cause the game process to be presented on a display of the client device 110.
[0046] In some embodiments, control instructions may refer to instructions for instructing the user's character to act in the game. For example, control instructions may include user inputs that control actions in the game, such as right, left, up, down, user selections, gyroscope position and direction data, force sensor data, etc. Control instructions may include gesture position and speed information. In some embodiments, control instructions are sent directly to the online game platform 102. In other embodiments, control instructions may be sent from the client device 110 to another client device, where the other client device uses the local game engine 104 to generate game process instructions. Control instructions may include instructions to play a voice communication message from another user on an audio device (e.g., a speaker, headphones, etc.).
[0047] In some embodiments, the gameplay instructions may refer to instructions that allow the client device 110 to present the gameplay of a game, such as a multiplayer game. The gameplay instructions may include one or more of user input (e.g., control instructions), character position and velocity information, or commands (e.g., physics commands, rendering commands, collision commands, etc.).
[0048] In some embodiments, characters (or general game objects) are composed of components, one or more of which can be selected by the user, and these components are automatically connected together to help the user edit. One or more characters (also referred to as "avatars" or "models" herein) can be associated with a user, wherein the user can control the characters to facilitate the interaction between the user and the game 105. In some embodiments, a character may include components such as body parts (such as hair, arms, legs, etc.) and accessories (such as T-shirts, glasses, decorative images, tools, etc.). In some example implementations, customizable character body parts include head types, body part types (arms, legs, torsos, and hands), facial types, hair types, and skin types, etc. In some embodiments, customizable accessories include clothes (such as shirts, pants, hats, shoes, glasses, etc.), weapons or other tools. In some embodiments, users can also control the proportions (such as height, width, or depth) of a character or the proportions of a character component. In some embodiments, users can control the proportions of a character (such as in a box form or anatomy form, etc.). It should be noted that in some embodiments, a character may not include character game objects (such as body parts, etc.), but the user can control the character (excluding the character game object) to facilitate the user's interaction with the game (such as a puzzle game in which there is no rendered character game object but the user still controls a character to control the actions in the game).
[0049] In some embodiments, a component, such as a body part, can be a primitive geometric shape, such as a block, a cylinder, a sphere, etc., or some other primitive shapes, such as a wedge, a ring, a tube, a strip, etc. In some embodiments, the creator module can publish the user's character for viewing or use by other users of the online game platform 102. In some embodiments, creating, modifying or customizing characters, other game objects, games 105 or game environments can be implemented by users using a user interface (such as a developer interface) and executed with or without scripts (or with or without an application programming interface API). It can be noted that for purposes of illustration and not limitation, the characters are described as having a humanoid form. It can also be noted that the characters can have any form, such as a vehicle, an animal, an inanimate object, or other creative forms.
[0050] In some embodiments, the online gaming platform 102 may store user-created characters in the data location 108. In some embodiments, the online gaming platform 102 maintains a character directory and a game directory that may be presented to the user through these directories. In some embodiments, the game directory includes game images stored on the online gaming platform 102. In addition, the user may select a character (e.g., a character created by the user or other users) from the character directory to participate in the selected game. The character directory includes character images stored on the online gaming platform 102. In some embodiments, one or more characters in the character directory may be created or customized by the user. In some embodiments, the selected character may have a character setting that defines one or more character components.
[0051] In some embodiments, the user's character may include a configuration of components, wherein the configuration and appearance of the components, and more generally the appearance of the character, may be defined by character settings. In some embodiments, the character settings of the user's character may be selected at least in part by the user. In other embodiments, the user may select a character with a default character setting or a character setting selected by other users. For example, the user may select a default character from a character catalog that predefines character settings, and then the user may further customize the default character by changing some character settings (e.g., adding a shirt with a custom logo). The character settings may be associated with a specific character of the online gaming platform 102.
[0052] In some embodiments, the client devices 110 may each include a computing device, such as a personal computer (PC), a mobile device (e.g., a laptop computer, a mobile phone, a smart phone, a tablet computer, or a netbook computer). In some embodiments, the client devices 110 may also be referred to as "user devices". In some embodiments, one or more client devices 110 may be connected to the online gaming platform 102 at any given moment. It may be noted that the number of client devices 110 is provided as an illustration and not a limitation. In some embodiments, any number of client devices 110 may be used.
[0053] In some embodiments, each client device 110 may include an instance of a game application 112. According to one embodiment, the game application 112 may allow a user to use and interact with the online game platform 102, such as controlling an avatar of a virtual game hosted on the online game platform 102, or viewing or uploading content, such as a game 105, an image, a video project, a web page, a document, etc. In one example, the game application may be a network application (e.g., an application operating in conjunction with a web browser) served by a network server that can access, retrieve, present, or navigate content (e.g., an avatar in a virtual environment, etc.). In another example, the game application may be a local application (e.g., a mobile application, an application, or a game program) that is installed and executed locally on the client device 110 and allows the user to interact with the online game platform 102. The game application may present, display, or show content (e.g., a web page, a media viewer) to the user. In one embodiment, the game application may also include an embedded media player (e.g., a Flash player) embedded in a web page.
[0054] According to a specific embodiment of the present application, the game application may be an online game platform application for users to build, create, edit, upload content to the online game platform 102, and interact with the online game platform 102 (e.g., play the game 105 hosted by the online game platform 102). In this way, the game application may be provided to the client device 110 by the online game platform 102. In another example, the game application may be an application downloaded from a server.
[0055] In some embodiments, a user may log into the online gaming platform 102 through a gaming application. The user may access a user account by providing user account information (e.g., a username and password), wherein the user account is associated with one or more characters that can be used to participate in one or more games 105 of the online gaming platform 102.
[0056] Generally speaking, functions described as being performed by the online gaming platform 102 according to one embodiment may also be performed by the client device 110, or the server, if appropriate in other embodiments. In addition, functions attributed to a particular component may be performed by different or multiple components operating together. The online gaming platform 102 may also be accessed as a service provided to other systems or devices through an appropriate application program interface (API), and is therefore not limited to use in a website.
[0057] In some embodiments, the online gaming platform 102 may include a voice communication module 106. In some embodiments, the voice communication module 106 may be a system, application, or module that allows the online gaming platform 102 to provide voice communication between users, such as voice communication between a sending user (e.g., 120) via a client device 110 and a receiving user (e.g., 134) via a client device 124. In some embodiments, the voice communication module 106 may perform one or more of the following operations in conjunction with: Figure 2 More operations are described by the flowchart shown.
[0058] Figure 2 It is a flow chart of a method 200 for voice communication on an online game platform provided according to a specific embodiment of the present application. The method 200 may be performed by a processing logic including hardware (e.g., circuits, dedicated logic, programmable logic, microcode), software (e.g., instructions running on a processing device to perform hardware simulation), or a combination thereof. In some embodiments, the voice communication module 106 executed on the online game platform 102 may perform some or all operations. In other embodiments, the voice communication module 106 executed on the online game platform 102, the client device 110, the client device 124, or a combination thereof may perform some or all operations. It may be noted that in some embodiments, the method 200 may include the same, different, fewer, or more operations performed in any order.
[0059] At box 202 of method 200, the processing logic executing method 200 receives a first voice message associated with a sender user account in an online gaming platform, and the first voice message is also associated with a recipient user account in the online gaming platform. For example, the platform can receive a voice message from a sender user associated with a sender user account. The voice message may include information (e.g., metadata, such as a sender account, etc.) of a corresponding recipient user account associated with one or more recipient users. The voice message can be obtained from a microphone (e.g., on a headset) or other device on the system being used by the sending user. The voice message can be part of a continuous voice conversation such as a voice chat, or it can be a recorded voice message sent asynchronously, etc. Continue to 204 next.
[0060] At block 204 , the first voice message is programmably transcribed into text. For example, the platform may utilize speech recognition technology to transcribe the voice message into text or data representing the text. Next, proceed to 206 .
[0061] At box 206, any restricted portion of the text is identified. According to the usage policy established by the platform operator, the restricted portion may include an inappropriate phrase of a text with one or more prohibited words or phrases (e.g., swear words are prohibited, hate speech is prohibited, cyberbullying is prohibited, etc.). The restricted portion may also include text that includes personally identifiable information, such as full name, phone number, last name, relative name, etc. In addition, the composition of the restricted portion may be based on one or more of the sender user account or the recipient user account. For example, if the sender user account and the recipient user account are both associated adult players, the criteria for the restricted portion may be different from the account applicable to the associated young player (e.g., minor). The threshold for determining restricted content or inappropriate phrases may be based on one or more factors, which may include, for example, the frequency of word use in the communication (restricted or unrestricted), the age, location, culture or other demographic characteristics or gender of the relevant sender or recipient account. The characteristics of the sender user account and one or more recipient user accounts (e.g., age, parental control settings, etc.) can be used to determine whether certain parts of the text are restricted. For example, some embodiments may include a list of restricted phrases, words, idioms, etc. An unrestricted list of near-sounding words may also be used (e.g., "duck" may be an unrestricted message in a shooting game, or as a guide to a playing partner in a boxing game, but may be misinterpreted due to the restricted content of curse words). In some embodiments, the speech-to-text engine may be trained to configure text specific to a particular game (e.g., more biased towards recognizing in-game command / configuration text such as "duck," "shoot," "hide," etc., with some errors when detecting words such as "puck," "yell," "wide"). Other considerations for determining restricted text may include online privacy protection (especially for minors) based on industry best practices and / or government regulations.
[0062] In addition, identifying one or more restricted portions of the text may include identifying relevant portions of the text that contain personally identifiable information when the sender user account is associated with a user age threshold (e.g., less than 13 years old). In some embodiments, identifying one or more restricted portions of the text may include identifying one or more portions of the text that correspond to personally identifiable information when the sender user account is associated with a user age threshold (e.g., 13 years old or younger), and the recipient user account does not include an indication that one or more other users associated with the recipient user account are confirmed acquaintances of the user associated with the sender user account. Confirmed acquaintances may include users who have been confirmed as known acquaintances of the sender user (e.g., the confirmed acquaintance is able to provide authentication information indicating that the confirmed acquaintance knows the sender user, such as the sender user's email address, the sender user's phone number, etc.).
[0063] In some embodiments, a third-party service may be used to filter text based on various factors (e.g., regular expressions and age-restricted dictionaries). The third-party service may be authenticated by a user online safety authentication provider (e.g., KidSafe, etc.). Each phrase sent in a communication may have a risk level associated with the corresponding phrase. The risk rating may be used to determine whether the corresponding phrase is filtered. The risk level may reflect personally identifiable information as well as other age-inappropriate content (e.g., swear words, sexual terms, etc.). Some embodiments may include an intelligent filter that will enhance other methods, such as regular expressions and dictionaries, based on machine learning.
[0064] A mapping of the restricted portion of text to the voice message may be maintained and include a reference associating the restricted portion with the audio data of the voice message (eg, data associating the audio portion with a specific time or data location of the audio file).
[0065] At box 208, the portion of the first voice message corresponding to one or more restricted portions of the text is filtered to obtain a filtered voice message. The filtering operation may include removing or deleting the restricted portion. In some embodiments, personally identifiable information is not stored. In some embodiments, personally identifiable information that may be stored is deleted according to the user's requirements corresponding to such information. The filtering operation may also include replacing the restricted portion with a similar (or dissimilar) replacement portion and making the portion unrestricted. For example, if a portion of the text contains a detected curse word and is marked as a restricted portion, the portion may be replaced with a word with a similar meaning but not an actual curse word. In another example, if an address portion is determined to contain an address (e.g., "I live at 123 Main Street"), the system may replace the address with an unrestricted equivalent (e.g., "I live on Earth"). In some embodiments, restrictive terms or phrases may be selectively placed with non-restrictive terms or phrases (e.g., by a 1-to-1 mapping of a specific restrictive term and its replacement). Next, continue to 210.
[0066] At block 210, the filtered voice message is modified to obtain a modified voice message. The audio data corresponding to the filtered voice message may be processed to modify the sound of the audio (e.g., to change the pitch, tone, rhythm, and / or sound quality of the audio) to obtain a modified voice message. Audio signal processing techniques may be used to modify the voice message. In some embodiments, the modification may be performed by generating an audio message from the filtered voice message using computer synthesized speech.
[0067] Modifying the filtered voice message may include modifying the filtered voice message according to a voice chat information surface, the voice chat information surface including a voice type chat information surface for modifying the voice of the filtered voice message to have parameters associated with voice features. For example, if the surface is a pirate character surface (or "skin"), then the voice features may include voice features that are typically associated with pirates. In some embodiments, a voice feature library and corresponding voice synthesis code may be provided, for example, text may be presented as various voices such as pirate, cute, doll, robbery, etc. In some embodiments, filtering the voice message includes applying effects on top of an existing voice audio portion (e.g., changing the pitch, adding more reverb, etc.).
[0068] In some embodiments, the modification operation may include generating a modified voice message using computer synthesized speech. In some embodiments, the modification operation may include using a voice filtering process to change the sound of the first voice message so as to hide the recognizable sound of the voice of the user associated with the sender user account. The modification operation may include pitch shifting and adding one or more of reverb, echo, distortion, chorus, equalizer, amplification, and / or flanger.
[0069] In some embodiments, if the sender user account is associated with a first user age threshold (e.g., over 18 years old, etc.), modifying the filtered voice message includes retaining the original voice sound of the first voice message; if the sender user account is associated with a second user age threshold (e.g., 13 years old), retaining the original voice sound of the filtered voice message. The recipient user account includes an indication that one or more users associated with the recipient user account are confirmed acquaintances of the user associated with the sender user account, or an authorization indication (e.g., parental authorization) associated with the sender user account is received. Next, continue to 212.
[0070] At block 212, the modified voice message is provided to a device associated with the recipient user account. For example, the modified voice message is played on a speaker or headset of a device being used by a user associated with the recipient user account.
[0071] For purposes of voice messaging (or other purposes), the recipient user account may include a status indication of one of a plurality of states, including: an unknown recipient, a known recipient of a user associated with the sender user account within the online gaming platform, or a known recipient of a user associated with the sender user account outside the online gaming platform (e.g., based on prior input received from the sender user and stored in the online gaming platform). The operations of identifying, filtering, and selectively modifying are based, at least in part, on the status of the recipient user account.
[0072] In some embodiments, the decision to modify the voice message may be based on an age associated with the sender user account and an age associated with the recipient user account or a parental authorization received by the sender user account.
[0073] In some embodiments, whether to enable voice chat between the sender user account and the receiver user account is determined based on the sender user account or the receiver user account, and if it is determined to enable voice chat, identification, filtering, modification and provision operations are performed.
[0074] Figure 3 A schematic diagram showing the user interfaces of the sender and the receiver and the corresponding client devices. In particular Figure 3 Shown are a sender user interface 302 displayed by a sender client device 110 coupled to an online gaming platform 102 via a network 122 and a recipient user interface 304 displayed by a recipient client device 124 .
[0075] Elements 306 and 308 (e.g., speech bubbles) with restricted and unrestricted text are displayed within user interfaces 302 and 304, respectively. For example, speech bubble 306 includes restricted text (indicated by asterisks) that has been replaced with unrestricted text (the word "Earth"). Speech bubble 308 displays the unrestricted text. The restricted and unrestricted text is displayed in Figure 3 For illustrative purposes only, the text may also be played as an audio signal (e.g., through headphones or speakers). Also shown is an element 310 for selecting a voice filter (e.g., a pirated voice filter) to be used for voice communications of the corresponding user. The user may manually select the voice communication filter to be used, or the voice communication filter may be automatically selected and applied as part of an avatar appearance package (or skin). The user interface may also include a display of parameters, such as age 312, which may be used in the voice communication filtering determinations discussed herein. In some embodiments, for inappropriate content (e.g., profanity, personally identifiable information, etc.), the speaking user may be made aware that their message is being filtered via a visual indication (e.g., a system message in the UI). In another example, for a user who selects a voice filter as part of an avatar skin, the system may display a separate indication to indicate that the user is speaking using a funny voice filter.
[0076] Figure 4 is a block diagram of an exemplary computing device that can be used to implement one or more features of the present application. In one example, device 400 can be used to implement a computer device (e.g., Figure 1102, 110 and / or 124) and perform appropriate method embodiments described in this application. Computing device 400 can be any suitable computer system, server or other electronic or hardware device. For example, computing device 400 can be a mainframe computer, a desktop computer, a workstation, a portable computer or an electronic device (a portable device, a mobile device, a mobile phone, a smart phone, a tablet computer, a television, a television set-top box, a personal digital assistant (PDA), a media player, a gaming device, a wearable device, etc.). In some embodiments, device 400 includes a processor 402, a memory 404 and an input / output (I / O) interface 406.
[0077] Processor 402 may be one or more processors and / or processing circuits to execute program code and control the basic operations of device 400. "Processor" includes any suitable hardware and / or software system, mechanism or component that processes data, signals or other information. The processor may include a system having a general-purpose central processing unit (CPU), multiple processing units, dedicated circuits or other systems for implementing functions. Processing need not be limited to a specific geographic location or have time constraints. For example, a processor may perform its functions in "real time", "offline", "batch mode", etc. Parts of processing may be performed by different (or the same) processing systems at different times and in different locations. A computer may be any processor that communicates with a memory.
[0078] Memory 404 is typically provided in the device 400 for access by the processor 402 and may be any suitable processor-readable storage medium, such as random access memory (RAM), read-only memory (ROM), electrically erasable read-only memory (EEPROM), flash memory, etc., suitable for storing instructions executed by the processor and separate from and / or integrated with the processor 402. The memory 404 may store software executed by the processor 402 on the server device 400, including an operating system 608, one or more applications 410, such as a voice communication (or voice chat) application, and application data 412. In some embodiments, the application 410 may include instructions that enable the processor 402 to perform the functions described herein, such as, Figure 2 some or all of the methods.
[0079] For example, the application 410 may include a voice chat (or voice communication) application or module 412, which may provide voice communication within an online gaming platform (e.g., 102) as described herein. Any software in the memory 404 may alternatively be stored in any other suitable storage location or computer-readable medium. In addition, the memory 404 (and / or other connected storage devices) may store instructions and data used in the features described herein. The memory 404 and any other type of storage (disk, optical disk, tape, or other tangible medium) may be considered "storage" or "storage device".
[0080] I / O interface 406 may provide functionality that enables server device 400 to interface with other systems and devices. For example, network communication devices, storage devices (e.g., memory and / or data storage 108), and input / output devices may communicate via interface 406. In some embodiments, I / O interface may be connected to interface devices, including input devices (keyboards, pointing devices, touch screens, microphones, cameras, scanners, etc.) and / or output devices (display devices, speaker devices, printers, motors, etc.). Display device 414 is a device that may be used to display a graphical user interface (e.g., Figure 3 Display device 414 may be connected to device 400 via a local connection (e.g., a display bus) and / or via a network connection, and may be any suitable display device, some examples of which are described below.
[0081] For ease of explanation, Figure 4 A box is shown for each of processor 402, memory 404, I / O interface 406, and software blocks 408 and 410. These boxes may represent one or more processors or processing circuits, operating systems, memories, I / O interfaces, applications, and / or software modules. In other embodiments, device 400 may not have all of the components shown and / or may have other elements, including other types of elements to replace those shown here or in addition to the elements shown here. Although online gaming platform 102 is described as performing operations as described in some embodiments of the present application, any suitable component or combination of components of online gaming platform 102 or similar systems, or any suitable processor or such system associated with a processor, may perform the described operations.
[0082] User equipment can also be implemented and / or used with the features described herein. Exemplary user equipment can be a computer device, which includes some components similar to device 400, such as processor 402, memory 404 and I / O interface 406. Operating systems, software and applications suitable for client devices can be provided in memory and used by processors. The I / O interface of client devices can be connected to network communication equipment, and can also be connected to input and output devices, such as microphones for capturing sounds, cameras for capturing images or videos, audio speaker devices for outputting sounds, display devices for outputting images or videos, or other output devices. For example, display device 414 can be connected to (or included in) device 400 to display pre-processing and post-processing images as described in the present application, wherein such display device can include any suitable display device, such as LCD, LED or plasma display screen, CRT, television, monitor, touch screen, 3-D display screen, projector or other visual display devices. Some embodiments can provide an audio output device, such as voice output or the synthesis of text.
[0083] One or more methods described in the present application (e.g., method 200) may be implemented by computer program instructions or codes, which may be executed on a computer. For example, the code may be implemented by one or more digital processors (e.g., microprocessors or other processing circuits) and may be stored on a computer program product including a non-transitory computer-readable medium (e.g., storage medium), such as a magnetic, optical, electromagnetic or semiconductor storage medium, including semiconductor or solid-state memory, tape, removable computer floppy disk, random access memory (RAM), read-only memory (ROM), flash memory, hard disk, optical disk, solid-state storage drive, etc. The program instructions may also be contained in an electronic signal and provided as an electronic signal, such as in the form of software as a service (SaaS) delivered from a server (e.g., a distributed system and / or a cloud computing system). Alternatively, one or more methods may be implemented in hardware (logic gates, etc.) or in a combination of hardware and software. Example hardware may be a programmable processor (e.g., a field programmable gate array (FPGA), a complex programmable logic device), a general-purpose processor, a graphics processor, an application-specific integrated circuit (ASIC), etc. One or more methods may be performed as part or component of an application running on a system, or as an application or software running in conjunction with other applications and an operating system.
[0084] One or more of the methods described herein may be run in a standalone program that can run on any type of computing device, a program that runs on a web browser, a mobile application (“app”) that runs on a mobile computing device (e.g., a cell phone, a smartphone, a tablet, a wearable device (a watch, an armband, jewelry, headwear, goggles, glasses, etc.), a laptop, etc.). In one example, a client / server architecture may be used, for example, a mobile computing device (as a client device) sends user input data to a server device and receives final output data from the server for output (e.g., for display). In another example, all computations may be performed within a mobile application (and / or other applications) on the mobile computing device. In another example, computations may be split between the mobile computing device and one or more server devices.
[0085] Although described with respect to specific embodiments, these specific embodiments are illustrative only and not restrictive. The concepts illustrated in the examples can be applied to other examples and implementations.
[0086] It should be noted that, as known to those skilled in the art, the functional blocks, operations, features, methods, devices and systems described in this application can be integrated or divided into different combinations of systems, devices and functional blocks. Any suitable programming language and programming techniques can be used to implement the routines of specific embodiments. Different programming techniques can be adopted, for example, process-oriented or object-oriented. The routines can be performed on a single processing device or multiple processors. Although steps, operations or calculations can be presented in a specific order, the order can be changed in different specific embodiments. In some example embodiments, multiple steps or operations shown as being performed sequentially in this application can be performed simultaneously.
Claims
1. A method, characterized in that The method comprises: receiving a first voice message associated with a sender user account in an online gaming platform and a recipient user account in the online gaming platform; programmatically transcribing the first voice message into text; identifying one or more restricted portions of the text based on a threshold for determining restricted content, wherein the threshold is based on a characteristic of at least one of the sender user account or the recipient user account, the characteristic comprising one or more of age, gender, or location; filtering the first voice message corresponding to the one or more restricted portions of the text, thereby obtaining a filtered voice message; selectively modifying the filtered voice message to obtain a modified voice message; and providing the modified voice message to a device associated with the recipient user account; The recipient user account includes the following statuses: unknown recipient, a known recipient of a user associated with the sender user account within the online gaming platform, or a known recipient of a user associated with the sender user account outside the online gaming platform, wherein the operations of identification, filtering and selective modification are based at least in part on the status of the recipient user account.
2. The method according to claim 1, characterized in that Identifying one or more restricted portions of the text includes identifying a portion of the text that includes one or more inappropriate phrases or personally identifiable information.
3. The method according to claim 1, characterized in that Identifying one or more restricted portions of the text includes: when the sender user account is associated with a user age threshold and the recipient user account is not a confirmed acquaintance account of the sender user account within the online gaming platform, identifying one or more portions of the text corresponding to personally identifiable information.
4. The method according to claim 1, characterized in that: Selectively modifying the first voice message includes: modifying the first voice message according to a voice chat information surface, the voice chat information surface including parameters, which are used to modify the voice sound of the first voice message to have voice characteristics associated with the type of the voice chat information surface.
5. The method according to claim 1, characterized in that Selectively modifying the first voice message includes: if the sender user account is associated with a first user age threshold, retaining the original sound of the first voice message.
6. The method according to claim 5, characterized in that Selectively modifying the first voice message includes retaining the original sound of the first voice message if the sender user account is associated with a second user age threshold, the recipient user account includes an indication that one or more other users associated with the recipient user account are confirmed acquaintances of the user associated with the sender user account, or an authorization indication associated with the sender user account is received.
7. The method according to claim 1, characterized in that The modification operation is based on the age associated with the sender user account and the age associated with the recipient user account or a parental authorization received by the sender user account.
8. The method according to claim 1, characterized in that The modification operation is based on the age associated with the sender user account and the parental authorization received by the sender user account.
9. The method according to claim 1, characterized in that: The modification operation includes replacing the original voice audio in the modified voice message with computer synthesized voice.
10. The method according to claim 1, characterized in that The modifying operation includes applying an audio filter to change the pitch of the first voice message to mask the recognizable sound of the voice of a user associated with the sender user account.
11. The method according to claim 1, characterized in that: The method also includes: determining whether to start a voice chat between the sender user account and the receiver user account according to the sender user account or the receiver user account, and performing identification, filtering, modification and provision operations if it is determined to start the voice chat.
12. A system, characterized in that: The system comprises: Memory; and A processing device, coupled to the memory, wherein the processing device is configured to: receiving a first voice message associated with a sender user account in an online gaming platform and a recipient user account in the online gaming platform; programmatically transcribing the first voice message into text; identifying one or more restricted portions of the text based on a threshold for determining restricted content, the threshold being based on a characteristic of at least one of the sender user account or the recipient user account, the characteristic comprising one or more of age, gender, or location; filtering the first voice message corresponding to the one or more restricted portions of the text, thereby obtaining a filtered voice message; selectively modifying the filtered voice message to obtain a modified voice message; and providing the modified voice message to a device associated with the recipient user account; The recipient user account includes the following statuses: unknown recipient, a known recipient of a user associated with the sender user account within the online gaming platform, or a known recipient of a user associated with the sender user account outside the online gaming platform, wherein the operations of identification, filtering and selective modification are based at least in part on the status of the recipient user account, wherein the operations of identification, filtering and selective modification are based at least in part on the status of the recipient user account.
13. The system according to claim 12, characterized in that Identifying one or more restricted portions of the text includes identifying a portion of the text that includes one or more inappropriate phrases or personally identifiable information.
14. The system according to claim 12, characterized in that Identifying one or more restricted portions of the text includes: when the sender user account is associated with a user age threshold and the recipient user account is not a confirmed acquaintance account of the sender user account within the online gaming platform, identifying one or more portions of the text corresponding to personally identifiable information.
15. The system according to claim 12, characterized in that Selectively modifying the first voice message includes: modifying the first voice message according to a voice chat information surface, the voice chat information surface including parameters, which are used to modify the voice sound of the first voice message to have voice characteristics associated with the type of the voice chat information surface.
16. A non-transitory computer readable medium comprising instructions which, in response to execution by a processing device, cause the processing device to perform the following operations: receiving a first voice message associated with a sender user account in an online gaming platform and a recipient user account in the online gaming platform; programmatically transcribing the first voice message into text; identifying one or more restricted portions of the text based on a threshold for determining restricted content, the threshold being based on a characteristic of at least one of the sender user account or the recipient user account, the characteristic comprising one or more of age, gender, or location; filtering the first voice message corresponding to the one or more restricted portions of the text, thereby obtaining a filtered voice message; selectively modifying the filtered voice message to obtain a modified voice message; and providing the modified voice message to a device associated with the recipient user account; The recipient user account includes the following statuses: unknown recipient, a known recipient of a user associated with the sender user account within the online gaming platform, or a known recipient of a user associated with the sender user account outside the online gaming platform, wherein the operations of identification, filtering and selective modification are based at least in part on the status of the recipient user account, wherein the operations of identification, filtering and selective modification are based at least in part on the status of the recipient user account.
17. The non-transitory computer readable medium of claim 16, wherein: Selectively modifying the first voice message includes: if the sender user account is associated with a first user age threshold, retaining the original sound of the first voice message.
18. The non-transitory computer readable medium of claim 17, wherein: Selectively modifying the first voice message includes retaining the original sound of the first voice message if the sender user account is associated with a second user age threshold, the recipient user account includes an indication that one or more other users associated with the recipient user account are confirmed acquaintances of the user associated with the sender user account, or an authorization indication associated with the sender user account is received.
Citation Information
Patent Citations
Apparatus and method for providing game
KR1020180071893A
Multi-sensory emoticons in a communication system
US20060015560A1
Systems, methods, and software applications for providing an identity and age-appropriate verification registry
US20110072039A1
Real-time online audio filtering
US20140358520A1
Session speech-to-text conversion
US20180161683A1
