Input analysis and content change

Abstract

In some aspects, a user equipment (UE) may display content via a display associated with the UE. The UE may receive input via a sensor associated with the UE while displaying content. The UE may alter the content based at least in part on the input, wherein altering the content includes introducing a role into the content or altering an environment or difficulty of the content. Numerous other aspects are described.

Description

[0001] Cross-reference to related applications

[0002] This patent application claims U.S. Patent Application No. 18 / 188,117, filed March 22, 2023, entitled “INPUT ANALYSIS AND CONTENTALTERATION” and assigned to the assignee of this application. The disclosure of the earlier application is considered part of this patent application and is incorporated herein by reference. Technical Field

[0003] All aspects of this disclosure relate to content interaction in general, and include, for example, input analysis and content modification. Background Technology

[0004] Wireless communication systems are widely deployed to provide a variety of telecommunications services, such as telephone, video, data, messaging, and broadcasting. Wireless communication systems may employ multiple access technologies capable of supporting communication with multiple users by sharing available system resources (e.g., bandwidth, transmission power, etc.). A wireless network may include one or more network nodes that support communication, for example, between the network nodes and user equipment (UE). The UE may be configured to display content to its user, such as extended reality content, virtual reality content, augmented reality content, social media content, and / or game content, etc. In one example, the UE may be a head-mounted device or other device capable of displaying content to the user. This may cause the user of the UE to become disconnected from reality, for example, because the user may only be able to see or hear what is happening in the virtual environment. Summary of the Invention

[0005] Some aspects described herein relate to a method of wireless communication performed by a user equipment (UE). The method may include: displaying content via a display associated with the UE. The method may include: receiving input via a sensor associated with the UE while the content is being displayed. The method may include: modifying the content based at least in part on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0006] Some aspects described herein relate to an apparatus for wireless communication at a UE. The apparatus may include a memory and one or more processors coupled to the memory. The one or more processors may be configured to display content via a display associated with the UE. The one or more processors may be configured to receive input via a sensor associated with the UE while the content is displayed. The one or more processors may be configured to modify the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0007] Some aspects described herein relate to a non-transitory computer-readable medium storing a set of instructions for wireless communication by a UE. When executed by one or more processors of the UE, the set of instructions enables the UE to display content via a display associated with the UE. When executed by one or more processors of the UE, the set of instructions enables the UE to receive input via a sensor associated with the UE while displaying the content. When executed by one or more processors of the UE, the set of instructions enables the UE to modify the content, at least in part, based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0008] Some aspects described herein relate to an apparatus for wireless communication. The apparatus may include components for displaying content via a display associated with the apparatus. The apparatus may include components for receiving input via a sensor associated with the apparatus while the content is displayed. The apparatus may include components for modifying the content, at least in part, based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0009] The aspects generally include, as described substantially with reference to the accompanying drawings and description and illustrated as shown in the drawings and description, methods, apparatuses, systems, computer program products, non-transitory computer-readable media, user equipment, user gear, wireless communication equipment and / or processing systems.

[0010] The features and technical advantages of the examples according to this disclosure have been summarized rather extensively above in order to provide a better understanding of the detailed description that follows. Additional features and advantages will be described below. The disclosed concepts and specific examples can be readily used as the basis for modifying or designing other structures for achieving the same purpose of this disclosure. Such equivalent constructions do not depart from the scope of the appended claims. The characteristics (both in their organization and operation) of the concepts disclosed herein, as well as their associated advantages, will be better understood in conjunction with the accompanying drawings, based on the following description. Each figure in the accompanying drawings is provided for illustrative and descriptive purposes and not as a definition of limitation of the claims. Attached Figure Description

[0011] To gain a full understanding of the foregoing features of this disclosure, a more specific description of the invention, briefly outlined above, can be obtained by referring to various aspects, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings illustrate only certain typical aspects of this disclosure and are therefore not to be considered as limiting its scope, as the description may acknowledge other equally valid aspects. The same reference numerals in different drawings may identify the same or similar elements.

[0012] Figure 1 This is a diagram illustrating an example environment in which the systems and / or methods described herein can be implemented.

[0013] Figure 2 This is a diagram illustrating example components of a device according to the present disclosure.

[0014] Figure 3 This is a diagram illustrating an example of an interruption based on the content of this disclosure.

[0015] Figure 4 This is a diagram illustrating examples of input analysis and content changes based on this disclosure.

[0016] Figure 5 This is a diagram illustrating an example procedure performed by a UE according to this disclosure, for example. Detailed Implementation

[0017] Various aspects of this disclosure are described more fully below with reference to the accompanying drawings. However, this disclosure can be embodied in many different forms and should not be construed as limited to any particular structure or function presented throughout this disclosure. Rather, these aspects are provided so that this disclosure will be comprehensive and complete, and will fully convey the scope of this disclosure to those skilled in the art. Those skilled in the art will appreciate that the scope of this disclosure is intended to cover any aspect of the disclosure herein, whether implemented independently or in combination with any other aspect of this disclosure. For example, any number of aspects set forth herein may be used to implement an apparatus or practice. Furthermore, the scope of this disclosure is intended to cover such apparatuses or methods implemented using structures, functions, or structures and functions other than or different from the various aspects of the disclosure set forth herein. It should be understood that any aspect of the disclosure herein may be embodied by one or more elements of the claims.

[0018] The user equipment (UE) may be a head-mounted device, cellular phone, tablet, and / or gaming device, etc., or may be included in, or incorporated into, a head-mounted device, cellular phone, tablet, and / or gaming device, etc. The UE may be configured to display content via a display associated with the UE. The display may be included in the UE or may be otherwise connected to the UE. In some cases, audio associated with the content may be played by an audio component associated with the UE. The audio component (e.g., headphones) may be included in the UE or may be otherwise connected to the UE. The content may be extended reality (XR) content, virtual reality (VR) content, augmented reality (AR) content, video content, gaming content, social media content, and / or communication content that disconnects the user of the UE from their surroundings. In some cases, input may be received from an input source. This input may be received via a sensor associated with the UE. This input may be received via the sensor while the user of the UE is viewing or otherwise interacting with the content. In one example, the content could be video game content being displayed to the user by a VR headset. This input could be received via a microphone associated with the VR headset, and the source of this input could be the user's parent instructing the user to "stop playing the video game because dinner is ready." This input could cause content interruption. For example, the input could be played back as audio to the user via a speaker associated with the VR headset (such as headphones with active noise cancellation). This audio might overshadow important audio associated with the video game. Additionally or alternatively, the user might be at a point in the video game where they cannot pause or save, and the user might need to abandon the video game before its natural end. Interrupting the content and causing the user to abandon it earlier than intended could negatively impact the user experience.

[0019] This document describes techniques and apparatus for input analysis and content modification. A UE may display content via a display associated with the UE. The UE may receive input via a sensor associated with the UE. This input may be received while the UE is displaying the content. The UE may modify the content based at least in part on the received input. In some aspects, modifying the content may include changing the character associated with the content. Changing the character associated with the content may include, for example, introducing a new character (such as a non-playable character or a character controlled by the central processing unit) into the content. In some aspects, modifying the content may include changing the environment associated with the content. Changing the environment associated with the content may include, for example, introducing obstacles into the content. In some aspects, modifying the content may include increasing the difficulty of the content. This allows the content to end or complete faster without causing significant interruption. For example, introducing a character into the content, introducing obstacles into the content, or increasing the difficulty of the content allows the content to end faster without explicitly interrupting the content and without negatively impacting the user experience. Additional details are described herein.

[0020] Figure 1 This is a diagram illustrating an example environment 100 in which the systems and / or methods described herein can be implemented. For example... Figure 1 As shown, environment 100 may include wireless communication device 110, UE 120, and network node 130. Wireless communication device 110 and network node 130 can communicate. Additionally or alternatively, UE 120 and network node 130 can communicate. In some cases, UE 120 and wireless communication device 110 can communicate directly. In other cases, UE 120 and wireless communication device 110 can communicate via network node 130.

[0021] In some cases, wireless communication device 110 and UE 120 may be included in a single device. For example, UE 120 may be included in wireless communication device 110, or wireless communication device 110 may be included in UE 120. In other cases, UE 120 and wireless communication device 110 may be separate devices. For example, wireless communication device 110 may receive content from network node 130 and may send that content to UE 120 for display to the user of UE 120. In some cases, UE 120, or the device including UE 120 and wireless communication device 110, may be an XR device, such as a VR device or an AR device.

[0022] A network (such as a network including network node 130) may include one or more wired networks, one or more wireless networks, or a combination thereof. A wireless network may be or may include elements of a 3G network, a 4G network, a 5G (New Radio (NR)) network, a Long Term Evolution (LTE) network, and / or a 6G network, etc. In some aspects, network node 130 may be a base station (Node B, gNB, and / or 5G Node B (NB), etc.), a relay device, a network controller, an access point, a Transmit / Receive Point (TRP), a device, an apparatus, a computing system, one or more components of any of these devices, and / or another processing entity configured to perform one or more aspects of the techniques described herein. For example, network node 130 may be one or more components of an aggregated base station and / or a decomposed base station.

[0023] UE 120 may be a stationary or mobile device. In some cases, UE 120 may be a display device, or may include a display device such as a virtual reality headset or a screen associated with a cellular phone, tablet, or gaming device. UE 120 may be, may include, or may be included in the following: cellular phone (e.g., smartphone), personal digital assistant (PDA), wireless modem, wireless communication device, handheld device, laptop computer, cordless phone, wireless local loop (WLL) station, tablet computer, camera, gaming device, netbook, smartbook, ultrabook, medical device or equipment, biometric sensor / device, wearable device (smartwatch, smart clothing, smart glasses, smart wristband, smart jewelry (e.g., smart ring, smart bracelet)), entertainment device (e.g., music or video device, or satellite radio), vehicle component or sensor, smart meter / sensor, industrial manufacturing equipment, GPS device, radar device, or any other suitable device configured to communicate via wireless or wired media.

[0024] Wireless communication device 110 can be a fixed or mobile device. In some cases, wireless communication device 110 can communicate with network node 130, for example, to receive content from network node 130. Additionally or alternatively, wireless communication device 110 can communicate with UE 120, for example, to send content to UE 120. In some cases, as described above, UE 120 and wireless communication device 110 can be a single device or can be included in a single device. Wireless communication device 110 can be, may include, or can be included in the following: cellular phone (e.g., smartphone), personal digital assistant (PDA), wireless modem, handheld device, laptop computer, cordless phone, wireless local loop (WLL) station, tablet computer, camera, gaming device, netbook, smartbook, ultrabook, medical device or equipment, biometric sensor / device, entertainment device (e.g., music or video device, or satellite radio), vehicle component or sensor, smart meter / sensor, industrial manufacturing equipment, GPS device, or any other suitable device configured to communicate via wireless or wired media.

[0025] Some wireless communication devices can be considered as Machine-Type Communication (MTC) or Evolved or Enhanced Machine-Type Communication (eMTC) UEs. For example, MTC and eMTC wireless communication devices include robots, drones, remote devices, sensors, meters, monitors, location tags, etc., capable of communicating with a base station, another device (e.g., a remote device), or some other entity. Wireless nodes can provide connectivity to or from a network, such as a wide area network (e.g., the Internet or cellular networks), via wired or wireless communication links. Some wireless communication devices can be considered as Internet of Things (IoT) devices and / or can be implemented as NB-IoT (Narrowband Internet of Things) devices. Some wireless communication devices can be considered as Customer Premises Equipment (CPE). Wireless communication device 110 can be included in a housing containing components of wireless communication device 110, such as processor components, memory components, etc. In some aspects, the processor components and memory components can be coupled together. For example, the processor components (e.g., one or more processors) and memory components (e.g., memory) can be operatively coupled, communicatively coupled, electronically coupled, electrically coupled, etc.

[0026] Figure 1 The number and arrangement of the devices and components shown are provided as one or more examples. In practice, they may exist in... Figure 1 Those shown are compared to additional equipment and / or components, fewer equipment and / or components, different equipment and / or components, or equipment and / or components arranged in a different manner. Furthermore, Figure 1The two or more devices and / or components shown can be implemented within a single device, or Figure 1 The single device and / or component shown may be implemented as multiple distributed devices. Additionally or alternatively, a group of devices and / or components of environment 100 (e.g., one or more devices and / or components) may perform one or more functions described as being performed by another group of devices and / or components of environment 100.

[0027] Figure 2 This is a diagram illustrating example components of device 200 according to the present disclosure. Device 200 may correspond to, for example, UE 120, wireless communication device 110, or a device including UE 120 and wireless communication device 110. In some aspects, UE 120, wireless communication device 110, or a device including UE 120 and wireless communication device 110 may include one or more devices 200 and / or one or more components of device 200. Figure 2 As shown, device 200 may include bus 205, processor 210, memory 215, input component 220, output component 225, communication component 230, internal sensor 235 and / or external sensor 240.

[0028] Bus 205 may include one or more components enabling wired and / or wireless communication between components of device 200. Bus 205 may connect components such as via operative coupling, communicative coupling, electronic coupling, and / or electrical coupling. Figure 2 Two or more components are coupled together. For example, bus 205 may include electrical connections (e.g., wires, traces, and / or leads) and / or wireless buses. Processor 210 may include a central processing unit, graphics processing unit, microprocessor, controller, microcontroller, digital signal processor, field-programmable gate array, application-specific integrated circuit, and / or another type of processing component. Processor 210 may be implemented in hardware, firmware, or a combination of hardware and software. In some aspects, processor 210 may include one or more processors capable of being programmed to perform one or more operations or processes described elsewhere herein.

[0029] Memory 215 may include volatile memory and / or non-volatile memory. For example, memory 215 may include random access memory (RAM), read-only memory (ROM), hard disk drive, and / or another type of memory (e.g., flash memory, magnetic memory, and / or optical memory). Memory 215 may include internal memory (e.g., RAM, ROM, or hard disk drive) and / or removable memory (e.g., removable via a universal serial bus connection). Memory 215 may be a non-transitory computer-readable medium. Memory 215 may store information relating to the operation of device 200, one or more instructions, and / or software (e.g., one or more software applications). In some aspects, memory 215 may include one or more memories, such as those coupled (e.g., communicatively coupled) to one or more processors (e.g., processor 210), via bus 205. The communicative coupling between processor 210 and memory 215 enables processor 210 to read and / or process information stored in memory 215 and / or store information in memory 215.

[0030] Input component 220 enables device 200 to receive input from a user of device 200. For example, input component 220 may include a touchscreen, keyboard, keypad, mouse, buttons, microphone, and / or switches, etc. Output component 225 enables device 200 to provide output, such as via a display, speaker, and / or light-emitting diode. Communication component 230 enables device 200 to communicate with other devices via wired and / or wireless connections. For example, communication component 230 may include a receiver, transmitter, transceiver, modem, network interface card, and / or antenna.

[0031] Internal sensor 235 may be a sensor included in device 200. For example, internal sensor 235 may be located in or on device 200. Internal sensor 235 may be an audio sensor (such as a microphone), a temperature sensor, a battery sensor, a time sensor, and / or a data sensor, etc. Internal sensor 235 may be configured to receive or detect input not associated with a user of device 200. For example, internal sensor 235 may be configured to receive audio input, such as human voice, which is not associated with a user of device 200. Additionally or alternatively, internal sensor 235 may be configured to detect the temperature of device 200, the battery level of device 200, or the time indicated by device 200, etc.

[0032] External sensor 240 may be a sensor not included in device 200. For example, external sensor 240 may be located in another device or connected to another device 200. The other device including external sensor 240 may be connected to device 200 using a wired or wireless connection. External sensor 240 may be, for example, an audio sensor or a data sensor, etc. In one example, external sensor 240 may be associated with a head-mounted device connected to device 200.

[0033] Device 200 may perform one or more operations or procedures described herein. For example, a non-transitory computer-readable medium (e.g., memory 215) may store a set of instructions (e.g., one or more instructions or code) for execution by processor 210. Processor 210 may execute the set of instructions to perform one or more operations or procedures described herein. In some aspects, execution of the instruction set by one or more processors 210 causes one or more processors 210 and / or device 200 to perform one or more operations or procedures described herein. In some aspects, hardwired circuitry may be used in place of or in combination with instructions to perform one or more operations or procedures described herein. Additionally or alternatively, processor 210 may be configured to perform one or more operations or procedures described herein. Thus, the aspects described herein are not limited to any particular combination of hardware circuitry and software.

[0034] In some aspects, device 200 may include: components for displaying content via a display associated with the UE; components for receiving input via a sensor associated with the UE while displaying the content; and / or components for modifying the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content. In some aspects, the components of device 200 for performing the processes and / or operations described herein may include combinations of... Figure 2 One or more components of the described device 200, such as bus 205, processor 210, memory 215, input component 220, output component 225, communication component 230, internal sensor 235 and / or external sensor 240.

[0035] Figure 2 The number and arrangement of components shown are provided as an example. Device 200 may include components with... Figure 2 The components shown are compared to additional components, fewer components, different components, or components arranged in a different manner. Additionally or alternatively, the set of components of device 200 (e.g., one or more components) can perform one or more functions described as being performed by another set of components of device 200.

[0036] Figure 3This is a diagram illustrating example 300 of an interruption according to the content of this disclosure.

[0037] Content may be displayed by UE 120. UE 120 may be a headset, cellular phone, tablet, and / or gaming device, or may be included within a headset, cellular phone, tablet, and / or gaming device. In some cases, the content may be displayed via a display associated with UE 120. The display may be included in UE 120 or may be otherwise connected to UE 120. In some cases, audio associated with the content may be played by an audio component of UE 120. The audio component may be included in UE 120 or may be otherwise connected to UE 120. For example, the audio component may include headphones. The content may be XR content, VR content, AR content, video content, gaming content, social media content, and / or communication content. The content may disconnect the user of UE 120 from their surroundings. In some cases, input 305 may be received from input source 310. The input can be received via a sensor associated with UE 120 (such as internal sensor 235 or external sensor 240). Input 305 can be received via this sensor while the user of UE 120 is viewing or otherwise interacting with content. In one example, the content could be video game content being displayed to the user by a VR headset. Input 305 can be received via a microphone associated with the VR headset, and the input source 310 could be the user's parent. Input 305 can cause a content interruption 315 at UE 120. For example, input 305 can be played back as audio to the user via a speaker associated with the VR headset (such as headphones with active noise cancellation). This audio may overwrite important audio associated with the video game. Additionally or alternatively, the user may be at a point in the video game where it cannot be paused or saved, and the user may need to abandon the video game before its natural end. Interrupting the content and causing the user to abandon it earlier than expected can negatively impact the user experience.

[0038] This document describes techniques and apparatus for input analysis and content modification. A UE may display content via a display associated with the UE. The UE may receive input via a sensor associated with the UE. This input may be received while the UE is displaying the content. The UE may modify the content based at least in part on the received input. In some aspects, modifying the content may include changing the character associated with the content. Changing the character associated with the content may include, for example, introducing a new character (such as a non-playable character or a character controlled by the central processing unit) into the content. In some aspects, modifying the content may include changing the environment associated with the content. Changing the environment associated with the content may include, for example, introducing obstacles into the content. In some aspects, modifying the content may include increasing the difficulty of the content. This allows the content to end or complete faster without causing significant interruption. For example, introducing a character into the content, introducing obstacles into the content, or increasing the difficulty of the content allows the content to end faster without explicitly interrupting the content and without negatively impacting the user experience. Additional details are described herein.

[0039] As indicated above, Figure 3 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 3 The examples described are different.

[0040] Figure 4 This is an illustration of example 400 of input analysis and content modification according to this disclosure.

[0041] UE 120 may display content to its user. This content may be XR content, VR content, AR content, video content, game content, social media content, and / or communication content, etc. UE 120 may display this content to its user via a display associated with UE 120. Additionally, UE 120 may play audio associated with the content to its user via an audio component associated with UE 120. This audio component may be, for example, headphones including active noise cancellation features. UE 120 may receive input 405 from input source 410. UE 120 may receive input 405 via a sensor associated with UE 120 (such as internal sensor 235 or external sensor 240). This sensor may be, for example, an audio sensor, a temperature sensor, a battery sensor, a time sensor, and / or a data sensor, etc. In some aspects, input 405 may include audio input, and the sensor may be a microphone. Input 405 may be an input not associated with a user of UE 120. In one example, input 405 could be another person's voice, such as the voice of the user of UE 120's parents. In another example, input 405 could include audio associated with another device, such as an audio device wirelessly connected to UE 120. In some aspects, input 405 could include a temperature input, and the sensor could be a temperature sensor. For example, the temperature sensor could detect that the temperature of UE 120 is approaching or has exceeded a temperature threshold. In some aspects, input 405 could be a battery input, and the sensor could be a battery sensor. For example, the battery sensor could detect that the battery level of UE 120 is approaching or has fallen below a low battery threshold. In some aspects, input 405 could be a time input, and the sensor could be a time sensor. For example, the time sensor could detect that the current time is approaching or has exceeded a time threshold. In some aspects, input 405 could be a data input, and the sensor could be a data sensor. For example, the data sensor could receive data unrelated to the data from another device, such as wireless communication device 110. As indicated by reference numeral 415 in the accompanying drawings, UE 120 may modify this content at least in part based on input 405 received from input source 410.

[0042] In some respects, changing the content may include changing the characters associated with the content. Changing the characters associated with the content may include, for example, introducing new characters (such as unplayable characters (NPCs) or central processing unit controlled characters (CPUCs)) into the content. In one example, UE 120 may be a VR headset configured to display video game content, receiving input 405 via a microphone associated with the VR headset while the VR headset is displaying the video game content, and the input source 410 may be the user's parent instructing the user to "stop playing the video game because dinner is ready." UE 120 may change the content, at least in part, based on the received input 405, by introducing an NPC into the video game. This NPC may be a difficult opponent character that causes the user to lose the video game more quickly.

[0043] In some aspects, changing the content may include altering the environment associated with it. In an example where UE 120 is a VR headset, UE 120 may detect that the temperature of the VR headset is approaching a temperature threshold. UE 120 may alter the environment of the content so that the video game ends before the VR headset reaches or exceeds the temperature threshold. In one example, the video game may be a baseball video game, and UE 120 may alter the environment associated with the content by changing the weather from sunny to rainy, thus causing a rain delay. When the temperature of the VR headset drops below the temperature threshold or another temperature threshold, the video game may resume, and the environment may be changed back to sunny. In another example, altering the environment associated with the content may include introducing obstacles into the environment. For example, the video game may be a motorcycle driving video game, and the environment may be altered so that the road surface becomes uneven and the motorcycle experiences a tire blowout.

[0044] In some respects, changing the content could include increasing its difficulty. For example, the video game could be a boxing video game that the user is playing at a medium difficulty level. Increasing the difficulty could include changing the boxing video game's difficulty from medium to hard. For example, the opponent character could be given greater strength or faster speed, causing the user to lose to the opponent character more quickly.

[0045] In some aspects, feature extraction component 420, artificial intelligence (AI) and / or machine learning (ML) (collectively, AI / ML) component 425, profile 430, and / or system-on-a-chip (SOC) component 435 may be used to determine changes to be applied to the content. Some or all of these components may be included in UE 120. For example, some or all of these features configured to be performed by these components may be performed by UE 120. Additionally or alternatively, some or all of these components may be included in another device (such as a cloud computing device). For example, some or all of these features configured to be performed by these components may be performed by a cloud computing device. In one example, feature extraction component 420, AI / ML component 425, and profile 430 may be included in UE 120, and SOC component 435 may be included in another device. Feature extraction component 420, AI / ML component 425, profile 430, and SOC component 435 are provided as example components. Other components and / or subsets of these components can be used to determine changes to be applied to the content.

[0046] Feature extraction component 420 can be configured to extract one or more features associated with input 405. Feature extraction component 420 can be configured to receive input, for example, from an audio sensor, a battery sensor, a temperature sensor, another sensor, and / or system input. System input may include, for example, time indicated by a clock associated with UE 120. Feature extraction component 420 can extract one or more features and can output these features to, for example, AI / ML component 425.

[0047] AI / ML component 425 can be configured to determine the context of the input, the source of the input, the emotion of the input, and / or the intensity of the input, etc. The context of the input may include, for example, information associated with other inputs preceding or following it. The source of the input may include information associated with source 410. For example, the source of the input may be a human voice, such as a parent or sibling associated with the user of UE120, or audio associated with a device in the same environment as UE120. The emotion of the input may include one or more emotions associated with the input. For example, the emotion may indicate whether the input is expressed as a command or a question. The intensity of the input may indicate whether the input requires immediate attention or delayed attention.

[0048] In some respects, the AI / ML component 425 can determine the priority of the input. The AI / ML component 425 can assign priority to the input based at least in part on the context of the input, the source of the input, the emotion of the input, and / or the intensity of the input, etc. For example, the AI / ML component 425 can assign high priority to parental voices, commands, or inputs that require immediate attention (such as a device reaching a critical temperature threshold), but can assign low priority to sibling voices, questions, or inputs that do not require immediate attention (such as a prompt indicating one hour of battery life remaining). This priority can be correlated with a timeline for changing the content. For example, high priority might indicate that the content will be changed within ten seconds, while low priority might indicate that the content will be changed within ten minutes.

[0049] In some respects, AI / ML component 425 may analyze the context of the input, the source of the input, the sentiment of the input, or the intensity of the input, and / or determine the priority of the input, at least in part, based on profile 430. Profile 430 enables AI / ML component 425 to analyze the input with increased accuracy. Profile 430 may include, for example, a user profile and a location profile. The user profile may include information associated with a user of UE 120. For example, the user profile may include data indicating that the user has two parents and one sister. The location profile may include information associated with one or more locations, such as one or more locations that the user frequently visits. For example, the location profile may indicate the location of the user's home or school (where commands will be executed more seriously) and the location of a playground that the user visits (where commands can be executed less seriously). In another example, the location profile may indicate whether the user is at an airport or at home. In this example, when a user is at an airport, a notification including flight information may be considered important input, but when a user is at home, a notification including flight information may be considered unimportant input (e.g., if the flight information is associated with a TV program the user is watching). AI / ML component 425 can output the analysis performed by AI / ML component 425 to, for example, SOC component 435.

[0050] SOC component 435 may determine changes to be applied to the content based at least in part on analysis performed by AI / ML component 425. For example, based at least in part on the fact that the input is a command, the source is the user's parent, and the priority is high, SOC component 435 may introduce a first character into the video game, or change the video game environment to a first environment that significantly speeds up the video game. For example, the first character may have a first function, first intensity, first speed, or first ability that makes the game more difficult, thus causing the user to lose the game faster. In another example, based at least in part on the fact that the input is a problem, the source is a sibling, and the priority is low, SOC component 435 may introduce a second character into the video game, or change the environment to a second environment that only slightly speeds up the video game. For example, the second character may have a second function, second intensity, second speed, or second ability that only slightly makes the game more difficult. In another example, SOC component 435 may determine not to introduce a character or change the environment based at least in part on the fact that the input has a very low priority.

[0051] As described herein, UE 120 may modify content, at least in part, based on received input. In some aspects, modifying the content may include changing the role associated with the content, changing the environment associated with the content, or increasing the difficulty of the content. This allows the content to end or complete more quickly without causing a noticeable interruption. For example, introducing a role into the content, introducing obstacles into the content, or increasing the difficulty of the content can allow the content to end more quickly without explicitly interrupting it and without negatively impacting the user experience.

[0052] As indicated above, Figure 4 This is provided as an example. Other examples are available with reference to [the relevant information]. Figure 4 The examples described are different.

[0053] Figure 5 This is a diagram illustrating an example process 500 performed by a UE according to this disclosure. Example process 500 is an example in which a UE (e.g., UE 120) performs operations associated with input analysis and content modification.

[0054] like Figure 5 As shown, in some aspects, process 500 may include displaying content via a display associated with the UE (block 510). For example, as described above, the UE may display content via a display associated with the UE.

[0055] like Figure 5As further shown, in some aspects, process 500 may include receiving input via a sensor associated with the UE when displaying the content (block 520). For example, as described above, the UE may receive input via a sensor associated with the UE when displaying the content.

[0056] like Figure 5 As further shown, in some aspects, process 500 may include: modifying the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content (box 530). For example, as described above, the UE may modify the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0057] Process 500 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in conjunction with one or more other processes described elsewhere in this document.

[0058] In the first aspect, process 500 includes: performing analysis of the input based at least in part on the context of the input, the source of the input, the sentiment of the input, or the intensity of the input.

[0059] In the second aspect, either alone or in combination with the first aspect, the analysis is performed at least in part based on a user profile or location profile associated with the user of the UE.

[0060] In a third aspect, either alone or in combination with one or more of the first and second aspects, process 500 includes: determining the priority of the input based at least in part on the context of the input, the source of the input, the emotion of the input, the intensity of the input, or the timing of the input.

[0061] In the fourth aspect, either alone or in combination with one or more of the first to third aspects, process 500 includes: determining, at least in part, changes to be applied to the content based on the priority and at least one of the context of the input, the source of the input, the mood of the input, the intensity of the input, or the time of the input.

[0062] In the fifth aspect, determining the change to be applied to the content, either alone or in combination with one or more of the first to fourth aspects, includes: determining the level or amount of change to be applied to the content.

[0063] In a sixth aspect, either alone or in combination with one or more of the first to fifth aspects, process 500 includes: performing an analysis of the input by an artificial intelligence and machine learning component based at least in part on the context of the input, the source of the input, the sentiment of the input, or the intensity of the input; determining a priority of the input by the artificial intelligence and machine learning component based at least in part on the analysis of the input; and determining changes to be applied to the content by an on-chip system component based at least in part on the priority of the input and at least one of the context of the input, the source of the input, the sentiment of the input, or the intensity of the input.

[0064] In the seventh aspect, either alone or in combination with one or more of the first to sixth aspects, the sensor is a microphone associated with the UE.

[0065] In the eighth aspect, either alone or in combination with one or more of the first to seventh aspects, the input is the voice of a person who is not currently using the UE.

[0066] In the ninth aspect, either alone or in combination with one or more of the first to eighth aspects, the input is a notification from a device connected to the UE.

[0067] In the tenth aspect, the input includes at least one of sensor data, time conditions, temperature conditions, or battery conditions, either alone or in combination with one or more of the first to ninth aspects.

[0068] In the eleventh aspect, altering the content, either alone or in combination with one or more of the first to tenth aspects, also includes altering existing roles associated with the content.

[0069] In the twelfth aspect, alone or in combination with one or more of the first to eleventh aspects, the role is a non-playable role, a central processing unit controlled role, or a combination of the non-playable role and the central processing unit controlled role.

[0070] In the thirteenth aspect, alone or in combination with one or more of the first to twelfth aspects, process 500 includes: determining the type of the role, the function of the role, the strength of the role, the speed of the role, or the ability of the role.

[0071] In the fourteenth aspect, altering the environment of the content, either alone or in combination with one or more of the first to thirteenth aspects, includes changing the environment of the content from a first environment to a second environment.

[0072] In the fifteenth aspect, altering the environment of the content, either alone or in combination with one or more of the first to fourteenth aspects, includes introducing obstacles into the environment of the content.

[0073] In the sixteenth aspect, altering the difficulty of the content, either alone or in combination with one or more of the first to fifteenth aspects, includes increasing the difficulty of the content.

[0074] In the seventeenth aspect, alone or in combination with one or more of the first to sixteenth aspects, the UE is an extended reality device, a virtual reality device, or an augmented reality device.

[0075] In the eighteenth aspect, alone or in combination with one or more of the first to seventeenth aspects, the content is video game content.

[0076] In the nineteenth aspect, alone or in combination with one or more of the first to eighteenth aspects, the UE includes a plurality of sensors, and receiving the input includes: receiving a first input via a first sensor of the plurality of sensors, and receiving a second input via a second sensor of the plurality of sensors.

[0077] In the twentieth aspect, the input is independent of the content, either alone or in combination with one or more of the first to nineteenth aspects.

[0078] In the twenty-first aspect, either alone or in combination with one or more of the first to twentieth aspects, process 500 includes: playing audio associated with the content.

[0079] although Figure 5 An example box of process 500 is shown, but in some respects, process 500 may include... Figure 5 The boxes depicted in the diagram may be fewer, different, or arranged differently than additional boxes. Alternatively, two or more boxes in the process 500 may be executed in parallel.

[0080] The following provides an overview of some aspects of this disclosure:

[0081] Aspect 1: A method of wireless communication performed by a user equipment (UE), the method comprising: displaying content via a display associated with the UE; receiving input via a sensor associated with the UE while displaying the content; and modifying the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0082] Aspect 2: According to the method of aspect 1, the method further includes: performing analysis of the input based at least in part on the context of the input, the source of the input, the sentiment of the input, or the intensity of the input.

[0083] Aspect 3: The method according to aspect 2, wherein the analysis is performed at least in part based on a user profile or location profile associated with a user of the UE.

[0084] Aspect 4: According to the method of aspect 2, the method further includes: determining the priority of the input based at least in part on the context of the input, the source of the input, the emotion of the input, the intensity of the input, or the time of the input.

[0085] Aspect 5: The method according to aspect 4, the method further comprising: determining, at least in part, a change to be applied to the content based on the priority and at least one of the context of the input, the source of the input, the sentiment of the input, the intensity of the input, or the time of the input.

[0086] Aspect 6: According to the method of aspect 5, determining the change to be applied to the content includes determining the level or amount of change to be applied to the content.

[0087] Aspect 7: The method according to any one of Aspects 1 to 6, the method further comprising: performing analysis of the input by an artificial intelligence and machine learning component based at least in part on the context of the input, the source of the input, the sentiment of the input, or the intensity of the input; determining a priority of the input by the artificial intelligence and machine learning component based at least in part on the analysis of the input; and determining a change to be applied to the content by a system-on-a-chip component based at least in part on the priority of the input and at least one of the context of the input, the source of the input, the sentiment of the input, or the intensity of the input.

[0088] Aspect 8: The method according to any one of Aspects 1 to 7, wherein the sensor is a microphone associated with the UE.

[0089] Aspect 9: According to the method described in aspect 8, wherein the input is the voice of a person who is not currently using the UE.

[0090] Aspect 10: The method according to aspect 8, wherein the input is a notification from a device connected to the UE.

[0091] Aspect 11: The method according to any one of aspects 1 to 10, wherein the input includes at least one of sensor data, time conditions, temperature conditions, or battery conditions.

[0092] Aspect 12: The method according to any one of Aspects 1 to 11, wherein changing the content further includes: changing an existing role associated with the content.

[0093] Aspect 13: The method according to any one of Aspects 1 to 12, wherein the character is a non-playable character, a central processing unit controlled character, or a combination of the non-playable character and the central processing unit controlled character.

[0094] Aspect 14: The method according to any one of Aspects 1 to 13, the method further comprising: determining the type of the character, the function of the character, the strength of the character, the speed of the character, or the ability of the character.

[0095] Aspect 15: The method according to any one of Aspects 1 to 14, wherein changing the environment of the content comprises: changing the environment of the content from a first environment to a second environment.

[0096] Aspect 16: The method according to any one of Aspects 1 to 15, wherein changing the environment of the content comprises: introducing an obstacle into the environment of the content.

[0097] Aspect 17: The method according to any one of Aspects 1 to 16, wherein changing the difficulty of the content includes: increasing the difficulty of the content.

[0098] Aspect 18: The method according to any one of Aspects 1 to 17, wherein the UE is an extended reality device, a virtual reality device, or an augmented reality device.

[0099] Aspect 19: The method according to any one of Aspects 1 to 18, wherein the content is video game content.

[0100] Aspect 20: The method according to any one of aspects 1 to 19, wherein the UE includes a plurality of sensors, and wherein receiving the input includes: receiving a first input via a first sensor of the plurality of sensors, and receiving a second input via a second sensor of the plurality of sensors.

[0101] Aspect 21: The method according to any one of aspects 1 to 20, wherein the input is independent of the content.

[0102] Aspect 22: The method according to any one of aspects 1 to 21, the method further comprising: playing audio associated with the content.

[0103] Aspect 23: An apparatus for wireless communication at a user equipment (UE), the apparatus comprising: a memory; and one or more processors coupled to the memory, the one or more processors being configured to: display content via a display associated with the UE; receive input via a sensor associated with the UE while displaying the content; and modify the content at least in part based on the input, wherein modifying the content includes introducing a role into the content or changing the environment or difficulty of the content.

[0104] Aspect 24: A non-transitory computer-readable medium storing a set of instructions for wireless communication, the set of instructions including one or more instructions that, when executed by one or more processors of a user equipment (UE), cause the UE to: display content via a display associated with the UE; receive input via a sensor associated with the UE while displaying the content; and modify the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0105] Aspect 25: An apparatus for wireless communication, the apparatus comprising: means for displaying content via a display associated with the apparatus; means for receiving input via a sensor associated with the apparatus while displaying the content; and means for modifying the content at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

[0106] Aspect 26: A system configured to perform one or more of the operations stated in one or more of aspects 1 to 25.

[0107] Aspect 27: An apparatus comprising components for performing one or more of the operations described in one or more of aspects 1 to 25.

[0108] Aspect 28: A non-transitory computer-readable medium storing an instruction set comprising one or more instructions that, when executed by a device, cause the device to perform one or more operations stated in one or more of aspects 1 to 25.

[0109] Aspect 29: A computer program product comprising instructions or code for performing one or more of the operations stated in one or more of aspects 1 to 25.

[0110] While the foregoing disclosure provides examples and descriptions, it is not intended to be exhaustive or to limit aspects to the precise form disclosed. Modifications and variations can be made based on the foregoing disclosure, or from various aspects of practice.

[0111] As used herein, the term "component" is intended to be interpreted broadly as hardware and / or a combination of hardware and software. Whether referred to as software, firmware, middleware, microcode, hardware description language, or other names, "software" should be interpreted broadly as meaning instructions, instruction sets, code, code segments, program code, programs, subroutines, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, and / or functions, etc. As used herein, a "processor" is implemented in hardware and / or a combination of hardware and software. It will be apparent to those skilled in the art that the systems and / or methods described herein can be implemented in various forms of hardware and / or combinations of hardware and software. The actual dedicated control hardware or software code used to implement these systems and / or methods is not limiting in any way. Therefore, no specific software code is referenced herein to describe the operation and behavior of the systems and / or methods, as those skilled in the art will understand that the software and hardware can be designed, at least in part, based on the descriptions herein, to implement the systems and / or methods.

[0112] As used in this article, depending on the context, "meeting the threshold" can mean a value greater than the threshold, greater than or equal to the threshold, less than the threshold, less than or equal to the threshold, equal to the threshold, or not equal to the threshold.

[0113] Although specific combinations of features are set forth in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of various aspects. Many of these features can be combined in ways not specifically set forth in the claims and / or not disclosed in the specification. The disclosure of various aspects includes each dependent claim in combination with each other claim in the claim set. As used herein, the phrase “at least one of” in the list of items refers to any combination of these items (including a single member). As an example, “at least one of a, b, or c” is intended to cover a, b, c, a+b, a+c, b+c, and a+b+c, as well as any combination with multiple identical elements (e.g., a+a, a+a+a, a+a+b, a+a+c, a+b+b, a+c+c, b+b, b+b+b, b+b+c, c+c, and c+c+c, or any other ordering of a, b, and c).

[0114] No element, action, or instruction used herein should be construed as essential or necessary unless explicitly stated otherwise. Furthermore, as used herein, the articles “a” and “an” are intended to include one or more items and are interchangeable with “one or more.” Furthermore, as used herein, the article “described” is intended to include one or more items mentioned in connection with the article “described” and is interchangeable with “one or more.” Furthermore, as used herein, the terms “set” and “group” are intended to include one or more items and are interchangeable with “one or more.” If only one item is desired, the phrase “only one” or similar terminology will be used. Furthermore, as used herein, the terms “have,” “possess,” or “have” are intended to be open-ended terms that do not limit the elements they modify (e.g., an element “having” A may also have B). Furthermore, the phrase “based on” is intended to mean “at least partially based on” unless otherwise explicitly stated. Furthermore, as used herein, the term “or” is intended to be open-ended when used in a series and is interchangeable with “and / or” unless otherwise expressly stated (e.g., if used in conjunction with “any” or “only one of”).

Claims

1. A method for wireless communication performed by a user equipment (UE), the method comprising: Content is displayed via a display associated with the UE; Input is received via a sensor associated with the UE when the content is displayed; as well as The content is modified at least in part based on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

2. The method according to claim 1, further comprising: The analysis of the input is performed at least in part based on the context of the input, the source of the input, the sentiment of the input, or the intensity of the input.

3. The method of claim 2, wherein the analysis is performed at least in part based on a user profile or location profile associated with a user of the UE.

4. The method according to claim 2, further comprising: The priority of the input is determined at least in part based on the context of the input, the source of the input, the emotion of the input, the intensity of the input, or the timing of the input.

5. The method according to claim 4, further comprising: The changes to be applied to the content are determined at least in part based on the priority and at least one of the context of the input, the source of the input, the sentiment of the input, the intensity of the input, or the timing of the input.

6. The method of claim 5, wherein determining the change to be applied to the content comprises: Determine the level or amount of change to apply to the content.

7. The method according to claim 1, further comprising: The analysis of the input is performed by artificial intelligence and machine learning components based at least in part on the context of the input, the source of the input, the sentiment of the input, or the intensity of the input; The priority of the input is determined by the artificial intelligence and machine learning components based at least in part on the analysis of the input; as well as The changes to be applied to the content are determined by the system-on-chip component based at least in part on the priority of the input and at least one of the context of the input, the source of the input, the mood of the input, or the intensity of the input.

8. The method of claim 1, wherein the sensor is a microphone associated with the UE.

9. The method of claim 8, wherein the input is the voice of a person who is not currently using the UE.

10. The method of claim 8, wherein the input is a notification from a device connected to the UE.

11. The method of claim 1, wherein the input includes at least one of sensor data, time conditions, temperature conditions, or battery conditions.

12. The method of claim 1, wherein the modification of the content further comprises: Change the existing role associated with the content.

13. The method of claim 1, wherein the character is a non-playable character, a central processing unit controlled character, or a combination of the non-playable character and the central processing unit controlled character.

14. The method according to claim 1, further comprising: Determine the type of the character, the function of the character, the strength of the character, the speed of the character, or the ability of the character.

15. The method of claim 1, wherein changing the environment of the content comprises: The environment of the content is changed from the first environment to the second environment.

16. The method of claim 1, wherein changing the environment of the content comprises: Introduce obstacles into the environment of the content.

17. The method of claim 1, wherein the difficulty of changing the content includes: Increase the difficulty of the content.

18. The method according to claim 1, wherein the UE is an extended reality device, a virtual reality device, or an augmented reality device.

19. The method according to claim 1, wherein the content is video game content.

20. The method of claim 1, wherein the UE comprises a plurality of sensors, and wherein receiving the input comprises: Receiving a first input via a first sensor among the plurality of sensors, and receiving a second input via a second sensor among the plurality of sensors.

21. The method according to claim 1, wherein the input is unrelated to the content.

22. The method according to claim 1, further comprising: Playing audio associated with the content.

23. An apparatus for wireless communication at a user equipment (UE), the apparatus comprising: A memory; And One or more processors coupled to the memory and configured to: Display content via a display associated with the UE; Receive an input via a sensor associated with the UE while displaying the content; and Change the content at least in part based on the input, wherein changing the content includes introducing a character into the content or changing the environment or difficulty of the content.

24. The apparatus according to claim 23, wherein the one or more processors are further configured to: perform an analysis of the input at least in part based on the context of the input, the source of the input, the mood of the input, or the intensity of the input.

25. The apparatus according to claim 24, wherein the analysis is performed at least in part based on a user profile or a location profile associated with a user of the UE.

26. The apparatus according to claim 24, wherein the one or more processors are further configured to: determine a priority of the input at least in part based on the context of the input, the source of the input, the mood of the input, the intensity of the input, or the time of the input.

27. The apparatus according to claim 26, wherein the one or more processors are further configured to: determine a change to be applied to the content at least in part based on the priority and at least one of the context of the input, the source of the input, the mood of the input, the intensity of the input, or the time of the input.

28. The apparatus according to claim 23, wherein the input includes at least one of sensor data, a time condition, a temperature condition, or a battery condition.

29. A non-transitory computer-readable medium storing a set of instructions for wireless communication, the set of instructions including: One or more instructions that, when executed by one or more processors of a user equipment (UE), cause the UE to: Display content via a display associated with the UE; Receive an input via a sensor associated with the UE while displaying the content; and Change the content at least in part based on the input, wherein changing the content includes introducing a character into the content or changing the environment or difficulty of the content.

30. An apparatus for wireless communication, the apparatus comprising: Components for displaying content via a display associated with the device; A component for receiving input via a sensor associated with the device when displaying the content; and Components for modifying the content based at least in part on the input, wherein modifying the content includes introducing a character into the content or changing the environment or difficulty of the content.

Images