Video Call Continuity

Abstract

The present disclosure relates to a method and device for wireless communication of an apparatus, such as a UE. In one aspect, the apparatus may determine whether a connection of a video call is interrupted, the video call including a plurality of decoded frames. The apparatus may also determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the connection of the video call is interrupted. The apparatus may also generate one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device. In addition, the apparatus may determine whether the one or more artificial frames are suitable for a face model call. The apparatus may also establish a face model call based on a combination of the one or more artificial frames and an audio feed from a transmitting device.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of U.S. patent application Ser. No. 17 / 217,857, filed Mar. 30, 2021, entitled “METHODS AND APPARATUS FOR CONTINUITY OF VIDEO CALLS,” which is expressly incorporated by reference herein in its entirety.

[0002] FIELD OF THE DISCLOSURE The present disclosure relates generally to communication systems, and more particularly, to video calling in wireless communication systems. [Background technology]

[0003] Wireless communication systems have been widely deployed to provide various telecommunication services, such as telephone, video, data, messaging, and broadcast. A typical wireless communication system may employ multiple access technologies capable of supporting communication with multiple users by sharing available system resources. Examples of such multiple access technologies include Code Division Multiple Access (CDMA) systems, Time Division Multiple Access (TDMA) systems, Frequency Division Multiple Access (FDMA) systems, Orthogonal Frequency Division Multiple Access (OFDMA) systems, Single Carrier Frequency Division Multiple Access (SC-FDMA) systems, and Time Division Synchronous Code Division Multiple Access (TD-SCDMA) systems.

[0004] These multiple access technologies are being adopted in various telecommunications standards to provide a common protocol that allows different wireless devices to communicate on a city, national, regional, or even global scale. An exemplary telecommunications standard is 5G New Radio (NR). 5G NR is part of the continuing mobile broadband evolution promulgated by the 3rd Generation Partnership Project (3GPP) to meet new requirements related to latency, reliability, security, scalability (e.g., with the Internet of Things (IoT)), and other requirements. 5G NR includes services associated with enhanced mobile broadband (eMBB), massive machine-type communications (mMTC), and ultra-reliable low-latency communications (URLLC). Some aspects of 5G NR may be based on the 4G Long Term Evolution (LTE) standard. There is a need for further improvements in 5G NR technology. These improvements may also be applicable to other multiple access technologies and telecommunications standards that utilize these technologies. Summary of the Invention [Means for solving the problem]

[0005] The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, nor is it intended to identify key or critical elements of all aspects or to delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.

[0006] In one aspect of the disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may be a wireless device or a user equipment (UE). The apparatus may receive a plurality of frames for a video call, and decode each of the plurality of frames for the video call, such that the plurality of frames corresponds to a plurality of decoded frames. The apparatus may also determine whether a connection of the video call is interrupted, the video call including a plurality of decoded frames. The apparatus may also determine whether a threshold amount of a plurality of frames has been received if the connection of the video call is interrupted, and one or more decoded frames are determined to be suitable based on whether the threshold amount of the plurality of frames has been received. In addition, the apparatus may determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the connection of the video call is interrupted. The apparatus may also identify one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, and each of the one or more artificial frames is generated based on the one or more facial landmarks. The device may also generate one or more artificial frames based on the one or more decoded frames and an audio feed from the transmitting device of the video call if the one or more decoded frames are suitable. Furthermore, upon generating the one or more artificial frames, the device may determine whether the one or more artificial frames are suitable for a face model call. The device may also combine the one or more artificial frames with the audio feed of the transmitting device if it determines that the one or more artificial frames are suitable. The device may also establish a face model call based on a combination of the one or more artificial frames and the audio feed from the transmitting device if the one or more artificial frames are suitable. Furthermore, the device may switch from the face model call to a conventional video call when the connection of the video call is no longer interrupted.

[0007] To the accomplishment of the foregoing and related ends, the one or more aspects comprise the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative features of the one or more aspects. These features are indicative, however, of but a few of the various ways in which the principles of the various aspects may be employed and the description is intended to include all such aspects and their equivalents. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example of a wireless communication system and access network. [Figure 2A] FIG. 2 illustrates an example of a first frame in accordance with various aspects of the present disclosure. [Figure 2B] FIG. 1 illustrates an example of a DL channel in a subframe in accordance with various aspects of the present disclosure. [Figure 2C] FIG. 2 illustrates an example of a second frame, according to various aspects of the present disclosure. [Figure 2D] FIG. 1 illustrates an example of a UL channel in a subframe in accordance with various aspects of the present disclosure. [Diagram 3] FIG. 1 illustrates an example of a base station and user equipment (UE) in an access network. [Figure 4] FIG. 2 illustrates an exemplary face model generation. [Diagram 5] FIG. 1 illustrates an exemplary facial landmark identification. [Figure 6] FIG. 2 illustrates an exemplary face model generation. [Figure 7A] 1 is a flow chart of a method of wireless communication. [Figure 7B] 1 is a flow chart of a method of wireless communication. [Figure 7C] 1 is a flow chart of a method of wireless communication. [Figure 8] FIG. 2 illustrates an exemplary communication between a UE and a base station. [Figure 9]1 is a flow chart of a method of wireless communication. [Figure 10] FIG. 2 illustrates an example of a hardware implementation for an exemplary apparatus. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] As wireless technologies for video calling become more and more advanced, for example, with 4G LTE and 5G New Radio (NR) technologies, network connectivity issues remain prevalent. In some instances, these network connectivity issues may impede or interrupt the continuity of the video call. For example, multiple devices, such as device A and device B, may be communicating via a normal video call, but device A may experience connectivity issues. That is, device A's frames may be dropped or device A may shift to a voice call. Device B may not experience connectivity issues, but may still suffer from device A's connectivity issues. Thus, it may be frustrating for a user of device B to experience a video call interruption when there was no connectivity issue on their side. In some aspects of video calling, a call interruption or connectivity issue may cause one or more frames of the call to be dropped. Furthermore, in some aspects of video calling with multiple devices, one device, such as device A, may drop frames, and the other device, such as device B, may suffer from a call interruption or connectivity issue. Aspects of the present disclosure may provide solutions to video call interruptions and / or network connectivity issues during a video call. For example, aspects of the present disclosure may help maintain a video call connection at one device when one or more frames are dropped from another device. Additionally, aspects of the present disclosure may enable one device to maintain network connectivity during a video call when another device experiences connectivity issues.

[0010] The detailed description set forth below in conjunction with the accompanying drawings is intended as a description of various configurations and does not represent the only configurations in which the concepts described herein may be practiced. The detailed description includes specific details for the purpose of providing a thorough understanding of the various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. In some instances, well-known structures and components are shown in block diagram form to avoid obscuring such concepts.

[0011] Several aspects of a telecommunications system are now presented with respect to various apparatus and methods that are described in the following detailed description and illustrated in the accompanying drawings by various blocks, components, circuits, processes, algorithms, etc. (collectively referred to as "elements"). These elements may be implemented using electronic hardware, computer software, or any combination thereof. Whether such elements are implemented as hardware or software depends on the particular application and design constraints imposed on the overall system.

[0012] As an example, an element or any portion of an element or any combination of elements may be implemented as a "processing system" including one or more processors. Examples of processors include microprocessors, microcontrollers, graphics processing units (GPUs), central processing units (CPUs), application processors, digital signal processors (DSPs), reduced instruction set computing (RISC) processors, systems on chips (SoCs), baseband processors, field programmable gate arrays (FPGAs), programmable logic devices (PLDs), state machines, gate logic, discrete hardware circuits, and other suitable hardware configured to perform various functions described throughout this disclosure. One or more processors in a processing system may execute software. Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software components, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, and the like, whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0013] Thus, in one or more exemplary embodiments, the functions described may be implemented in hardware, software, or any combination thereof. If implemented in software, the functions may be stored on a computer-readable medium or encoded as one or more instructions or codes on a computer-readable medium. A computer-readable medium includes a computer storage medium. A storage medium may be any available medium that can be accessed by a computer. By way of example and not limitation, such a computer-readable medium may comprise a random access memory (RAM), a read-only memory (ROM), an electrically erasable programmable ROM (EEPROM), optical disk storage, magnetic disk storage, other magnetic storage devices, combinations of the above types of computer-readable media, or any other medium that can be used to store computer-executable code in the form of instructions or data structures that can be accessed by a computer.

[0014] 1 illustrates an example of a wireless communication system and access network 100. The wireless communication system (also referred to as a wireless wide area network (WWAN)) includes a base station 102, a UE 104, an evolved packet core (EPC) 160, and another core network 190 (e.g., 5G core (5GC)). The base station 102 may include a macro cell (high power cellular base station) and / or a small cell (low power cellular base station). The macro cell includes a base station. The small cell includes a femto cell, a pico cell, and a micro cell.

[0015] A base station 102 configured for 4G LTE (collectively referred to as Evolved Universal Mobile Telecommunications System (UMTS) Terrestrial Radio Access Network (E-UTRAN)) may interface with the EPC 160 through a first backhaul link 132 (e.g., an S1 interface). A base station 102 configured for 5G NR (collectively referred to as Next Generation RAN (NG-RAN)) may interface with the core network 190 through a second backhaul link 184. In addition to other functions, the base station 102 may perform one or more of the following functions: forwarding of user data, encryption and decryption of radio channels, integrity protection, header compression, mobility control functions (e.g., handover, dual connectivity), inter-cell interference coordination, connection setup and release, load balancing, distribution for non-access stratum (NAS) messages, NAS node selection, synchronization, Radio Access Network (RAN) sharing, Multimedia Broadcast Multicast Service (MBMS), subscriber and equipment tracking, RAN Information Management (RIM), paging, positioning, and delivery of alert messages. The base stations 102 may communicate with each other directly or indirectly (e.g., through the EPC 160 or the core network 190) via a third backhaul link 134 (e.g., an X2 interface). The first backhaul link 132, the second backhaul link 184, and the third backhaul link 134 may be wired or wireless.

[0016] The base stations 102 may wirelessly communicate with the UE 104. Each of the base stations 102 may provide communication coverage to a respective geographic coverage area 110. There may be overlapping geographic coverage areas 110. For example, a small cell 102' may have a coverage area 110' that overlaps with the coverage area 110 of one or more macro base stations 102. A network including both small cells and macro cells may be referred to as a heterogeneous network. A heterogeneous network may also include a Home evolved Node B (eNB) (HeNB) that may serve restricted groups called Closed Subscriber Groups (CSGs). A communication link 120 between the base station 102 and the UE 104 may include an uplink (UL) (also referred to as a reverse link) transmission from the UE 104 to the base station 102, and / or a downlink (DL) (also referred to as a forward link) transmission from the base station 102 to the UE 104. The communication link 120 may use multiple-input multiple-output (MIMO) antenna technology, including spatial multiplexing, beamforming, and / or transmit diversity. The communication link may be over one or more carriers. The base station 102 / UE 104 may use spectrum with bandwidth up to YMHz (e.g., 5, 10, 15, 20, 100, 400 MHz, etc.) per carrier allocated in carrier aggregation with up to a total of YxMHz (x component carriers) used for transmission in each direction. The carriers may or may not be adjacent to each other. The carrier allocation may be asymmetric with respect to DL and UL (e.g., more or fewer carriers may be allocated for DL ​​than for UL). The component carriers may include a primary component carrier and one or more secondary component carriers. The primary component carrier may be referred to as a primary cell (PCell), and the secondary component carrier may be referred to as a secondary cell (SCell).

[0017] Several UEs 104 may communicate with each other using device-to-device (D2D) communication links 158. The D2D communication links 158 may use DL / UL WWAN spectrum. The D2D communication links 158 may use one or more sidelink channels, such as a physical sidelink broadcast channel (PSBCH), a physical sidelink discovery channel (PSDCH), a physical sidelink shared channel (PSSCH), and a physical sidelink control channel (PSCCH). The D2D communication may be through various wireless D2D communication systems, such as, for example, WiMedia, Bluetooth, ZigBee, Wi-Fi based on the Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard, LTE, or NR.

[0018] The wireless communication system may further include a Wi-Fi access point (AP) 150 in communication with a Wi-Fi station (STA) 152, such as in the 5 GHz unlicensed frequency spectrum, via a communication link 154. When communicating in the unlicensed frequency spectrum, the STA 152 / AP 150 may perform clear channel assessment (CCA) before communicating to determine if a channel is available.

[0019] The small cell 102' may operate in licensed and / or unlicensed frequency spectrums. When operating in an unlicensed frequency spectrum, the small cell 102' may utilize NR and may use the same unlicensed frequency spectrum (e.g., 5 GHz, etc.) used by the Wi-Fi AP 150. A small cell 102' utilizing NR in an unlicensed frequency spectrum may provide enhanced coverage to and / or increase the capacity of an access network.

[0020] The electromagnetic spectrum is often subdivided into various classes, bands, channels, etc., based on frequency / wavelength. For 5G NR, two initial operating bands have been identified with frequency range designations FR1 (410 MHz-7.125 GHz) and FR2 (24.25 GHz-52.6 GHz). Frequencies between FR1 and FR2 are often referred to as mid-band frequencies. Although portions of FR1 are higher than 6 GHz, FR1 is often referred to (interchangeably) as the "sub-6 GHz" band in various documents and papers. Similar nomenclature issues may arise with respect to FR2, which is often referred to (interchangeably) as the "mmWave" band in documents and papers, even though it is different from the extremely high frequency (EHF) band (30 GHz-300 GHz) identified as the "mmWave" band by the International Telecommunications Union (ITU).

[0021] With the above aspects in mind, it should be understood that unless otherwise specified, terms such as "sub-6 GHz," as used herein, may broadly refer to frequencies that may be below 6 GHz, may be within FR1, or may include mid-band frequencies. Additionally, it should be understood that unless otherwise specified, terms such as "mmWave," as used herein, may broadly refer to frequencies that may include mid-band frequencies, may be within FR2, or may be within the EHF band.

[0022] The base station 102, whether a small cell 102′ or a large cell (e.g., a macro base station), may include and / or be referred to as an eNB, gNodeB (gNB), or another type of base station. Some base stations, such as the gNB 180, in communication with the UE 104 may operate in the conventional sub-6 GHz spectrum, at mmWave frequencies, and / or at sub-mmWave frequencies. When the gNB 180 operates in mmWave frequencies or sub-mmWave frequencies, the gNB 180 may be referred to as a mmWave base station. The mmWave base station 180 may use beamforming 182 with the UE 104 to compensate for path loss and short distances. The base station 180 and the UE 104 may each include multiple antennas, such as antenna elements, antenna panels, and / or antenna arrays, to facilitate beamforming.

[0023] The base station 180 may transmit a beamformed signal to the UE 104 in one or more transmit directions 182′. The UE 104 may receive a beamformed signal from the base station 180 in one or more receive directions 182″. The UE 104 may also transmit a beamformed signal to the base station 180 in one or more transmit directions. The base station 180 may receive a beamformed signal from the UE 104 in one or more receive directions. The base station 180 / UE 104 may perform beam training to determine the best receive direction and transmit direction for each of the base station 180 / UE 104. The transmit direction and receive direction for the base station 180 may be the same or different. The transmit direction and receive direction for the UE 104 may be the same or different.

[0024] The EPC 160 may include a Mobility Management Entity (MME) 162, other MMEs 164, a Serving Gateway 166, a Multimedia Broadcast Multicast Service (MBMS) Gateway 168, a Broadcast Multicast Service Center (BM-SC) 170, and a Packet Data Network (PDN) Gateway 172. The MME 162 may be in communication with a Home Subscriber Server (HSS) 174. The MME 162 is a control node that handles signaling between the UE 104 and the EPC 160. In general, the MME 162 handles bearer and connection management. All user Internet Protocol (IP) packets are forwarded through the Serving Gateway 166, which is itself connected to the PDN Gateway 172. The PDN Gateway 172 provides UE IP address allocation as well as other functions. The PDN Gateway 172 and the BM-SC 170 are connected to an IP Service 176. The IP services 176 may include Internet, Intranet, IP Multimedia Subsystem (IMS), PS streaming services, and / or other IP services. The BM-SC 170 may provide functionality for MBMS user service provisioning and delivery. The BM-SC 170 may act as an entry point for content provider MBMS transmissions, may be used to authorize and activate MBMS bearer services in a Public Land Mobile Network (PLMN), and may be used to schedule MBMS transmissions. The MBMS Gateway 168 may be used to deliver MBMS traffic to base stations 102 that belong to a Multicast Broadcast Single Frequency Network (MBSFN) area that broadcasts a particular service, and may be responsible for session management (start / stop) and collecting eMBMS-related charging information.

[0025] The core network 190 may include an access and mobility management function (AMF) 192, other AMFs 193, a session management function (SMF) 194, and a user plane function (UPF) 195. The AMF 192 may be in communication with an integrated data management (UDM) 196. The AMF 192 is a control node that handles signaling between the UE 104 and the core network 190. In general, the AMF 192 provides QoS flow and session management. All user Internet Protocol (IP) packets are forwarded through the UPF 195. The UPF 195 provides IP address allocation for the UE as well as other functions. The UPF 195 is connected to IP services 197. The IP services 197 may include the Internet, intranets, IP multimedia subsystem (IMS), packet switched (PS) streaming (PSS) services, and / or other IP services.

[0026] A base station may include and / or be referred to as a gNB, Node B, eNB, access point, base transceiver station, radio base station, radio transceiver, transceiver function, basic service set (BSS), extended service set (ESS), transmit reception point (TRP), or some other suitable terminology. The base station 102 provides an access point to the EPC 160 or core network 190 for the UE 104. Examples of the UE 104 include a cellular phone, a smartphone, a session initiation protocol (SIP) phone, a laptop, a personal digital assistant (PDA), a satellite radio, a global positioning system, a multimedia device, a video device, a digital audio player (e.g., MP3 player), a camera, a game console, a tablet, a smart device, a wearable device, a vehicle, an electric meter, a gas pump, a large or small cooking appliance, a health management device, an implant, a sensor / actuator, a display, or any other similar function device. Some of the UEs 104 may be referred to as IoT devices (e.g., a parking meter, a gas pump, a toaster, a vehicle, a heart monitor, etc.). The UE 104 may also be referred to as a station, mobile station, subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.

[0027] Referring again to FIG. 1, in some aspects, the UE 104 may include a determination component 198 configured to receive a plurality of frames for a video call and decode each of the plurality of frames for the video call such that the plurality of frames corresponds to a plurality of decoded frames. The determination component 198 may also be configured to determine whether a connection of the video call is interrupted, the video call including a plurality of decoded frames. The determination component 198 may also be configured to determine whether a threshold amount of the plurality of frames has been received if the connection of the video call is interrupted, and one or more decoded frames are determined to be suitable based on whether the threshold amount of the plurality of frames has been received. The determination component 198 may also be configured to determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the connection of the video call is interrupted. The determination component 198 may also be configured to identify one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, and each of the one or more artificial frames is generated based on the one or more facial landmarks. The determination component 198 may also be configured to generate one or more artificial frames based on the one or more decoded frames and an audio feed from the transmitting device of the video call if the one or more decoded frames are suitable. The determination component 198 may also be configured to determine whether the one or more artificial frames are suitable for a face model call upon generating the one or more artificial frames. The determination component 198 may also be configured to combine the one or more artificial frames with an audio feed of the transmitting device upon determining that the one or more artificial frames are suitable. The determination component 198 may also be configured to establish a face model call based on a combination of the one or more artificial frames and an audio feed from the transmitting device if the one or more artificial frames are suitable.The decision component 198 can also be configured to switch from the face model call to a conventional video call when the video call connection is no longer interrupted.

[0028] The following description may focus on 5G NR, however, the concepts described herein may be applicable to other similar domains, such as LTE, LTE-A, CDMA, GSM, and other wireless technologies.

[0029] FIG. 2A is a diagram 200 illustrating an example of a first subframe in a 5G NR frame structure. FIG. 2B is a diagram 230 illustrating an example of a DL channel in a 5G NR subframe. FIG. 2C is a diagram 250 illustrating an example of a second subframe in a 5G NR frame structure. FIG. 2D is a diagram 280 illustrating an example of a UL channel in a 5G NR subframe. The 5G NR frame structure may be frequency division duplex (FDD) where for a particular set of subcarriers (carrier system bandwidth), subframes within the set of subcarriers are dedicated to either DL or UL, or may be time division duplex (TDD) where for a particular set of subcarriers (carrier system bandwidth), subframes within the set of subcarriers are dedicated to both DL and UL. In the example provided by FIG. 2A, FIG. 2C, the 5G / NR frame structure is assumed to be TDD, subframe 4 is configured with slot format 28 (with mostly DL), where D is DL, U is UL, and F is flexible for use between DL / UL, and subframe 3 is configured with slot format 1 (with all UL). Subframes 3 and 4 are shown with slot formats 1 and 28, respectively, but any particular subframe may be configured with any of the various available slot formats 0-61. Slot formats 0 and 1 are all DL, UL, respectively. The other slot formats 2-61 include a mix of DL, UL, and flexible symbols. The UE is configured with the slot format (dynamically through DL control information (DCI) or semi-statically / statically through radio resource control (RRC) signaling) through a received slot format indicator (SFI). Note that the following description also applies to the 5G NR frame structure, which is TDD.

[0030] Other wireless communication technologies may have different frame structures and / or different channels. A frame (10 ms) may be divided into 10 subframes (1 ms) of equal size. Each subframe may include one or more time slots. A subframe may also include a minislot, which may include 7, 4, or 2 symbols. Each slot may include 7 or 14 symbols depending on the slot configuration. For slot configuration 0, each slot may include 14 symbols, and for slot configuration 1, each slot may include 7 symbols. Symbols on the DL may be Cyclic Prefix (CP) Orthogonal Frequency Division Multiplexing (OFDM) (CP-OFDM) symbols. Symbols on the UL may be CP-OFDM symbols (for high throughput scenarios) or Discrete Fourier Transform (DFT) Spread OFDM (DFT-s-OFDM) symbols (also called Single Carrier Frequency Division Multiple Access (SC-FDMA) symbols) (for power-limited scenarios, limited to a single stream transmission). The number of slots in a subframe is based on the slot configuration and numerology. In slot configuration 0, the different numerologies μ 0-4 allow 1, 2, 4, 8, and 16 slots per subframe, respectively. In slot configuration 1, the different numerologies 0-2 allow 2, 4, and 8 slots per subframe, respectively. Thus, for slot configuration 0 and numerology μ, 14 symbols / slot and 2 μ There are slots / subframes. Subcarrier spacing and symbol length / duration are functions of numerology. Subcarrier spacing is 2 μ* may be equal to 15 kHz, where μ is the numerology 0 to 4. Thus, numerology μ=0 has a subcarrier spacing of 15 kHz and numerology μ=4 has a subcarrier spacing of 240 kHz. The symbol length / duration is inversely proportional to the subcarrier spacing. Figures 2A to 2D give an example of slot configuration 0 with 14 symbols per slot and numerology μ=2 with 4 slots per subframe. The slot duration is 0.25 ms, the subcarrier spacing is 60 kHz and the symbol duration is approximately 16.67 μs. Within a set of frames, there may be one or more different bandwidth parts (BWPs) (see Figure 2B) that are frequency division multiplexed. Each BWP may have a specific numerology.

[0031] A resource grid can be used to represent the frame structure. Each time slot contains a resource block (RB), also called a physical RB (PRB), that spans 12 consecutive subcarriers. The resource grid is divided into multiple resource elements (REs). The number of bits carried by each RE depends on the modulation scheme.

[0032] As shown in Figure 2A, some of the REs carry reference (pilot) signals (RS) for the UE. The RS may include demodulation RS (DM-RS) (denoted as R for one particular configuration, but other DM-RS configurations are possible) and channel state information reference signals (CSI-RS) for channel estimation at the UE. The RS may also include beam measurement RS (BRS), beam improvement RS (BRRS), and phase tracking RS (PT-RS).

[0033] FIG. 2B illustrates an example of various DL channels in a subframe of a frame. A physical downlink control channel (PDCCH) carries DCI in one or more control channel elements (CCEs) (e.g., 1, 2, 4, 8, or 16 CCEs), each CCE including 6 RE groups (REGs), each REG including 12 consecutive REs in an OFDM symbol of an RB. The PDCCHs in one BWP may be referred to as a control resource set (CORESET). A UE is configured to monitor PDCCH candidates in a PDCCH search space (e.g., common search space, UE-specific search space) during a PDCCH monitoring opportunity on the CORESET, where the PDCCH candidates have different DCI formats and different aggregation levels. Additional BWPs may be at higher and / or lower frequencies across the channel bandwidth. A primary synchronization signal (PSS) may be in symbol 2 of a particular subframe of a frame. The PSS is used by the UE 104 to determine subframe / symbol timing and physical layer identity. The secondary synchronization signal (SSS) may be in symbol 4 of a particular subframe of a frame. The SSS is used by the UE to determine the physical layer cell identity group number and radio frame timing. Based on the physical layer identity and the physical layer cell identity group number, the UE can determine the physical cell identifier (PCI). Based on the PCI, the UE can determine the location of the DM-RS mentioned above. The physical broadcast channel (PBCH), which carries the master information block (MIB), may be logically grouped with the PSS and SSS to form a synchronization signal (SS) / PBCH block (also called SS block (SSB)). The MIB provides the number of RBs in the system bandwidth and the system frame number (SFN). The physical downlink shared channel (PDSCH) carries user data, broadcast system information not transmitted over the PBCH, such as the system information block (SIB), and paging messages.

[0034] As shown in FIG. 2C, some of the REs carry DM-RS (denoted as R for one particular configuration, but other DM-RS configurations are possible) for channel estimation at the base station. The UE may transmit DM-RS for the physical uplink control channel (PUCCH) and DM-RS for the physical uplink shared channel (PUSCH). The PUSCH DM-RS may be transmitted in the first one or two symbols of the PUSCH. The PUCCH DM-RS may be transmitted in different configurations depending on whether a short or long PUCCH is transmitted and depending on the particular PUCCH format used. The UE may transmit a sounding reference signal (SRS). The SRS may be transmitted in the last symbol of a subframe. The SRS may have a comb structure, and the UE may transmit the SRS in one of the combs. The SRS may be used by the base station for channel quality estimation to enable frequency-dependent scheduling on the UL.

[0035] 2D illustrates an example of various UL channels within a subframe of a frame. The PUCCH, in one configuration, may be located as shown. The PUCCH carries uplink control information (UCI) such as scheduling requests, channel quality indicators (CQIs), precoding matrix indicators (PMIs), rank indicators (RIs), and hybrid automatic repeat request (HARQ) acknowledgment (ACK) (HARQ-ACK) information (ACK / negative ACK (NACK)) feedback. The PUSCH carries data and may be further used to carry buffer status reports (BSRs), power headroom reports (PHRs), and / or UCIs.

[0036] 3 is a block diagram of a base station 310 communicating with a UE 350 in an access network. In the DL, IP packets from the EPC 160 may be provided to a controller / processor 375. The controller / processor 375 implements Layer 3 and Layer 2 functions. Layer 3 includes a Radio Resource Control (RRC) layer, and Layer 2 includes a Service Data Adaptation Protocol (SDAP) layer, a Packet Data Convergence Protocol (PDCP) layer, a Radio Link Control (RLC) layer, and a Medium Access Control (MAC) layer. The controller / processor 375 provides RRC layer functionality related to broadcasting of system information (e.g., MIBs, SIBs), RRC connection control (e.g., RRC connection paging, RRC connection establishment, RRC connection modification, and RRC connection release), inter-radio access technology (RAT) mobility, and measurement configuration for UE measurement reporting; PDCP layer functionality related to header compression / decompression, security (encryption, decryption, integrity protection, integrity verification), and handover support functions; RLC layer functionality related to transfer of upper layer packet data units (PDUs), error correction via ARQ, concatenation, segmentation, and reassembly of RLC service data units (SDUs), re-segmentation of RLC data PDUs, and reordering of RLC data PDUs; and MAC layer functionality related to mapping between logical channels and transport channels, multiplexing of MAC SDUs onto transport blocks (TBs), demultiplexing of MAC SDUs from TBs, scheduling information reporting, error correction via HARQ, priority handling, and logical channel prioritization.

[0037] The transmit (TX) processor 316 and receive (RX) processor 370 perform Layer 1 functions related to various signal processing functions. Layer 1, including the physical (PHY) layer, may include error detection on transport channels, forward error correction (FEC) coding / decoding of transport channels, interleaving, rate matching, mapping onto physical channels, modulation / demodulation of physical channels, and MIMO antenna processing. The TX processor 316 processes mapping to signal constellations based on various modulation schemes (e.g., binary phase shift keying (BPSK), quadrature phase shift keying (QPSK), M-phase shift keying (M-PSK), M-ary quadrature amplitude modulation (M-QAM)). The coded and modulated symbols may then be split into parallel streams. Each stream may then be mapped to an OFDM subcarrier, multiplexed with reference signals (e.g., pilots) in the time and / or frequency domain, and then combined together using an inverse fast Fourier transform (IFFT) to generate a physical channel carrying a time-domain OFDM symbol stream. The OFDM stream is spatially precoded to generate multiple spatial streams. Channel estimates from a channel estimator 374 may be used to determine the coding and modulation scheme and for spatial processing. The channel estimates may be derived from a reference signal and / or channel condition feedback transmitted by the UE 350. Each spatial stream may then be provided to a different antenna 320 via a separate transmitter 318TX. Each transmitter 318TX may modulate an RF carrier with a respective spatial stream for transmission.

[0038] At the UE 350, each receiver 354RX receives a signal through its respective antenna 352. Each receiver 354RX recovers information modulated onto an RF carrier and provides the information to a receive (RX) processor 356. The TX processor 368 and the RX processor 356 implement Layer 1 functionality related to various signal processing functions. The RX processor 356 may perform spatial processing on the information to recover any spatial streams directed to the UE 350. Multiple spatial streams may be combined by the RX processor 356 into a single OFDM symbol stream if they are destined for the UE 350. The RX processor 356 then converts the OFDM symbol stream from the time domain to the frequency domain using a Fast Fourier Transform (FFT). The frequency domain signal comprises a separate OFDM symbol stream for each subcarrier of the OFDM signal. The symbols on each subcarrier, as well as the reference signal, are recovered and demodulated by determining the most likely signal constellation point transmitted by the base station 310. These soft decisions may be based on channel estimates calculated by a channel estimator 358. The soft decisions are then decoded and deinterleaved to recover the data and control signals originally transmitted by the base station 310 on the physical channel. The data and control signals are then provided to a controller / processor 359, which performs Layer 3 and Layer 2 functions.

[0039] The controller / processor 359 may be associated with a memory 360 that stores program codes and data. The memory 360 may be referred to as a computer-readable medium. In the UL, the controller / processor 359 performs demultiplexing between transport and logical channels, packet reassembly, decryption, header decompression, and control signal processing to recover IP packets from the EPC 160. The controller / processor 359 is also responsible for error detection using an ACK and / or NACK protocol to support HARQ operations.

[0040] Similar to the functionality described with respect to DL transmission by the base station 310, the controller / processor 359 provides RRC layer functionality associated with system information (e.g., MIBs, SIBs) collection, RRC connection, and measurement reporting; PDCP layer functionality associated with header compression / decompression and security (encryption, decryption, integrity protection, integrity verification); RLC layer functionality associated with transfer of upper layer PDUs, error correction via ARQ, concatenation, segmentation, and reassembly of RLC SDUs, resegmentation of RLC data PDUs, and reordering of RLC data PDUs; and MAC layer functionality associated with mapping between logical channels and transport channels, multiplexing of MAC SDUs onto the TB, demultiplexing of MAC SDUs from the TB, scheduling information reporting, error correction via HARQ, priority handling, and logical channel prioritization.

[0041] Channel estimates derived by the channel estimator 358 from a reference signal or feedback transmitted by the base station 310 may be used by the TX processor 368 to select an appropriate coding and modulation scheme as well as to facilitate spatial processing. The spatial streams generated by the TX processor 368 may be provided to different antennas 352 via separate transmitters 354TX. Each transmitter 354TX may modulate an RF carrier with a respective spatial stream for transmission.

[0042] The UL transmission is processed at the base station 310 in a manner similar to that described for the receiver functions at the UE 350. Each receiver 318RX receives a signal through a respective antenna 320. Each receiver 318RX recovers the information modulated onto an RF carrier and provides the information to a RX processor 370.

[0043] The controller / processor 375 may be associated with a memory 376 that stores program codes and data. The memory 376 may be referred to as a computer-readable medium. In the UL, the controller / processor 375 performs demultiplexing between transport and logical channels, packet reassembly, decryption, header decompression, and control signal processing to recover IP packets from the UE 350. The IP packets from the controller / processor 375 may be provided to the EPC 160. The controller / processor 375 is also responsible for error detection using an ACK and / or NACK protocol to support HARQ operations.

[0044] At least one of the TX processor 368, the RX processor 356, and the controller / processor 359 may be configured to perform aspects associated with 198 in FIG.

[0045] As wireless technologies for video calling become more and more advanced, for example with 4G LTE and 5G New Radio (NR) technologies, network connectivity issues remain prevalent. In some cases, these network connectivity issues may hinder or interrupt the continuity of the video call. For example, multiple devices, such as device A and device B, may be communicating via a normal video call, but device A may experience connectivity issues. That is, device A's frames may be dropped or device A may shift to a voice call. Device B may not experience connectivity issues, but may still be plagued by device A's connectivity issues. Thus, it may be frustrating for a user of device B to experience a video call interruption when there was no connectivity issue on his / her end.

[0046] As shown herein, in some aspects of a video call, a call interruption or connectivity issue may cause one or more frames of the call to be dropped. Furthermore, in some aspects of a video call with multiple devices, one device, e.g., device A, may drop frames and the other device, e.g., device B, may experience a call interruption or connectivity issue. Based on this, it may be beneficial to provide a solution to video call interruptions and / or network connectivity issues during a video call. For example, it may be beneficial to maintain a video call connection at one device when one or more frames are dropped from another device. Thus, it may be beneficial for both devices to maintain network connectivity during a video call when either of the devices experiences a connectivity issue.

[0047] Aspects of the present disclosure may provide solutions to video call interruptions and / or network connectivity issues during a video call. For example, aspects of the present disclosure may help maintain a video call connection at one device when one or more frames are dropped from another device. Additionally, aspects of the present disclosure may enable one device to maintain network connectivity during a video call when another device experiences connectivity issues.

[0048] In one example of a video call, the video call may include multiple devices, such as device A and device B. At the start of the video call, frames of device A may be smoothly transferred to device B. Aspects of the present disclosure may potentially utilize frames already received by device B to generate artificial frames for the face model call. In some instances, if the video portion of the call is interrupted, both the user of device A, i.e., user A, and the user of device B, i.e., user B, may have a smooth experience using only the audio feed. Aspects of the present disclosure may also utilize face synthesis to build a face model based on one or more techniques, such as by using a generative adversarial network (GAN) or a neural network (NN).

[0049] After the video call is established, aspects of the present disclosure may build a face model of the user of device A, i.e., a face model of user A, on device B. This face model may be built after a certain duration of the video call. In addition, after a certain duration, aspects of the present disclosure may build a face model of the user of device B, i.e., user B, on device A. That is, a certain duration of the video call may need to be established before the face model can be created. This duration of the video call may depend on several factors, e.g., the computing power of a particular processor, and / or may be determined based on various test procedures.

[0050] FIG. 4 is a diagram 400 illustrating an example face model generation. As shown in FIG. 4, the diagram 400 includes a network 410, a data layer 412, a real-time transport protocol (RTP) component 414, a jitter buffer 416, a decoder 418, and a rendering component 480. As shown in FIG. 4, each of these components may be involved in a standard video call of a receiving device, such as device 404 or device B. The diagram 400 also includes a hardware trigger component 420 (i.e., used to detect the appropriate frame), a decoded frame 430, a multitask cascaded convolutional neural network (MTCNN) model 432, a GAN model 434, and a face model generation component 436. As shown in FIG. 4, each of the aforementioned components may be part of a video module. Diagram 400 also includes a voice conversation 450 (between device 402 and device 404), a voice detection component 452 (for device 402 or device A), a tone trigger 454, a keyword trigger 456, a sentiment analysis 460, and generator weights 462. As shown in FIG. 4, each of these components may be part of a voice module.

[0051] As shown in FIG. 4, diagram 400 includes a pipeline at a receiving device, such as device 404 or device B, in a video call with a transmitting device, such as device 402 or device A. Diagram 400 illustrates that a face model may be constructed at a receiving device, such as device 404 or device B, based on a video call with a transmitting device, such as device 402 or device A. As shown in FIG. 4, a video call for a receiving device, such as device 404 or device B, may involve communication between a network 410, a data layer 412, an RTP component 414, a jitter buffer 416, a decoder 418, and a rendering component 480. In some aspects, a hardware trigger 420 may detect a suitable frame, communicate a suitable decoded frame 430 from the decoder 418, and utilize the MTCNN model 432 and the GAN model 434 to generate a face model in a face model generation component 436. The face model generation may also utilize the voice conversation between device A and device B 450, the voice detection at device A 452, the tone trigger 454, the keyword trigger 456, the sentiment analysis 460, and the generator weights. More specifically, the voice detection component 452 and the generator weights 462 may be utilized by the GAN model 434 to generate a face model at the face model generation component 436. Additionally, the face model generated by the face model generation component 436 may be utilized by the rendering component 480 to render or establish a face model call at device 404 or device B.

[0052] As shown in FIG. 4, some aspects of the disclosure may include a hardware trigger, such as, for example, hardware trigger component 420. In some instances, this hardware trigger may provide a suitable or acceptable video frame to the model. A suitable frame may correspond to a received frame without packet loss or corruption. Additionally, a suitable or acceptable frame may be based on face visibility, an optimal bit rate in the received frame, and / or the use of artificial intelligence (AI) upscaling to improve the quality of the frame sent to the model.

[0053] Further, as shown in FIG. 4, embodiments of the present disclosure may include sentiment analysis, such as sentiment analysis 460. For example, embodiments of the present disclosure may utilize real-time audio samples in addition to the generated video. Furthermore, embodiments of the present disclosure may modify facial expressions according to different types of emotions the user may be experiencing. In some embodiments, the sentiment analysis module may include extrapolation techniques that may output a certain emotion, which may then be fed to the generator.

[0054] In some instances, the background of the video call may remain the same across various frames for the video call, and thus, a GAN model, such as, for example, GAN model 434, may be fed with the user's face information. For example, a multitask cascaded neural network (MTCNN), such as, for example, MTCNN model 432, may be used for this process. Furthermore, MTCNN may be utilized for purposes other than providing face information. For example, aspects of the present disclosure may identify the user's key face locations or facial landmarks, such as five facial landmarks, for example, two landmarks for the eyes, two landmarks for the mouth, and one landmark for the nose. These features may be used to modify the weights of the generator according to emotion triggers from the audio feed. Also, tone triggers may be based on language analysis. In some instances, some keyword triggers, such as, for example, "congratulations," "sigh," etc., may be set to control the face in the face model call.

[0055] FIG. 5 is a diagram 500 illustrating an exemplary facial landmark identification. More specifically, FIG. 5 displays a diagram 500 of a face of a user 510 in a frame 502 for a facial model call. As shown in FIG. 5, the face of the user 510 in the frame 502 may be utilized to generate one or more artificial frames for a facial model call. As indicated above, when generating an artificial frame for a facial model call, aspects of the present disclosure may identify key locations of the user's facial landmarks, such as, for example, five facial landmarks. For example, aspects of the present disclosure may identify two facial landmarks for the user's 510's eyes, such as, for example, landmarks 511 and 512, one facial landmark for the user's 510's nose, such as, for example, landmark 513, and two facial landmarks for the user's 510's mouth, such as, for example, landmarks 514 and 515.

[0056] In some aspects, the artificial frame generation process may utilize multiple neural networks, e.g., generative and adversarial networks. These multiple types of neural networks may be utilized in the training process for the generation of the artificial frames. Generative networks may utilize forward propagation, i.e., generation and classification. And discriminative or adversarial networks may utilize backward propagation, i.e., adversarial training. In some cases, after the face model training process, the user may not be able to distinguish the real frames compared to the artificial frames.

[0057] FIG. 6 is a diagram 600 illustrating an exemplary face model generation. More specifically, FIG. 6 illustrates an artificial frame generation process or face synthesis process according to the present disclosure utilizing a GAN or neural network. As shown in FIG. 6, the diagram 600 includes a speech 610, a decoded frame 620, a generator 630, emotion weights 632, an actual frame 640, a synchronization discriminator 642, a generated frame 650, a frame discriminator 652, and a sequence discriminator 660. The diagram 600 illustrates that the generator 630 may generate a frame, such as the generated frame 650, based on the speech 610, the decoded frame 620, and the emotion weights 632. The speech condition of the speech 610, along with the actual frame 640 and the generated frame 650, may be analyzed by the synchronization discriminator 642. Also, the discriminatory condition of the decoded frame 620, along with the actual frame 640 and the generated frame 650, may be analyzed by the frame discriminator 652. The sequence discriminator 660 may also analyze the generated frames 650 and the actual frames 640. As shown in Figure 6, the audio condition step and the identification condition step may be conditional inputs, and the other steps in the diagram 600 may be inputs.

[0058] In an aspect, a user of device A establishes a video call with a user of device B, and both device A and device B may initially have a good connection. After a certain duration, e.g., a duration of length "n", aspects of the present disclosure may build a video call model of the user of device A on device B. For example, a face model of user A, i.e., the user of device A, may be built on device B, e.g., a UE or smartphone. Similarly, a face model of user B, i.e., the user of device B, may be built on user A's device, e.g., a UE or smartphone. If the video communication is dropped or interrupted, aspects of the present disclosure may implement a face model call by utilizing an audio feed from another device along with the built face model. For example, if the video communication from device A is dropped or interrupted, a face model call may be initiated at device B by utilizing an audio feed from device A in combination with the built face model of user A. Thus, the face model call at device B may include one or more artificial frames of user A generated at device B and an audio feed from device A. Similarly, a face model call at device A may include one or more artificial frames of user B generated at device A and an audio feed from device B.

[0059] 7A, 7B, and 7C display flowcharts 700, 720, and 740 of a method of wireless communication, respectively. As shown in FIG. 7A, in one example, at 702, a video call may be established between a user of device A and a user of device B. At 704, after a certain duration, e.g., a duration of length "n", the video call may be interrupted or one or more frames in the call may be dropped. At 706, the face models created at device A and device B may replace the traditional real-time video call at both devices, i.e., device A and device B. Thus, device A and device B may utilize audio feeds from the other device to combine with one or more artificial frames to generate a face model call.

[0060] As shown in FIG. 7B, in another example, at 722, a video call may be established between a user of device A, i.e., user A, and a user of device B, i.e., user B. At 724, it may be determined that the length of the video call is relatively short, i.e., does not exceed a threshold duration, and the video call may be interrupted or at least one frame may be dropped. At 726, a conventional switch to a voice call may be made because a face model may not be built before the threshold duration. In this situation, aspects of the present disclosure may not implement a face model call because a face model may not be created before the threshold duration, and thus the interrupted video call may transition to a conventional voice call.

[0061] As shown in FIG. 7C, in another example, a face model call may be established at 742 between a user of device A, i.e., user A, and a user of device B, i.e., user B. During the face model call, the video connection may be interrupted or one or more frames may be dropped. However, at 744, the video connection may be re-established in a relatively short time. At 746, if the video connection is quickly re-established, aspects of the present disclosure may switch to a conventional video call and stop conducting the face model call. Thus, if the normal video connection is restored in a timely manner, the face model call may not be needed.

[0062] Aspects of the present disclosure can introduce continuous calling to the device and provide users with the opportunity to maintain a video call without any call drops. Aspects of the present disclosure can be implemented in hardware and can use hardware triggers to identify which frames are suitable or acceptable to be used in creating a face model. This can be a faster method than any standard application of artificial intelligence (AI) or machine learning (ML), which entails the additional overhead of going through all frames to determine which frames are suitable or acceptable for creating a face model. Aspects of the present disclosure can leverage hardware in this function of continuous video calling. Aspects of the present disclosure can include a sentiment analysis module to recreate an acceptable video call, which can be faster compared to standard software solutions. Additionally, aspects of the present disclosure can include a call switching feature between a face model call and a real-time video call, for example, when network connectivity returns.

[0063] In some cases, aspects of the present disclosure may include real-time synchronization to replace the face model in a call at the same moment the call drops. Additionally, a model of the sending device may be generated on the receiving device for that particular call. This model may then be stored in temporary memory at the receiving device for the duration of the call. Additionally, aspects of the present disclosure may create two separate models if two users' faces are present at the beginning of the call. However, if a second user joins during the duration the call was dropped, there may be no way to recreate those frames, and therefore the audio feed may be utilized for the second user.

[0064] 8 is a diagram 800 illustrating communication between a wireless device or UE 802 and a wireless device or UE 804. The wireless device 802 may correspond to the UE 104, 350, the device 402, the device 404, and the apparatus 1002.

[0065] At 810, the wireless device 802 may receive a plurality of frames for a video call, such as, for example, the video call 812, and decode each of the plurality of frames for the video call, such that the plurality of frames corresponds to a plurality of decoded frames. The wireless device 802 may be a UE, and the one or more artificial frames may be stored in a local memory of the UE.

[0066] At 820, the wireless device 802 may determine whether a video call, such as, for example, the video call 812, is interrupted, the video call including a plurality of decoded frames.

[0067] At 822, the wireless device 802 may determine whether a threshold amount of frames have been received if a video call connection, such as the video call 812, is interrupted, and one or more decoded frames are determined to be suitable based on whether the threshold amount of frames has been received.

[0068] At 830, the wireless device 802 may determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the video call connection is interrupted. In some instances, each of the one or more decoded frames may be determined to be suitable for artificial frame generation based on at least one of face visibility of the frame, a bit rate of the frame, or packet loss or corruption of the frame. Also, information corresponding to at least one of face visibility of the frame, a bit rate of the frame, or packet loss or corruption of the frame may be received from a video module or video firmware.

[0069] At 840, the wireless device 802 may identify one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, and each of the one or more artificial frames is generated based on the one or more facial landmarks. The one or more facial landmarks in each of the one or more decoded frames may be adjusted based on at least one of one or more tone triggers or one or more keyword triggers.

[0070] At 850, the wireless device 802 may generate one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call if the one or more decoded frames are suitable. The one or more artificial frames may be generated based on one or more emotion weights. The one or more emotion weights may also be based on at least one of one or more tone triggers or one or more keyword triggers.

[0071] At 860, upon generating the one or more artificial frames, the wireless device 802 may determine whether the one or more artificial frames are suitable for the face model call. The one or more artificial frames may be determined to be suitable based on at least one of a synchronization of the one or more artificial frames with an audio feed, a comparison of the one or more artificial frames with one or more decoded frames, or a sequence of the one or more artificial frames. The comparison with the one or more decoded frames may be based on a quality or definition of the one or more artificial frames. The sequence of the one or more artificial frames may be based on an alignment between consecutive frames being less than a threshold. The one or more artificial frames may be determined to be suitable by at least one neural network (NN) or at least one discriminator.

[0072] At 870, the wireless device 802 may combine the one or more artificial frames with the audio feed of the transmitting device if it determines that the one or more artificial frames are suitable.

[0073] At 880, the wireless device 802 may establish a facial model call, such as, for example, a facial model call 882, based on a combination of the one or more artificial frames and the audio feed from the transmitting device, if one or more artificial frames are suitable.

[0074] At 890, the wireless device 802 may switch from the face model call, such as, for example, face model call 882, to a traditional video call, such as, for example, video call 892, when the video call connection is no longer interrupted.

[0075] 9 is a flowchart 900 of a method of wireless communication. The method may be performed by an apparatus such as a wireless device, a UE, or a component of a UE (e.g., UE 104, 350, device 402 / 404, apparatus 1002). Optional aspects are shown in dashed lines. The methods described herein may provide several benefits, such as improved communication signaling, resource utilization, and / or power savings.

[0076] At 902, the apparatus may receive a plurality of frames for a video call and decode each of the plurality of frames for the video call, such that the plurality of frames corresponds to the plurality of decoded frames, as described in connection with the examples of Figures 4-8. For example, as described at 810 of Figure 8, the wireless device 802 may receive a plurality of frames for a video call and decode each of the plurality of frames for the video call, such that the plurality of frames corresponds to the plurality of decoded frames. Additionally, 902 may be performed by the determining component 1040 of Figure 10. The wireless device may be a UE, and the one or more artificial frames are stored in a local memory of the UE.

[0077] At 904, the apparatus may determine whether a connection of the video call is interrupted, the video call including a plurality of decoded frames, as described in connection with the examples of Figures 4-8. For example, as described at 820 of Figure 8, the wireless device 802 may determine whether a connection of the video call is interrupted, the video call including a plurality of decoded frames. Additionally, 904 may be performed by the determination component 1040 of Figure 10.

[0078] At 906, the apparatus may determine whether a threshold amount of frames have been received if the video call is interrupted, as described in connection with the examples of Figures 4-8, and one or more decoded frames are determined to be suitable based on whether the threshold amount of frames has been received. For example, as described at 822 of Figure 8, the wireless device 802 may determine whether a threshold amount of frames have been received if the video call is interrupted, and one or more decoded frames are determined to be suitable based on whether the threshold amount of frames has been received. Additionally, 906 may be performed by the determination component 1040 of Figure 10.

[0079] At 908, the apparatus may determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the video call connection is interrupted, as described in connection with the examples of FIGS. 4-8. For example, as described at 830 of FIG. 8, the wireless device 802 may determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the video call connection is interrupted. Additionally, 908 may be performed by the determination component 1040 of FIG. 10. In some instances, each of the one or more decoded frames may be determined to be suitable for artificial frame generation based on at least one of face visibility of the frame, a bit rate of the frame, or packet loss or corruption of the frame. Also, information corresponding to at least one of face visibility of the frame, a bit rate of the frame, or packet loss or corruption of the frame may be received from a video module or video firmware.

[0080] At 910, the apparatus may identify one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, and each of the one or more artificial frames is generated based on the one or more facial landmarks, as described in connection with the examples of Figures 4-8. For example, as described at 840 of Figure 8, the wireless device 802 may identify one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, and each of the one or more artificial frames is generated based on the one or more facial landmarks. Additionally, 910 may be performed by the decision component 1040 of Figure 10. The one or more facial landmarks in each of the one or more decoded frames may be adjusted based on at least one of one or more tone triggers or one or more keyword triggers.

[0081] At 912, the device may generate one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call if the one or more decoded frames are suitable, as described in connection with the examples of Figures 4-8. For example, as described at 850 of Figure 8, the wireless device 802 may generate one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call if the one or more decoded frames are suitable. Additionally, 912 may be performed by the decision component 1040 of Figure 10. The one or more artificial frames may be generated based on one or more emotion weights. Additionally, the one or more emotion weights may be based on at least one of one or more tone triggers or one or more keyword triggers.

[0082] At 914, the device may determine whether the one or more artificial frames are suitable for a face model call upon generating the one or more artificial frames, as described in connection with the examples of FIGS. 4-8. For example, as described at 860 of FIG. 8, the wireless device 802 may determine whether the one or more artificial frames are suitable for a face model call upon generating the one or more artificial frames. Additionally, 914 may be performed by the determination component 1040 of FIG. 10. The one or more artificial frames may be determined to be suitable based on at least one of a synchronization of the one or more artificial frames with an audio feed, a comparison of the one or more artificial frames with one or more decoded frames, or a sequence of the one or more artificial frames. The comparison with the one or more decoded frames may be based on a quality or definition of the one or more artificial frames. The sequence of the one or more artificial frames may be based on an alignment between successive frames being less than a threshold. The one or more artificial frames may be determined to be suitable by at least one neural network (NN) or at least one discriminator.

[0083] At 916, the apparatus may combine one or more artificial frames with the audio feed of the transmitting device if it determines that one or more artificial frames are suitable, as described in connection with the examples of Figures 4-8. For example, as described at 870 of Figure 8, the wireless device 802 may combine one or more artificial frames with the audio feed of the transmitting device if it determines that one or more artificial frames are suitable. Additionally, 916 may be performed by the determining component 1040 of Figure 10.

[0084] At 918, the device may establish a facial model call based on a combination of the one or more artificial frames and an audio feed from the transmitting device if the one or more artificial frames are suitable, as described in connection with the examples of Figures 4-8. For example, as described at 880 of Figure 8, the wireless device 802 may establish a facial model call based on a combination of the one or more artificial frames and an audio feed from the transmitting device if the one or more artificial frames are suitable. Additionally, 918 may be performed by the decision component 1040 of Figure 10.

[0085] At 920, the device may switch from the face model call to a conventional video call when the video call connection is no longer interrupted, as described in connection with the examples of Figures 4-8. For example, as described at 890 of Figure 8, the wireless device 802 may switch from the face model call to a conventional video call when the video call connection is no longer interrupted. Additionally, 920 may be performed by the decision component 1040 of Figure 10.

[0086] 10 is a diagram 1000 illustrating an example of a hardware implementation of an apparatus 1002. The apparatus 1002 is a UE and includes a cellular baseband processor 1004 (also called a modem) coupled to a cellular RF transceiver 1022 and one or more subscriber identity module (SIM) cards 1020, an application processor 1006 coupled to a secure digital (SD) card 1008 and a screen 1010, a Bluetooth module 1012, a wireless local area network (WLAN) module 1014, a global positioning system (GPS) module 1016, and a power source 1018. The cellular baseband processor 1004 communicates with the UE 104 and / or the BS 102 / 180 through the cellular RF transceiver 1022. The cellular baseband processor 1004 may include a computer-readable medium / memory. The computer-readable medium / memory may be non-transitory. The cellular baseband processor 1004 is responsible for general processing, including the execution of software stored on a computer-readable medium / memory. The software, when executed by the cellular baseband processor 1004, causes the cellular baseband processor 1004 to perform the various functions described above. The computer-readable medium / memory may be used to store data that is manipulated by the cellular baseband processor 1004 when executing the software. The cellular baseband processor 1004 further includes a receiving component 1030, a communications manager 1032, and a transmitting component 1034. The communications manager 1032 includes one or more of the illustrated components. The components in the communications manager 1032 may be stored on a computer-readable medium / memory and / or configured as hardware in the cellular baseband processor 1004. The cellular baseband processor 1004 may be a component of the UE 350 and may include the memory 360 and / or at least one of the TX processor 368, the RX processor 356, and the controller / processor 359.In one configuration, the device 1002 may be a modem chip and may include only the baseband processor 1004, while in another configuration, the device 1002 may be an entire UE (e.g., see 350 in FIG. 3) and may include the additional modules described above for the device 1002.

[0087] The communications manager 1032 includes a determination component 1040 that may be configured to receive a plurality of frames for the video call and decode each of the plurality of frames for the video call, such that the plurality of frames corresponds to a plurality of decoded frames, for example, as described in connection with 902 of FIG. 9. The determination component 1040 may also be configured to determine whether a connection of the video call is interrupted, such as, for example, as described in connection with 904 of FIG. 9, the video call including a plurality of decoded frames. The determination component 1040 may also be configured to determine whether a threshold amount of the plurality of frames has been received if the connection of the video call is interrupted, such as, for example, as described in connection with 906 of FIG. 9, and one or more decoded frames are determined to be suitable based on whether the threshold amount of the plurality of frames has been received. The determination component 1040 may also be configured to determine whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation if the connection of the video call is interrupted, such as, for example, as described in connection with 908 of FIG. 9. The determination component 1040 may also be configured to identify one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, and each of the one or more artificial frames is generated based on the one or more facial landmarks, as described in connection with 910 of FIG. 9. The determination component 1040 may also be configured to generate one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call if the one or more decoded frames are suitable, as described in connection with 912 of FIG. The determination component 1040 may also be configured to determine whether the one or more artificial frames are suitable for a face model call upon generating the one or more artificial frames, as described in connection with 914 of FIG.The determination component 1040 may also be configured to combine one or more artificial frames with an audio feed of the transmitting device upon determining that one or more artificial frames are suitable, e.g., as described in connection with 916 of FIG. 9. The determination component 1040 may also be configured to establish a face model call based on a combination of the one or more artificial frames and an audio feed from the transmitting device if one or more artificial frames are suitable, e.g., as described in connection with 918 of FIG. 9. The determination component 1040 may also be configured to switch from the face model call to a conventional video call when the connection of the video call is no longer interrupted, e.g., as described in connection with 920 of FIG.

[0088] The apparatus may include additional components that perform each of the blocks of the algorithms in the foregoing flowcharts of Figures 8 and 9. Thus, each block in the foregoing flowcharts of Figures 8 and 9 may be performed by a component, and the apparatus may include one or more of those components. The components may be one or more hardware components specifically configured to perform the described process / algorithm, implemented by a processor configured to perform the described process / algorithm, stored in a computer-readable medium for implementation by a processor, or some combination thereof.

[0089] In one configuration, the apparatus 1002, and in particular the cellular baseband processor 1004, includes a means for receiving a plurality of frames for the video call, a means for decoding each of a plurality of frames for the video call, such that the plurality of frames corresponds to a plurality of decoded frames, a means for determining whether a connection of the video call is interrupted, the video call including the plurality of decoded frames, a means for determining if a threshold amount of the plurality of frames has been received, where one or more decoded frames are determined to be suitable based on whether the threshold amount of the plurality of frames has been received, a means for determining if a connection of the video call is interrupted, whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation, and if the one or more decoded frames are suitable for artificial frame generation, a means for determining whether one or more decoded frames in each of the one or more decoded frames are suitable for artificial frame generation. The present invention includes a means for identifying one or more facial landmarks, each of the one or more artificial frames being generated based on the one or more facial landmarks, a means for generating one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call if the one or more decoded frames are suitable, a means for determining whether the one or more artificial frames are suitable for a face model call upon generating the one or more artificial frames, a means for combining the one or more artificial frames with an audio feed of the transmitting device upon determining that the one or more artificial frames are suitable, a means for establishing a face model call based on a combination of the one or more artificial frames and the audio feed from the transmitting device if the one or more artificial frames are suitable, and a means for switching from the face model call to a conventional video call when the connection of the video call is no longer interrupted. The above-mentioned means may be one or more of the above-mentioned components of the apparatus 1002 configured to perform the functions recited by the above-mentioned means.As described above, the apparatus 1002 may include the TX processor 368, the RX processor 356, and the controller / processor 359. Thus, in one configuration, the above-mentioned means may be the TX processor 368, the RX processor 356, and the controller / processor 359 configured to perform the functions recited by the above-mentioned means.

[0090] It is understood that the particular order or hierarchy of blocks in the disclosed processes / flowcharts is illustrative of example approaches. Based on design preferences, it is understood that the particular order or hierarchy of blocks in the processes / flowcharts may be rearranged. Further, some blocks may be combined or omitted. The accompanying method claims present elements of the various blocks in an example order, and are not limited to the particular order or hierarchy presented.

[0091] The above description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects. Thus, the claims are not intended to be limited to the aspects set forth herein, but are to be accorded the widest scope consistent with the claim language, and references to elements in the singular do not mean "one and only," unless so expressly stated, but rather mean "one or more." Terms such as "if," "when," and "while" should be construed to mean "under the condition that," rather than implying an immediate time relationship or reaction. That is, these phrases, for example, "when," do not imply an immediate action in response to or during the occurrence of an action, but merely imply that an action occurs when a condition is met, but without requiring a specific or immediate time constraint for the action to occur. The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any aspect described herein as "exemplary" should not necessarily be construed as preferred or advantageous over other aspects. Unless otherwise specified, the term "some" refers to one or more. Combinations such as "at least one of A, B, or C," "one or more of A, B, or C," "at least one of A, B, and C," "one or more of A, B, and C," "A, B, C, or any combination thereof" include any combination of A, B, and / or C, and may include multiple A, multiple B, or multiple C.Specifically, combinations such as "at least one of A, B, or C," "one or more of A, B, or C," "at least one of A, B, and C," "one or more of A, B, and C," "A, B, C, or any combination thereof" may be A only, B only, C only, A and B, A and C, B and C, or A and B and C, and any such combination may include one or more members of A, B, or C. All structural and functional equivalents to the elements of the various embodiments described throughout this disclosure that are known or that later become known to those of skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the claims. Moreover, nothing disclosed herein is made public, regardless of whether such disclosure is expressly recited in the claims. Words such as "module," "mechanism," "element," "device," and the like may not be substitutes for the word "means." Thus, no claim element should be construed as a means plus function unless the element is expressly recited using the phrase "means for."

[0092] The following aspects are illustrative only and may be combined with other aspects or teachings described herein without limitation.

[0093] Aspect 1 is a method of wireless communication for a wireless device. The method includes: determining whether a video call connection is interrupted, the video call including a plurality of decoded frames; if the video call connection is interrupted, determining whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation; if the one or more decoded frames are suitable, generating one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call; upon generating the one or more artificial frames, determining whether the one or more artificial frames are suitable for a face model call; if the one or more artificial frames are suitable, establishing the face model call based on a combination of the one or more artificial frames and the audio feed from the transmitting device.

[0094] Aspect 2 is a method according to aspect 1, further comprising the step of determining, when a video call connection is interrupted, whether a threshold amount of a plurality of frames has been received, and one or more decoded frames are determined to be suitable based on whether the threshold amount of the plurality of frames has been received.

[0095] Example 3 is a method according to any of Examples 1 and 2, further comprising: identifying one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, wherein each of the one or more artificial frames is generated based on the one or more facial landmarks.

[0096] Example 4 is a method according to any of Examples 1 to 3, wherein one or more facial landmarks in each of the one or more decoded frames are adjusted based on at least one of one or more tone triggers or one or more keyword triggers.

[0097] Aspect 5 is a method according to any one of aspects 1 to 4, further comprising the step of switching from the face model call to a conventional video call when the connection of the video call is no longer interrupted.

[0098] Example 6 is a method described in any of examples 1 to 5, wherein the one or more artificial frames are determined to be suitable based on at least one of synchronization of the one or more artificial frames with an audio feed, a comparison of the one or more artificial frames with one or more decoded frames, or a sequence of the one or more artificial frames.

[0099] Example 7 is a method according to any one of examples 1 to 6, wherein the comparison with the one or more decoded frames is based on a quality or definition of the one or more artificial frames.

[0100] Example 8 is a method according to any of examples 1 to 7, wherein the sequence of one or more artificial frames is based on an alignment between consecutive frames being less than a threshold.

[0101] Example 9 is a method according to any of examples 1 to 8, wherein the one or more artificial frames are generated based on one or more emotion weights.

[0102] Example 10 is a method according to any of examples 1 to 9, wherein the one or more emotion weights are based on at least one of one or more tone triggers or one or more keyword triggers.

[0103] Example 11 is a method according to any one of Examples 1 to 10, further comprising, upon determining that one or more artificial frames are suitable, combining the one or more artificial frames with an audio feed of the transmitting device.

[0104] Example 12 is a method according to any one of examples 1 to 11, wherein each of one or more decoded frames is determined to be suitable for artificial frame generation based on at least one of face visibility of the frame, a bit rate of the frame, or packet loss or corruption of the frame.

[0105] Example 13 is a method described in any of Examples 1 to 12, wherein information corresponding to at least one of face visibility of the frame, bit rate of the frame, or packet loss or corruption of the frame is received from a video module or video firmware.

[0106] Example 14 is a method according to any one of Examples 1 to 13, further comprising the steps of receiving a plurality of frames for a video call and decoding each of the plurality of frames for the video call, such that the plurality of frames corresponds to a plurality of decoded frames.

[0107] Example 15 is a method according to any one of Examples 1 to 14, wherein the wireless device is a user equipment (UE) and the one or more artificial frames are stored in a local memory of the UE.

[0108] Example 16 is a method according to any of Examples 1 to 15, wherein the one or more artificial frames are determined to be suitable by at least one neural network (NN) or at least one discriminator.

[0109]

[0031] Aspect 17 is an apparatus for wireless communication including at least one processor coupled to a memory and configured to implement a method according to any of aspects 1 to 16.

[0110] Example 18 is an apparatus for wireless communication, comprising means for implementing the method of any of Examples 1 to 16.

[0111] Aspect 19 is a computer readable medium storing computer executable code, the code, when executed by a processor, causing the processor to implement a method according to any of aspects 1 to 16. [Explanation of symbols]

[0112] 100 Access Network 102 Base station 102' Small Cell 104 User Equipment (UE) 110 Geographic Coverage Areas 110' Coverage Area 120 Communication Links 132 1st backhaul link 134 3rd Backhaul Link 150 Wi-Fi access points (AP) 152 Wi-Fi stations (STA) 154 Communication Links 158 Device-to-Device (D2D) Communication Links 160 Evolved Packet Core (EPC) 162 Mobility Management Entity (MME) 164 Other MMEs 166 Serving Gateway 168 Multimedia Broadcast Multicast Service (MBMS) Gateway 170 Broadcast Multicast Service Center (BM-SC) 172 Packet Data Network (PDN) Gateway 174 Home Subscriber Server (HSS) 176 IP Services 180 base station 182 Beamforming 182' Sending direction 182'' receiving direction 184 Second Backhaul Link 190 Core Network 192 Access and Mobility Management Function (AMF) 193 Other AMF 194 Session Management Facility (SMF) 195 User Plane Function (UPF) 196 Unified Data Management (UDM) 197 IP Services 198 Decision Component 310 base station 316 Transmit (TX) Processor 318 Transmitter 318 Receiver 320 Antenna 350UE 352 Antenna 354 Receiver 354 Transmitter 354 Transmitter 356 Receive (RX) Processor 358 Channel Estimator 359 Controller / Processor 360 Memory 368 TX Processor 370 Receive (RX) Processor 374 Channel Estimator 375 Controller / Processor 376 Memory 402 Devices 404 Device 410 Network 412 Data Layer 414 Real-time Transport Protocol (RTP) Components 416 Jitter Buffer 418 Decoder 420 Hardware Trigger Components 430 Decoded Frames 432 Multitask Cascade Convolutional Neural Network (MTCNN) Model 434 GAN Model 436 Face Model Generation Component 450 voice conversations 452 Voice Detection Component 454 Tone Trigger 456 Keyword Triggers 460 Sentiment Analysis 462 Generator Weights 480 Rendering Component 510 users 502 frames 511 Landmark 512 Landmark 513 Landmark 514 Landmark 515 Landmark 610 Audio 620 Decoded Frames 630 Generator 632 Emotional Weight 640 Actual Frame 642 Synchronous Discriminator 650 Generated Frames 652 Frame Discriminator 660 Sequence Discriminator 802 Wireless Devices 804 Wireless Devices 812 Video Call 882 Face Model Call 1002 Equipment 1004 Cellular Baseband Processor 1006 Application Processor 1008 Secure Digital (SD) Card 1010 Screen 1012 Bluetooth Module 1014 Wireless Local Area Network (WLAN) Module 1016 Global Positioning System (GPS) Module 1018 Power supply 1020 Subscriber Identity Module (SIM) Card 1022 Cellular RF Transceiver 1030 Receiving Component 1032 Communications Manager 1034 Transmission Component 1040 Decision Component

Claims

1. 1. A method of wireless communication for a wireless device, comprising: determining whether a video call is interrupted, the video call including a plurality of decoded frames; If the connection of the video call is interrupted, whether a threshold amount of said plurality of frames has been received; and determining whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation based on whether the threshold amount of the plurality of frames has been received; if the one or more decoded frames are suitable, generating one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call; Upon generating the one or more artificial frames, determining whether the one or more artificial frames are suitable for face model calling; if the one or more artificial frames are suitable, establishing a face model call based on a combination of the one or more artificial frames and the audio feed from the transmitting device; The method includes: and identifying one or more facial landmarks in each of the one or more decoded frames if the one or more decoded frames are suitable for artificial frame generation, wherein each of the one or more artificial frames is generated based on the one or more facial landmarks. The method of claim 1, further comprising:

3. 3. The method of claim 2, wherein the one or more facial landmarks in each of the one or more decoded frames are adjusted based on at least one of one or more tone triggers or one or more keyword triggers.

4. switching from the face model call to a conventional video call when the connection of the video call is no longer interrupted. The method of claim 1, further comprising:

5. the one or more artificial frames are determined to be suitable based on at least one of: a synchronization of the one or more artificial frames with the audio feed, a comparison of the one or more artificial frames with the one or more decoded frames, or a sequence of the one or more artificial frames; Optional said comparison with said one or more decoded frames is based on a quality or definition of said one or more artificial frames; or the sequence of the one or more artificial frames is based on an alignment between successive frames being less than a threshold; The method of claim 1.

6. The method of claim 1, wherein the one or more artificial frames are generated based on one or more emotion weights.

7. The method of claim 6 , wherein the one or more emotion weights are based on at least one of one or more tone triggers or one or more keyword triggers.

8. upon determining that the one or more artificial frames are suitable, combining the one or more artificial frames with the audio feed of the transmitting device. The method of claim 1, further comprising:

9. Each of the one or more decoded frames is determined to be suitable for artificial frame generation based on at least one of face visibility of the frame, a bit rate of the frame, or packet loss or corruption of the frame; Optional information corresponding to at least one of the face visibility of the frame, the bit rate of the frame, or the packet loss or corruption of the frame is received from a video module or video firmware; The method of claim 1.

10. The method of claim 1, further comprising: receiving a plurality of frames for the video call; decoding each of the plurality of frames for the video call such that the plurality of frames corresponds to the plurality of decoded frames; The method of claim 1, further comprising:

11. 2. The method of claim 1, wherein the wireless device is a user equipment (UE) and the one or more artificial frames are stored in a local memory of the UE.

12. The method of claim 1 , wherein the one or more artificial frames are determined to be suitable by at least one neural network (NN) or at least one discriminator.

13. 1. An apparatus for wireless communication, the apparatus being a wireless device, comprising: Memory, at least one processor coupled to the memory; wherein the at least one processor: determining whether a connection of a video call is interrupted, the video call including a plurality of decoded frames; If the connection of the video call is interrupted, whether a threshold amount of said plurality of frames has been received; and determining whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation based on whether the threshold amount of the plurality of frames has been received; if the one or more decoded frames are suitable, generating one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device of the video call; Upon generating the one or more artificial frames, determining whether the one or more artificial frames are suitable for face model calling; if the one or more artificial frames are suitable, establishing a face model call based on a combination of the one or more artificial frames and the audio feed from the transmitting device; 4. The method of claim 3, Device.

14. The apparatus of claim 13, wherein the at least one processor is further configured to perform a method according to any one of claims 1 to 12.

15. 13. A computer readable medium storing computer executable code for wireless communication, the code, when executed by a processor, causing the processor to perform a method according to any one of claims 1 to 12.

Images