System and method for realizing video communication on a large television screen through an intelligent screen sound box

Abstract

The application provides a system and method for realizing video communication on a large TV screen through a smart screen sound box. The system comprises a terminal communication establishment subsystem, an account login subsystem and a scene communication establishment subsystem. The method comprises: providing at least three different terminal video communication client software installation versions, the video communication client software being used to establish communication connection of different terminals under the same account; completing network connection of different terminals under the same account, starting the video communication client software, performing account login, and completing communication connection of different terminals and a selective forwarding unit service platform; and under the support of the selective forwarding unit service platform and the network, completing communication in a call-out scene and an incoming call scene between different terminals. The application realizes end-side cooperation of the smart screen sound box and the large TV screen, reuses existing device hardware, and reduces cost; and realizes selective forwarding of video streams based on the selective forwarding unit service, and optimizes transmission efficiency.

Description

Technical Field

[0001] This invention relates to the field of smart device communication technology, and in particular to a system and method for enabling video communication on a large television screen via a smart screen speaker. Background Technology

[0002] Video communication uses compression coding technology to convert dynamic images and audio signals into digital data packets, which then travel across the internet via network protocols and are ultimately rewoven into a coherent audiovisual experience on the terminal device. With continuous technological development and progress, its application areas are constantly expanding, covering multiple fields such as social networking, education, healthcare, enterprise communication, public safety, and live-streaming e-commerce. In education, it promotes the development of online education; in healthcare, it drives the popularization of telemedicine; in enterprise communication, it improves communication and collaboration efficiency; in public safety, it is used for emergency response and monitoring; and in live-streaming e-commerce, it innovates marketing models. Existing technical solutions typically involve independent video communication via smart speakers or video calls via an external USB camera on a television. These solutions suffer from drawbacks such as the small screen size of smart screens, limited edge-side collaborative control performance, and high cross-device communication latency. The video communication field has developed rapidly in recent years, making significant progress in technological innovation, market expansion, and application scenario extension. In the future, it will continue to move towards intelligence, integration, and widespread adoption.

[0003] Existing technology one primarily utilizes independent video communication via smart speakers, such as the Amazon Echo Show and Baidu Smart Screen. This technology leverages the built-in screen and camera of the smart speaker to enable independent video calls, offering convenient operation without the need for additional equipment. However, smart screens are typically 7-10 inches, much smaller than televisions or monitors, impacting the viewing experience for multiple people. Furthermore, due to cost constraints, the camera, speaker, and microphone specifications of smart screens are relatively low, resulting in limited image quality, sound quality, and microphone pickup capabilities. Some brands (such as the Echo Show) only support their own communication protocols, leading to poor cross-platform compatibility.

[0004] Existing technology two primarily involves video calls via an external camera connected to the TV, such as a smart TV with a USB camera. This leverages the computing power of the smart TV to enable large-screen video calls, suitable for home use. However, this requires purchasing a compatible camera separately, and TVs typically lack a built-in high-sensitivity microphone, necessitating additional configuration, increasing cost and wiring complexity. Furthermore, the USB interface protocols and driver support vary across different TV brands, potentially leading to compatibility issues. Additionally, the TV remote control's video call interface is not intuitive, lacking the smooth experience of touch or voice control.

[0005] Existing technology three involves video calls via screen mirroring from a mobile phone, such as WeChat / DingTalk, to a TV. The mobile phone acts as the primary device for audio and video encoding / decoding, while the TV serves only as a display terminal, temporarily addressing the need for a large screen. However, the mobile phone must remain running continuously, leading to rapid heat and battery drain, and background applications may interrupt the call. Screen mirroring relies on Wi-Fi transmission, and secondary encoding increases latency (typically over 200ms), resulting in significant image compression. Furthermore, the TV cannot directly access the camera or microphone, hindering end-to-end collaborative optimization, such as echo cancellation between the TV speaker and the mobile phone microphone.

[0006] Current technologies 1, 2, and 3 suffer from several drawbacks: the lack of audio / video capture hardware on TVs and set-top boxes, the small screen size of smart screens, and limitations in the compatibility of audio / video capture hardware and screen functionality, all of which reduce the user experience. Traditional screen mirroring solutions also lack end-side collaborative control, making it impossible to directly answer and hang up calls on the large TV screen. Furthermore, they lack efficient video stream forwarding mechanisms, resulting in high cross-device communication latency. Therefore, this invention provides a system and method for achieving video communication on a large TV screen using a smart screen speaker. Summary of the Invention

[0007] To address the aforementioned technical problems, this invention provides a system for enabling video communication on a large television screen via a smart screen speaker, comprising: The terminal communication establishment subsystem is used to provide video communication client software installation versions that are compatible with at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. The account login subsystem is used to complete the network connection of different terminals under the same account, start the video communication client software, log in to the account, and complete the communication connection between different terminals and the selective forwarding unit service platform; The scenario communication establishment subsystem is used to complete communication between different terminals in both outgoing call and incoming call scenarios, with the support of the selective forwarding unit service platform and network.

[0008] Optional, the account login subsystem includes: The network access initialization module is used to inject network topology parameters into the configuration interface of the smart screen speaker, activate the underlying transmission protocol stack, and form a physical layer connection with the available network base station; it also simultaneously starts the video interaction application and completes the first authentication handshake with the service platform through the account credential verification mechanism. The cross-device account binding module is used when the same network topology parameters are entered in the settings menu of the TV screen. The triggered protocol stack response forms a symmetrical structure with the smart screen speaker. The same account credentials of the smart screen speaker are used to start the authentication handshake and generate an account-level device binding identifier, so that the TV screen and the smart screen speaker are mapped to the same virtual terminal group in the video communication client software. The collaborative channel self-test module is used to send collaborative configuration vectors from the service platform to the TV screen and smart screen speaker based on the account-level device binding identifier.

[0009] Optionally, the collaborative configuration vector of the collaborative channel self-test module triggers the display driver chain of the TV screen and the acquisition sensor loop of the smart screen speaker. The TV screen and the smart screen speaker automatically establish a spatiotemporal synchronization verification mechanism through the topology discovery protocol of the service platform and output an end-to-end ready status signal.

[0010] Optional, a scene communication establishment subsystem includes: The cross-terminal operation sensing module is used to receive physical button signals from the TV screen or acoustic or touch signals from the smart screen speaker, encode them into a unified format call request packet, and transmit the call request packet to the background service instruction distribution center through a persistent connection channel. The dual-device collaborative control module is used to retrieve the pre-stored device binding topology based on the account credentials in the call request packet; and execute the device collaborative decision logic. The directional media stream distribution module is used to upload the audio and video capture streams from the smart screen speaker to the media distribution node when the device is in a collaborative ready state. The media distribution node performs bidirectional routing, forwarding the local audio and video streams to the contact end; distributing remote video and audio streams to the TV screen; selectively distributing remote audio streams to the smart screen speaker; and the TV screen performs decoding and rendering operations on the received media streams to drive screen display and speaker output.

[0011] Optionally, in the outgoing call scenario of the dual-device collaborative control module, a display ready command is sent to the bound TV screen, and a collection ready command is sent to the smart screen speaker; in the incoming call scenario, a ringing synchronization command is sent to both ends in parallel; when either end returns a response to answer, a command to terminate is sent to the unresponsive end.

[0012] Optional, a dual-device collaborative control module includes: The user-initiated call submodule allows users to open the video communication client software on the TV screen, select a contact on their mobile phone through the application interface using the TV remote control, and touch the call button; or users can call a contact's name through voice commands in front of the smart screen speaker, or select a contact to initiate a call on the smart screen speaker interface. The background service collaboration submodule is used for TV screens or smart screen speakers to send call commands to the background service. After receiving the command, the background service queries the user's device binding information, confirms that the user is simultaneously connected to the TV screen and smart screen speaker devices, and sends collaboration commands to the TV screen and smart screen speaker devices to notify them to prepare to enter the video communication state. The audio and video acquisition and transmission submodule is used to activate the camera and microphone after the smart screen speaker receives the collaborative command, start to collect local audio and video data, encode the data and upload it to the selective forwarding unit service platform via the network; The video communication display and playback submodule is used to decode the audio and video data received from the other end after the TV screen receives the data, display the video image of the other end on the screen, and play the audio through the speaker; the smart screen speaker can select to play the audio from the other end according to the settings to realize video communication.

[0013] Optionally, the selective forwarding unit service platform of the audio and video acquisition and transmission submodule selectively forwards the video stream based on the device information of the peer contact, and at the same time forwards the audio and video data of the peer contact to the TV screen and smart screen speaker.

[0014] Optionally, the dual-device collaborative control module also includes: The incoming call notification submodule is used when the background service detects that the user's TV screen and smart screen speaker are both online when there is an incoming call. It sends an incoming call notification command to the TV screen and smart screen speaker. After receiving the command, the TV screen and smart screen speaker simultaneously start ringing and display the incoming call information on the TV screen and smart screen speaker interface. The call answering operation submodule allows users to answer calls by clicking the answer button on the TV screen using a remote control, by using voice commands on the smart screen speaker, or by touching the answer icon on the smart screen speaker. The answering device sends the answering command to the background service, and after receiving the command, the background service notifies the other device to stop ringing. The video communication establishment submodule is used by the backend service to coordinate the establishment of communication connections between the receiving end device, the unanswered end device, and the selective forwarding unit service platform; the smart screen speaker begins to collect local audio and video data and upload it to the selective forwarding unit service platform.

[0015] Optionally, the selective forwarding unit service platform of the video communication establishment submodule forwards data to the peer contact's device and forwards the peer contact's audio and video data to the TV screen and smart screen speaker. The TV screen displays the video and plays the audio, realizing large-screen video communication.

[0016] This invention provides a method for enabling video communication on a large TV screen using a smart screen speaker, comprising the following steps: Provide video communication client software installation versions that are compatible with at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. Complete network connections between different terminals under the same account, start the video communication client software, log in to the account, and complete the communication connection between different terminals and the selective forwarding unit service platform; With the support of the selective forwarding unit service platform and network, communication in both outgoing call and incoming call scenarios is completed between different terminals.

[0017] This invention enables end-to-end collaboration between a smart screen speaker and a large TV screen, fully leveraging the audio and video capture advantages of the smart screen speaker and the large-screen display advantages of the TV to provide users with a clearer and more immersive large-screen video communication experience. It supports users initiating and answering calls from either the smart TV screen or the smart screen speaker, catering to diverse user operating habits and improving the convenience of video communication operations. By utilizing a selective forwarding unit service to achieve selective forwarding of the video stream, it optimizes the data transmission path, reduces data transmission volume and latency, and improves the stability and smoothness of video communication.

[0018] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in the written description and the accompanying drawings.

[0019] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0020] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings: Figure 1 This is a system block diagram of embodiment 1 of the present invention for realizing video communication on a large TV screen through a smart screen speaker; Figure 2 This is a block diagram of the account login subsystem in Embodiment 2 of the present invention; Figure 3 This is a block diagram of the account login subsystem in Embodiment 3 of the present invention; Figure 4 A subsystem block diagram for scene communication in Embodiment 6 of the present invention is provided. Figure 5 This is a schematic diagram of the call-out scenario in Embodiment 7 of the present invention; Figure 6 This is a schematic diagram of the incoming call scenario in Embodiment 8 of the present invention; Figure 7 This is a flowchart of the method for achieving video communication on a large TV screen using a smart screen speaker in Embodiment 9 of the present invention; Figure 8 This is a schematic diagram of the selective forwarding unit service platform in Embodiment 9 of the present invention. Detailed Implementation

[0021] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0022] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the embodiments of this application. The singular forms “a,” “the,” and “the” used in the embodiments of this application are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used herein refers to and includes any or all possible combinations of one or more associated listed items.

[0023] In the following description, when referring to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application. In the description of this application, it should be understood that the terms "first," "second," "third," etc., are used only to distinguish similar objects and are not necessarily used to describe a specific order or sequence, nor should they be construed as indicating or implying relative importance. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.

[0024] Example 1: As Figure 1 As shown, this embodiment of the invention provides a system for video communication on a large TV screen via a smart screen speaker, comprising: The terminal communication establishment subsystem is used to provide video communication client software installation versions that are compatible with at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. The account login subsystem is used to complete the network connection of different terminals under the same account, start the video communication client software, log in to the account, and complete the communication connection between different terminals and the selective forwarding unit service platform; The scenario communication establishment subsystem is used to complete communication between different terminals in both outgoing call and incoming call scenarios, with the support of the selective forwarding unit service platform and network.

[0025] The working principle and beneficial effects of the above technical solution are as follows: The terminal communication establishment subsystem of this embodiment is used to provide video communication client software installation versions adapted to at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. The account login subsystem is used to complete the network connection between different terminals under the same account, start the video communication client software, log in to the account, and complete the communication connection between different terminals and the selective forwarding unit service platform. The scene communication establishment subsystem is used to complete communication between different terminals in the active call scene and the incoming call scene with the support of the selective forwarding unit service platform and the network.

[0026] In this embodiment, the three different terminals may include a smartphone, a smart TV or a regular TV connected to a set-top box, and a smart screen speaker; wherein the smart screen speaker has a camera, microphone, network communication module (such as a Wi-Fi module), and data processing capabilities, and a video communication client (smart screen version) is installed on the smart screen speaker; the smart TV or regular TV connected to a set-top box has a network communication module, is able to receive, decode, and play audio and video data, and has a display screen and audio playback device (such as a speaker), and a video communication client (TV version) is installed on the smart TV or set-top box; the smartphone has a camera, microphone, network communication module (such as a Wi-Fi module), and data processing capabilities, and a video communication client (mobile version) is installed on the smartphone.

[0027] This embodiment achieves end-to-end collaboration between the smart screen speaker and the large TV screen, fully leveraging the audio and video capture advantages of the smart screen speaker and the large-screen display advantages of the TV to provide users with a clearer and more immersive large-screen video communication experience. It supports users initiating and answering calls from either the smart TV screen or the smart screen speaker, catering to diverse user operating habits and improving the convenience of video communication operations. By utilizing the selective forwarding unit service to achieve selective forwarding of the video stream, the data transmission path is optimized, reducing data transmission volume and latency, thus improving the stability and smoothness of video communication.

[0028] This embodiment achieves cost reduction by leveraging the collaboration between the smart screen speaker and the large TV screen on the device side, reusing existing equipment hardware; it optimizes transmission efficiency by implementing selective forwarding of video streams based on the selective forwarding unit service; and it supports dual-end call initiation and answering, improving operational flexibility.

[0029] Example 2: Figure 2 As shown, based on Embodiment 1, the terminal communication establishment subsystem provided in this embodiment of the invention includes: The bidirectional channel construction module is used for the TV screen and smart screen speaker to initiate an authentication request to the video communication client software through an encrypted handshake protocol. After successful authentication, a dynamic transmission key is generated. The dynamic transmission key triggers a bidirectional verification mechanism to establish a low-latency data channel. The low-latency data channel has adaptive bandwidth detection characteristics. The heterogeneous terminal function allocation module is used to issue differentiated instruction sets to the TV screen and smart screen speaker by relying on the low-latency data channel: the TV screen activates the high-resolution frame buffer processor to form the data reconstruction capability of the video picture; the smart screen speaker starts the multi-modal sensor array to synchronously generate audio stream data; the TV screen and smart screen speaker realize time domain alignment of acquisition and output through the low-latency data channel clock synchronization mechanism. The integrated module of the composite terminal system is used to form a closed-loop exchange between the reconstructed data stream of the TV screen and the original data stream of the smart screen speaker in a low-latency channel based on the function allocation result; a distributed codec coordinator is embedded so that the data streams of the TV screen and the smart screen speaker are merged into a unified media processing unit after being processed by the cross-device codec pipeline.

[0030] The working principle and beneficial effects of the above technical solution are as follows: The bidirectional channel construction module of this embodiment is used for the TV screen and the smart screen speaker to initiate an authentication request to the video communication client software through an encrypted handshake protocol. After successful authentication, a dynamic transmission key is generated. The dynamic transmission key triggers a bidirectional verification mechanism to establish a low-latency data channel. The low-latency data channel has adaptive bandwidth detection characteristics. The heterogeneous terminal function allocation module is used to issue differentiated instruction sets to the TV screen and the smart screen speaker based on the low-latency data channel: the TV screen activates the high-resolution frame buffer processor to form the data reconstruction capability of the video picture; the smart screen speaker starts the multimodal sensor array to synchronously generate audio stream data. The TV screen and the smart screen speaker achieve time domain alignment of acquisition and output through the low-latency data channel clock synchronization mechanism. The composite terminal system integration module is used to form a closed-loop exchange between the reconstructed data stream of the TV screen and the original data stream of the smart screen speaker in the low-latency channel based on the function allocation result. A distributed codec coordinator is implanted so that the data streams of the TV screen and the smart screen speaker are merged into a unified media processing unit after being processed by the cross-device codec pipeline. The above solution achieves efficient collaboration among heterogeneous terminals. The encrypted transmission system established through the bidirectional channel construction module provides two core capabilities: a dynamic key-based bidirectional authentication mechanism ensures the confidentiality of communication between devices, and adaptive bandwidth detection enables the data channel to have network environment awareness, providing QoS guarantees for subsequent media transmission. The heterogeneous terminal function allocation module enables precise scheduling of device computing power; the large-screen TV focuses on video frame buffering and image reconstruction processing, while the smart screen speaker specializes in multimodal audio stream generation. The clock synchronization mechanism keeps heterogeneous processing latency within a manageable range. In the media fusion processing layer, the composite terminal system integration module constructs a cross-device processing pipeline. Through a distributed codec coordinator, it achieves lossless exchange of video / audio streams between devices, forming a closed-loop data exchange system that ultimately merges the separate media streams into a unified output unit with spatiotemporal consistency.

[0031] In summary, this embodiment, while ensuring communication security, fully leverages the differentiated hardware advantages of heterogeneous terminals and eliminates performance losses caused by multi-device collaboration through precise timing control and distributed processing.

[0032] Example 3: Based on Example 2, the bidirectional channel construction module provided in this embodiment of the invention includes: The initial authentication submodule is used to generate a random chaotic matrix as the initial authentication factor for the TV screen. The initial authentication factor is transformed into an anti-interception pulse signal stream through topological deformation. The smart screen speaker synchronously activates the hardware feature extractor to encode the device's physical fingerprint into an uncopyable oscillation waveform. The key output submodule is used to superimpose the pulse signal stream and the oscillation waveform through the video communication client software to generate a composite carrier with device correlation; the composite carrier triggers the quantized entropy detector, and after verification and screening by the probability cloud, outputs a chaotic key fragment that meets the dynamic threshold. The reversible transformation submodule is used to generate a dynamic transmission key with time constraints from chaotic key fragments through irreversible transformation operations.

[0033] The working principle and beneficial effects of the above technical solution are as follows: The initial authentication submodule of this embodiment generates a random chaotic matrix as an initial authentication factor for the TV screen. The initial authentication factor is transformed into an anti-interception pulse signal stream through topological deformation. The smart screen speaker synchronously activates the hardware feature extractor, encoding the device's physical fingerprint into an uncopyable oscillating waveform. The key output submodule is used to superimpose the pulse signal stream and the oscillating waveform through the spatiotemporal interleaving transmission module of the video communication client software to generate a composite carrier with device correlation. The composite carrier triggers a quantized entropy detector, which, after probability cloud verification and screening, outputs a chaotic key fragment that meets the dynamic threshold. The reversible transformation submodule is used to generate a dynamic transmission key with time constraints by performing an irreversible transformation operation on the chaotic key fragment. The above solution realizes an end-to-end authentication key system with multiple security features: the initial authentication submodule establishes a physical layer security foundation; the TV screen uses a chaotic matrix generation algorithm to generate a random authentication factor; the authentication factor is transformed into an anti-interception pulse signal through topological deformation technology; and the smart screen speaker synchronously extracts hardware fingerprint features and encodes them into an oscillating waveform. The dual physical features provide an unclonable authentication foundation for the system. The key output submodule generates dynamic keys. Pulse signals and oscillating waveforms are superimposed using a spatiotemporal interleaving technique to form a composite carrier containing characteristics of both ends of the device. A quantized entropy detector performs probability filtering, outputting chaotic key fragments that meet dynamic thresholds. The reversible transformation submodule controls key validity by performing irreversible transformations on the chaotic key fragments. The generated dynamic transmission key has time constraints, ensuring short-term key validity.

[0034] In summary, this embodiment establishes a device feature-bound authentication mechanism to achieve intercepted signal transmission, generates dynamically changing session keys to ensure key timeliness and security, and forms a complete two-way authentication key system. Through a combination of technologies such as physical feature extraction, chaotic signal processing, and dynamic key generation, a secure communication channel with features including device authentication, transmission security, and key updates is constructed. The technical integration of each module forms a closed-loop protection, ultimately outputting a dynamic transmission key that meets security requirements.

[0035] Example 4: Based on Example 3, the key output submodule provided in this embodiment of the invention includes: The spectrum output unit is used to phase entangle the phase modulation trajectory of the pulse signal stream with the spectral characteristics of the oscillation waveform, thereby inducing the generation of carrier resonance vortexes. The chaotic fluctuation amplitude of the carrier resonance vortex triggers the energy level transition diagnostic device for quantized entropy detection, and outputs the entropy fluctuation spectrum by measuring the dispersion gradient of the vortex particle swarm. The interval separation unit is used to input the entropy fluctuation spectrum into the dynamic convolutional grid of the probability cloud verifier, and after filtering by the non-local correlation filter, separate the band interval that conforms to the chaotic attractor model. The folding transformation unit is used to subject the separated bandgap regions to topological folding transformation in the threshold compressor. Its collapse product is the chaotic key fragment that satisfies the dynamic stability condition.

[0036] The working principle and beneficial effects of the above technical solution are as follows: The spectrum output unit in this embodiment is used to induce phase entanglement between the phase modulation trajectory of the pulse signal stream and the spectral characteristics of the oscillation waveform, thereby generating a carrier resonance vortex. The chaotic fluctuation amplitude of the carrier resonance vortex triggers the energy level transition diagnostic unit for quantized entropy detection. By measuring the diffusion gradient of the vortex particle swarm, the entropy fluctuation spectrum is output. The interval separation unit inputs the entropy fluctuation spectrum into the dynamic convolution grid of the probability cloud verifier. After filtering by a non-local correlation filter, the band intervals conforming to the chaotic attractor model are separated. The folding transformation unit performs a topological folding transformation on the separated band intervals in a threshold compressor. The collapse product is the chaotic key fragment that satisfies the dynamic stability condition. The key output submodule of the above solution realizes a dynamic key generation mechanism based on quantum properties through the cascaded processing of the three units. The spectrum output unit extracts quantum features. The phase modulation trajectory of the pulse signal and the spectral features of the oscillation waveform become phase entangled, generating a carrier resonant vortex as a quantum state carrier. Energy level transitions are triggered by chaotic fluctuations, and the diffusion gradient of the vortex particle swarm is measured to output an entropy fluctuation spectrum. The interval separation unit performs feature filtering. The entropy fluctuation spectrum is input into a dynamic convolutional raster and verified using a non-local correlation filter to identify band intervals that conform to the chaotic attractor model, ensuring the chaotic characteristics of the key material. The folding transformation unit generates the key. The band interval is input into a threshold compressor and undergoes a topological folding transformation operation. The final key fragment is generated through a collapse effect, and the output meets the dynamic stability requirements.

[0037] In summary, this embodiment establishes a quantum state carrier information carrying mechanism, realizes randomness extraction based on physical entropy sources, completes mathematical modeling verification of chaotic features, ensures the unpredictability of key generation, and forms key fragments that meet dynamic stability requirements. Through techniques such as quantum state manipulation, chaotic feature screening, and topological transformation, the random features of the physical layer are transformed into mathematical key material that can be used for encryption. Each processing stage forms a progressive processing chain, ultimately outputting key fragments with quantum randomness and chaotic characteristics.

[0038] Example 5: Figure 3 As shown, based on Embodiment 1, the account login subsystem provided in this embodiment of the invention includes: The network access initialization module is used to inject network topology parameters into the configuration interface of the smart screen speaker, activate the underlying transmission protocol stack, and form a physical layer connection with the available network base station; it also simultaneously starts the video interaction application and completes the first authentication handshake with the service platform through the account credential verification mechanism. The cross-device account binding module is used when the same network topology parameters are entered in the settings menu of the TV screen. The triggered protocol stack response forms a symmetrical structure with the smart screen speaker. The same account credentials of the smart screen speaker are used to start the authentication handshake and generate an account-level device binding identifier, so that the TV screen and the smart screen speaker are mapped to the same virtual terminal group in the video communication client software. The collaborative channel self-test module is used to send collaborative configuration vectors to the TV screen and smart screen speaker based on the account-level device binding identifier. The collaborative configuration vector triggers the display driver chain of the TV screen and the acquisition sensor loop of the smart screen speaker. The TV screen and smart screen speaker automatically establish a spatiotemporal synchronization verification mechanism through the topology discovery protocol of the service platform and output an end-to-end ready status signal.

[0039] The working principle and beneficial effects of the above technical solution are as follows: The network access initialization module of this embodiment is used to inject network topology parameters into the configuration interface of the smart screen speaker, activate the underlying transmission protocol stack, and form a physical layer connection with the available network base station; synchronously start the video interaction application, and complete the first authentication handshake with the service platform through the account credential verification mechanism; the cross-device account binding module is used to input the same network topology parameters in the settings menu of the TV screen, and the protocol stack response triggered by it forms a symmetrical structure with the smart screen speaker; the same account credentials of the smart screen speaker are used to start the authentication handshake, generate an account-level device binding identifier, and make the TV screen and the smart screen speaker mapped to the same virtual terminal group in the video communication client software; the collaborative channel self-test module is used to send collaborative configuration vectors to the TV screen and the smart screen speaker based on the account-level device binding identifier; the collaborative configuration vector triggers the display driver chain of the TV screen and the acquisition sensor loop of the smart screen speaker, and the TV screen and the smart screen speaker automatically establish a spatiotemporal synchronization verification mechanism through the topology discovery protocol of the service platform, and output an end-to-end ready status signal. The account login subsystem of the above scheme achieves a technical closed loop for multi-terminal collaborative access and management through modular design. The network access initialization module establishes a unified physical layer connection standard and achieves protocol stack homogenization processing for heterogeneous terminals (smart screen speakers / TVs) through parameterized configuration. This design enables devices with different hardware architectures to establish standardized transmission channels based on the same network topology parameters, providing a physical foundation for subsequent account binding. The cross-device account binding module constructs a device-independent authentication system, elevating device binding relationships to the virtual terminal group dimension through the generalization of account credentials; it achieves transparent processing of hardware differences, allowing the server to maintain only logical terminal group identifiers without needing to be aware of specific device types. The collaborative channel self-test module adopts a configuration vector-driven strategy, encapsulating the hardware differences between the display driver (TV) and the acquisition sensor (speaker) into control parameters that can be issued. Through the spatiotemporal synchronization mechanism established by the topology discovery protocol, the timing consistency guarantee of heterogeneous hardware at the application layer is achieved, forming an end-to-end verifiable collaborative ready state.

[0040] In summary, this embodiment constructs a standardized access framework that supports heterogeneous collaboration among multiple terminals through a three-level abstraction of physical layer parameter injection, logical layer credential binding, and application layer vector control; while maintaining the hardware independence of each device, a unified virtual terminal management model is implemented on the server side.

[0041] Example 6: As Figure 4 As shown, based on Embodiment 1, the scenario communication establishment subsystem provided in this embodiment of the invention includes: The cross-terminal operation sensing module is used to receive physical button signals from the TV screen or acoustic or touch signals from the smart screen speaker, encode them into a unified format call request packet, and transmit the call request packet to the background service instruction distribution center through a persistent connection channel. The dual-device collaborative control module is used to retrieve the pre-stored device binding topology based on the account credentials in the call request packet; and execute the device collaborative decision logic. Call up the scene and send a display ready command to the bound TV screen and a collection ready command to the smart screen speaker; In the case of an incoming call, a ringing synchronization command is sent to both ends in parallel; when either end responds to the call, a command to terminate the call is sent to the unresponsive end. The directional media stream distribution module is used to upload the audio and video capture streams from the smart screen speaker to the media distribution node when the device is in a collaborative ready state. The media distribution node performs bidirectional routing, forwarding the local audio and video streams to the contact end; distributing remote video and audio streams to the TV screen; selectively distributing remote audio streams to the smart screen speaker; and the TV screen performs decoding and rendering operations on the received media streams to drive screen display and speaker output.

[0042] The working principle and beneficial effects of the above technical solution are as follows: The cross-terminal operation sensing module in this embodiment is used to receive physical button signals from the TV screen or acoustic or touch signals from the smart screen speaker, and encode them into a call request packet in a unified format; the call request packet is transmitted to the background service instruction distribution center through a persistent connection channel; the dual-device collaborative control module is used to retrieve the pre-stored device binding topology based on the account credentials in the call request packet; execute the device collaborative decision logic; in the outgoing call scenario, a display ready instruction is sent to the bound TV screen, and a collection ready instruction is sent to the smart screen speaker; in the incoming call scenario, a ringing synchronization instruction is sent to both ends in parallel; when either end returns a call response, an instruction termination signal is sent to the non-responding end; the directional media stream distribution module is used to upload the audio and video acquisition stream from the smart screen speaker to the media distribution node in the device collaborative ready state, and the media distribution node performs bidirectional routing to forward the local audio and video stream to the contact end; distributes remote video stream and audio stream to the TV screen; selectively distributes remote audio stream to the smart screen speaker; the TV screen performs decoding and rendering operations on the received media stream, driving the screen display and speaker output. The scenario communication establishment subsystem of the above solution achieves cross-device collaborative communication functionality through modular design. The cross-device operation perception module, through a unified encoding mechanism, transforms heterogeneous input signals (physical buttons / acoustic / touch) into standardized call request packets, eliminating communication barriers caused by device differences; persistent connection channels ensure the real-time and reliable transmission of signaling. The dual-device collaborative control module achieves device topology discovery based on account credentials and dynamically generates control command sets through a decision engine. In outgoing call scenarios, it achieves parallel initialization of display / acquisition devices; in incoming call scenarios, it completes dual-end ringing synchronization and conflict resolution, with the first responding end triggering a termination mechanism. The directional media stream distribution module constructs a hierarchical transmission system: the smart screen speaker acts as the acquisition source, achieving uplink transmission through media distribution nodes; the large TV screen acts as the main presentation device, receiving downlink video streams; the speaker acquires audio streams on demand; the large TV screen integrates decoding and rendering pipelines to complete media presentation.

[0043] In this embodiment, the call-out process is as follows: The user initiates a video communication request by operating the TV screen interface through the TV remote control, or by making voice commands and touch operations on the smart speaker. When the user initiates a call on the TV screen, the TV screen sends the call command to the backend service via the network. When the user initiates a call on the smart speaker, the smart speaker also sends the call command to the backend service. The backend service refers to the connection service that maintains the connection between the client and the server. It is a long-connection protocol, and the TV screen and the smart speaker maintain the connection according to the protocol. After receiving the call command, the backend service determines the device information of the TV screen and the smart speaker that the user is simultaneously connected to according to preset rules, and sends coordination commands to the TV screen and the smart speaker. This enables the large TV screen and smart speaker to work collaboratively. When a user logs in to their account on the large TV screen or smart speaker, the device type under the current account is recorded. The smart speaker activates its camera and microphone to capture local video and audio data, and uploads the captured data to the selective forwarding unit service platform via the network. The selective forwarding unit service platform processes the data and, based on the peer device information, selectively forwards the video stream to the peer contact's device, while simultaneously forwarding the peer contact's audio and video data to the large TV screen and smart speaker. The large TV screen receives and decodes the peer audio and video data, displays the peer video on the screen and plays the audio, and the smart speaker can also play the peer audio as needed, thus achieving video communication.

[0044] The incoming call process is as follows: When a call comes in, if both the TV screen and the smart speaker are online simultaneously, the backend service sends a call notification to both devices, and both devices ring simultaneously to alert the user. The user can answer the call on the TV screen using the remote control or via voice commands or touch controls on the smart speaker. Once either device answers the call, it sends the answer command to the backend service. The backend service then instructs the other device to stop ringing and coordinates a stable communication connection between both devices and the selective forwarding unit service platform, entering video communication mode. The smart speaker collects local audio and video data and uploads it to the selective forwarding unit service platform. The platform then forwards the data to the contact's device and transmits the contact's audio and video data to both the TV screen and the smart speaker. The TV screen displays the video and plays the audio, enabling large-screen video communication.

[0045] In summary, this embodiment achieves dynamic scheduling of cross-device communication resources, forming a closed-loop path of acquisition-transmission-presentation. While ensuring media stream synchronization, it optimizes bandwidth utilization, enabling full media reception on the TV screen / selective reception on the speaker end. The device collaboration logic effectively reduces the complexity of user operations, and the topology binding mechanism maintains the consistency of multiple device states.

[0046] Example 7: Based on Example 6, the dual-device collaborative control module provided in this embodiment of the invention includes: The user-initiated call submodule allows users to open the video communication client software on the TV screen, select a contact on their mobile phone through the application interface using the TV remote control, and touch the call button; or users can call a contact's name through voice commands in front of the smart screen speaker, or select a contact to initiate a call on the smart screen speaker interface. The background service collaboration submodule is used for TV screens or smart screen speakers to send call commands to the background service. After receiving the command, the background service queries the user's device binding information, confirms that the user is simultaneously connected to the TV screen and smart screen speaker devices, and sends collaboration commands to the TV screen and smart screen speaker devices to notify them to prepare to enter the video communication state. The audio and video acquisition and transmission submodule is used to activate the camera and microphone after the smart screen speaker receives the collaborative command, start to acquire local audio and video data, encode the data and upload it to the selective forwarding unit service platform through the network; the selective forwarding unit service platform selectively forwards the video stream according to the device information of the other end contact, and at the same time forwards the audio and video data of the other end contact to the TV screen and the smart screen speaker; The video communication display and playback submodule is used to decode the audio and video data received from the other end after the TV screen receives the data, display the video image of the other end on the screen, and play the audio through the speaker; the smart screen speaker can select to play the audio from the other end according to the settings to realize video communication.

[0047] The working principle and beneficial effects of the above technical solution are as follows: In this embodiment, the user-initiated call submodule is used by the user to open the video communication client software on the TV screen, select a contact on the mobile phone via the TV remote control in the application interface, and touch the call button; or the user can call the contact's name via voice command in front of the smart screen speaker, or select a contact to initiate a call on the smart screen speaker interface; the background service coordination submodule is used by the TV screen or smart screen speaker to send the call command to the background service. After receiving the command, the background service queries the user's device binding information, confirms that the user is simultaneously connected to both the TV screen and the smart screen speaker, and sends a coordination command to the TV screen and the smart screen speaker to notify them to prepare. Upon entering video communication mode, the audio and video acquisition and transmission submodule activates the camera and microphone after the smart screen speaker receives the collaborative command, begins acquiring local audio and video data, encodes the data, and uploads it to the selective forwarding unit service platform via the network. The selective forwarding unit service platform selectively forwards the video stream based on the device information of the peer contact, and simultaneously forwards the peer contact's audio and video data to the TV screen and the smart screen speaker. The video communication display and playback submodule decodes the peer audio and video data received by the TV screen, displays the peer video image on the screen, and plays audio through the speakers. The smart screen speaker, according to its settings, can select to play the peer audio, thus enabling video communication (e.g., ...). Figure 5 (As shown). The above solution's dual-device collaborative control module achieves cross-terminal video communication collaboration through a layered architecture. The user-initiated call submodule supports three interaction methods: remote control touch, voice commands, and screen selection, covering typical input scenarios for both the TV screen and the smart speaker, ensuring that users can initiate call requests through any bound device. The background service collaboration submodule dynamically generates collaboration instruction sets by querying the device binding topology in real time, enabling parallel state switching between the two devices. The TV screen enters the display-ready state, and the smart speaker enters the acquisition-ready state, maintaining consistency between the devices. After the smart speaker completes acquisition and encoding, the audio and video acquisition and transmission submodule uses the selective forwarding unit service platform to achieve intelligent routing of streaming media, forwarding the local audio and video stream to the contact person on the other end, distributing the complete audio and video stream to the TV screen, and distributing the pure audio stream to the smart speaker on demand, optimizing bandwidth allocation. The video communication display and playback submodule completes video decoding and large-screen rendering on the TV screen, leveraging its display advantages; the smart speaker only handles audio output, forming complementary device capabilities.

[0048] In summary, this embodiment establishes an end-to-end collaborative communication link. Through device role division, the large TV screen focuses on presentation, while the smart screen speaker focuses on acquisition, maximizing hardware performance while maintaining a consistent user operation interface. A selective forwarding mechanism reduces redundant data transmission, ensuring precise matching between media streams and device capabilities.

[0049] Example 8: Based on Example 6, the dual-device collaborative control module provided in this embodiment of the invention includes: The incoming call notification submodule is used when the background service detects that the user's TV screen and smart screen speaker are both online when there is an incoming call. It sends an incoming call notification command to the TV screen and smart screen speaker. After receiving the command, the TV screen and smart screen speaker simultaneously start ringing and display the incoming call information on the TV screen and smart screen speaker interface. The call answering operation submodule allows users to answer calls by clicking the answer button on the TV screen using a remote control, by using voice commands on the smart screen speaker, or by touching the answer icon on the smart screen speaker. The answering device sends the answering command to the background service, and after receiving the command, the background service notifies the other device to stop ringing. The video communication establishment submodule is used by the background service to coordinate the establishment of communication connections between the receiving end device, the unanswered end device, and the selective forwarding unit service platform. The smart screen speaker starts to collect local audio and video data and uploads it to the selective forwarding unit service platform. The selective forwarding unit service platform forwards the data to the other end contact device and forwards the audio and video data of the other end contact to the TV screen and the smart screen speaker. The TV screen displays the video and plays the audio, realizing large-screen video communication.

[0050] The working principle and beneficial effects of the above technical solution are as follows: In this embodiment, the incoming call notification submodule is used when the background service detects that both the user's TV screen and smart speaker are online, and sends an incoming call notification command to both. Upon receiving the command, the TV screen and smart speaker simultaneously activate ringing alerts and display the incoming call information on their respective interfaces. The answering operation submodule allows the user to answer the call by clicking the answer button on the TV screen using a remote control, answering via voice command on the smart speaker, or touching the answer icon on the smart speaker. The terminal device sends an answer command to the backend service. Upon receiving the command, the backend service notifies the other terminal device to stop ringing. A video communication establishment submodule coordinates the communication connection between the answering terminal device, the unanswered terminal device, and the selective forwarding unit service platform. The smart screen speaker begins collecting local audio and video data and uploading it to the selective forwarding unit service platform. The platform forwards the data to the contact device and also forwards the contact's audio and video data to the large TV screen and the smart screen speaker. The large TV screen displays the video and plays the audio, enabling large-screen video communication (e.g.,...). Figure 6(As shown). The dual-device collaborative control module of the above solution achieves a seamless cross-terminal communication experience through the linkage of three subsystems; through the dual-terminal online detection mechanism of the TV screen and smart speaker, it ensures that devices in different locations in the home can synchronously sense the incoming call status; the parallel triggering design of dual-end ringing eliminates the risk of missing calls on a single device; it provides physical buttons on the remote control (TV screen); supports voice commands (smart speaker); and retains touch interaction (smart speaker interface), covering the operating preferences of different user groups; the ringing of unanswered devices is immediately terminated after the answer command is triggered, and the intelligent routing mechanism of the selective forwarding unit service platform jointly realizes the dynamic allocation of network bandwidth and terminal computing resources; the TV screen leverages its large screen advantage to focus on video presentation, while the smart speaker undertakes the audio and video acquisition function; forming a functionally complementary architecture between devices.

[0051] In summary, this embodiment establishes a technical framework for cross-terminal collaborative communication. Through technologies such as device status awareness, command routing optimization, and intelligent media stream distribution, it achieves system-level collaborative effects while maintaining the independent functions of each device.

[0052] Example 9: As Figure 7 As shown, based on Embodiments 1-8, the method for video communication on a large TV screen via a smart screen speaker provided by this invention includes the following steps: S100: Provides video communication client software installation versions that are compatible with at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. S200: Completes network connection between different terminals under the same account, starts video communication client software, logs in to the account, and completes communication connection between different terminals and the selective forwarding unit service platform; S300: With the support of the selective forwarding unit service platform and network, it enables communication between different terminals in both outgoing call and incoming call scenarios.

[0053] The working principle and beneficial effects of the above technical solution are as follows: This embodiment first provides an installation version of video communication client software adapted to at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account; secondly, it completes the network connection between different terminals under the same account, starts the video communication client software, logs in to the account, and completes the connection between different terminals and the selective forwarding unit service platform (the principle of which is described in the appendix). Figure 8The above solution establishes a communication connection between different terminals; finally, with the support of the selective forwarding unit service platform and network, communication is completed between different terminals in both outgoing call and incoming call scenarios. The core of this solution, which uses smart speakers to achieve large-screen video communication on televisions, lies in building a cross-terminal, highly compatible real-time audio and video communication system. It realizes a heterogeneous terminal interconnection system, achieving terminal type independence through multiple versions of client software, overcoming hardware difference limitations; and establishes a standardized communication link based on the same account system, enabling heterogeneous devices such as smart speakers, mobile terminals, and televisions to form logically unified communication nodes, achieving terminal abstraction. The selective forwarding unit service platform achieves end-to-end low-latency connections.

[0054] This embodiment specifically involves technologies such as audio and video acquisition and display collaboration, network communication protocols, and real-time audio and video processing (SFU service), and is applicable to video communication scenarios in the home smart device ecosystem. Expandable technical fields include: (1) Smart home device linkage (such as collaborative communication between smart screens and projectors, and smart screens and computer monitors); (2) Multi-device audio and video collaboration in enterprise meeting scenarios (such as large-screen communication between conference tablets and smart terminals).

[0055] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of equivalents of this invention, this invention is also intended to include these modifications and variations.

Claims

1. A system for enabling video communication on a large television screen via a smart screen speaker, characterized in that, Include: The terminal communication establishment subsystem is used to provide video communication client software installation versions that are compatible with at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. The account login subsystem is used to complete the network connection of different terminals under the same account, start the video communication client software, log in to the account, and complete the communication connection between different terminals and the selective forwarding unit service platform; The account login subsystem generates an account-level device binding identifier, enabling the large TV screen and the smart screen speaker to be mapped to the same virtual terminal group in the video communication client software; Based on the account-level device binding identifier, the service platform sends collaborative configuration instructions to the TV screen and smart screen speaker for hardware scheduling. The scenario communication establishment subsystem is used to complete communication between different terminals in both outgoing call and incoming call scenarios, with the support of the selective forwarding unit service platform and network. The scene communication establishment subsystem includes a dual-device collaborative control module and a directional media stream distribution module; The dual-device collaborative control module is used to retrieve the pre-stored device binding topology based on the account credentials in the call request packet, execute the device collaborative decision logic, and send a display ready command to the bound TV screen and a collection ready command to the smart screen speaker in the outgoing call scenario. The targeted media stream distribution module is used to upload the collected local audio and video streams to the selective forwarding unit service platform by the smart screen speaker when the device is in a collaborative ready state. The selective forwarding unit service platform performs bidirectional routing settings: forwarding the local audio and video stream to the peer contact's terminal; distributing the peer contact's video and audio streams to the large TV screen, where the large TV screen performs decoding and rendering operations on the received media streams to drive screen display and speaker output; for the smart screen speaker, not distributing the peer contact's video stream, but selectively distributing the peer contact's pure audio stream to the smart screen speaker, where the smart screen speaker plays the peer's audio.

2. The system for video communication on a large TV screen via a smart screen speaker as described in claim 1, characterized in that, The account login subsystem includes: The network access initialization module is used to inject network topology parameters into the configuration interface of the smart screen speaker, activate the underlying transmission protocol stack, and form a physical layer connection with the available network base station; it also simultaneously starts the video interaction application and completes the first authentication handshake with the service platform through the account credential verification mechanism. The cross-device account binding module is used when the same network topology parameters are entered in the settings menu on the TV screen; it uses the same account credentials as the smart screen speaker to initiate the authentication handshake and generate an account-level device binding identifier.

3. The system for video communication on a large TV screen via a smart screen speaker as described in claim 2, characterized in that, The collaborative configuration command triggers the display driver chain of the TV screen and the acquisition sensor loop of the smart screen speaker. The TV screen and the smart screen speaker automatically establish a timing consistency verification mechanism through the topology discovery protocol of the service platform and output an end-to-end ready status signal.

4. The system for video communication on a large TV screen via a smart screen speaker as described in claim 1, characterized in that, The scene communication establishment subsystem also includes: The cross-device operation sensing module is used to receive physical button signals from the TV screen or acoustic or touch signals from the smart screen speaker, encode them into a unified format call request packet, and transmit the call request packet to the background service instruction distribution center through a persistent connection channel.

5. The system for video communication on a large TV screen via a smart screen speaker as described in claim 4, characterized in that, In the case of an incoming call, a ringing synchronization command is sent to both ends in parallel; when either end responds, a termination signal is sent to the unresponsive end.

6. The system for video communication on a large TV screen via a smart screen speaker as described in claim 5, characterized in that, The dual-device collaborative control module includes: The user-initiated call submodule allows users to open the video communication client software on the TV screen, select a contact on their mobile phone through the application interface using the TV remote control, and touch the call button; or users can call a contact's name through voice commands in front of the smart screen speaker, or select a contact to initiate a call on the smart screen speaker interface. The background service collaboration submodule is used for TV screens or smart screen speakers to send call commands to the background service. After receiving the command, the background service queries the user's device binding information, confirms that the user is simultaneously connected to the TV screen and smart screen speaker devices, and sends collaboration commands to the TV screen and smart screen speaker devices to notify them to prepare to enter the video communication state. The audio and video acquisition and transmission submodule is used to activate the camera and microphone after the smart screen speaker receives the collaborative command, start to collect local audio and video data, encode the data and upload it to the selective forwarding unit service platform via the network; The video communication display and playback submodule is used to decode the audio and video data received from the other end after the TV screen receives the data, display the video image of the other end on the screen, and play the audio through the speakers. The smart speaker can be set to play audio from the other end, enabling video communication.

7. The system for video communication on a large TV screen via a smart screen speaker as described in claim 5, characterized in that, The dual-device collaborative control module also includes: The incoming call notification submodule is used when the background service detects that the user's TV screen and smart screen speaker are both online when there is an incoming call. It sends an incoming call notification command to the TV screen and smart screen speaker. After receiving the command, the TV screen and smart screen speaker simultaneously start ringing and display the incoming call information on the TV screen and smart screen speaker interface. The answer operation submodule is used by users to answer calls by clicking the answer button on the TV screen with a remote control, or by answering calls through voice commands on the smart screen speaker, or by touching the answer icon on the smart screen speaker. The answering device that has performed the answer operation sends the answer command to the background service. After receiving the command, the background service notifies the unanswered devices under the same account that have not performed the answer operation to stop ringing. The video communication establishment submodule is used to coordinate the establishment of communication connections between the receiving end device that has performed the answering operation, the unanswered device under the same account that has not performed the answering operation, and the selective forwarding unit service platform; the smart screen speaker begins to collect local audio and video data and upload it to the selective forwarding unit service platform.

8. A method for achieving video communication on a large TV screen using a smart screen speaker, characterized in that, Includes the following steps: Provide video communication client software installation versions that are compatible with at least three different terminals. The video communication client software is used to establish communication connections between different terminals under the same account. Complete network connections between different terminals under the same account, start the video communication client software, log in to the account, and complete the communication connection between different terminals and the selective forwarding unit service platform; Generate an account-level device binding identifier so that the TV screen and smart screen speaker are mapped to the same virtual terminal group in the video communication client software; Based on the account-level device binding identifier, the service platform sends collaborative configuration instructions to the TV screen and smart screen speaker for hardware scheduling. With the support of the selective forwarding unit service platform and network, communication in both outgoing and incoming call scenarios is completed between different terminals. The specific steps include: Based on the account credentials in the call request packet, retrieve the pre-stored device binding topology, execute the device collaborative decision logic, and in the outgoing call scenario, send a display ready command to the bound TV screen and a collection ready command to the smart screen speaker; In the device collaboration ready state, the smart screen speaker uploads the collected local audio and video streams to the selective forwarding unit service platform; The selective forwarding unit service platform performs bidirectional routing settings: forwarding the local audio and video stream to the peer contact's terminal; distributing the peer contact's video and audio streams to the large TV screen, where the large TV screen performs decoding and rendering operations on the received media streams to drive screen display and speaker output; for the smart screen speaker, not distributing the peer contact's video stream, but selectively distributing the peer contact's pure audio stream to the smart screen speaker, where the smart screen speaker plays the peer's audio.

Images