System and method for realizing video communication on large television screen through intelligent screen sound box
By using a collaborative system between the smart screen speaker and the TV, the problems of small screen size and high latency in existing technologies have been solved, enabling efficient, stable, and convenient operation of large-screen video communication and improving the user experience.
Patent Information
- Application Number
- CN202510987766.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-07-17
- Publication Date
- 2025-10-24
AI Technical Summary
In the existing technology, smart speakers and TV devices have problems such as small screen size, limited adaptation of audio and video acquisition hardware functions, high cross-device communication latency, and lack of end-side collaborative control during video communication, resulting in a poor user experience.
Through the collaborative system between the smart screen speaker and the TV, terminal communication establishment, account login, and scene communication establishment are realized. It supports the installation of video communication client software on various terminal devices, and uses the selective forwarding unit service platform to selectively forward and coordinate control audio and video data, thereby optimizing the data transmission path.
It enables end-to-end collaboration between the smart screen speaker and the TV, giving full play to their respective advantages to provide users with a clear and immersive large-screen video communication experience, supporting diverse operating habits, reducing data transmission volume and latency, and improving the stability and smoothness of video communication.
Smart Images

Figure CN120835125A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of intelligent device communication, and particularly relates to a system and method for realizing video communication on a large television screen through an intelligent screen sound box. BACKGROUND
[0002] Video communication converts dynamic pictures and audio signals into digital data packets through compression and encoding technology, transmits them in the Internet through network protocols, and finally reweaves them into a coherent audio-visual experience on the terminal device. With the continuous development and progress of technology, its application field is constantly expanding, covering social communication, education, medical treatment, enterprise communication, public security, live broadcast e-commerce and other fields; in the field of education, it promotes the development of online education; in the field of medical treatment, it promotes the popularization of telemedicine; in the field of enterprise communication, it improves the efficiency of communication and cooperation; in the field of public security, it is used for emergency response and monitoring; in the field of live broadcast e-commerce, it innovates marketing mode. The existing technical solutions are usually independent video communication of intelligent sound box or video call through external USB camera of television, which has defects such as small screen size of intelligent screen, limited performance of end-side collaborative control and high delay of cross-device communication. In recent years, the field of video communication has developed rapidly, and significant progress has been made in technical innovation, market expansion and application scenario extension. In the future, it will continue to move towards the direction of intelligence, integration and popularization.
[0003] The existing technology one is mainly independent video communication through intelligent sound box, such as Amazon Echo Show and Xiaodu intelligent screen; relying on the screen and camera of the intelligent sound box, it realizes independent video call, which is convenient to operate and does not need additional equipment. The screen of the intelligent sound box is usually 7-10 inches, which is much smaller than the television or display, affecting the viewing experience of multiple people; limited by cost, the camera, speaker and microphone of the intelligent screen have low specifications, and the picture quality, sound quality and sound pickup ability are limited; some brands (such as Echo Show) only support their own communication protocol, and have poor cross-platform compatibility.
[0004] The existing technology two is mainly video call through external camera of television, such as smart television + USB camera; using the computing power of the smart television, the external camera realizes large-screen video call, which is suitable for home scenarios. It is necessary to purchase a compatible camera separately, and the television usually has no built-in high-sensitivity microphone, which needs to be configured additionally, increasing the cost and wiring complexity; the USB interface protocols and driver support of different brands of televisions are uneven, which may cause compatibility failure; the video call interface of the television remote control is not intuitive enough, and lacks the smooth experience of touch or voice control.
[0005] The prior art three, through the mobile phone screen projection video call, such as WeChat / DingDing screen projection to the TV; the mobile phone as the main equipment handles audio and video codec, and the TV is only used as a display terminal, temporarily solves the demand of large screen. The mobile phone needs to keep running state all the way, and the background application may interrupt the call; screen projection depends on Wi-Fi transmission, and secondary coding leads to increased delay (usually more than 200ms), and the picture quality is obviously compressed; the TV cannot directly call the camera or microphone, and cannot realize the end-side collaborative optimization, such as echo cancellation of TV loudspeaker and mobile phone microphone.
[0006] At present, the prior art one, the prior art two and the prior art three have the problems that the TV and the set top box have no audio and video collection hardware, the screen of the smart screen is small, the function adaptation of the audio and video collection hardware and the screen is limited, and the user experience is reduced; the traditional screen projection scheme does not realize end-side collaborative control, and cannot directly answer and hang up on the TV end; and there is no efficient video stream forwarding mechanism, and the cross-device communication delay is high. Therefore, the present application provides a system and method for realizing video communication on a large TV screen through a smart screen sound box. SUMMARY
[0007] In order to solve the above technical problems, the present application provides a system for realizing video communication on a large TV screen through a smart screen sound box, comprising:
[0008] A terminal communication establishment subsystem is used to provide at least three different terminal video communication client software installation versions, and the video communication client software is used to establish communication connection between different terminals under the same account;
[0009] An account login subsystem is used to complete network connection of different terminals under the same account, start the video communication client software, perform account login, and complete communication connection between different terminals and the selective forwarding unit service platform;
[0010] A scene communication establishment subsystem is used to complete communication in the active call-out scene and the incoming call scene between different terminals under the support of the selective forwarding unit service platform and the network.
[0011] Optionally, the account login subsystem comprises:
[0012] A network access initialization module is used to inject network topology parameters in the configuration interface of the smart screen sound box terminal, activate the bottom layer transmission protocol stack, form a physical layer connection with the available network base station, and synchronously start the video interaction application to complete the first authentication handshake with the service platform through the account certificate verification mechanism;
[0013] A cross-device account binding module is configured to trigger a protocol stack of the television terminal to form a symmetrical structure with the smart screen sound box terminal in response to inputting the same network topology parameters in a setting menu; start an authentication handshake using the same account credentials of the smart screen sound box terminal to generate an account-level device binding identifier, and map the television terminal and the smart screen sound box terminal to the same virtual terminal group in a video communication client software.
[0014] A cooperative channel self-checking module is configured to distribute a cooperative configuration vector to the television terminal and the smart screen sound box terminal based on the account binding identifier.
[0015] Optionally, the cooperative configuration vector of the cooperative channel self-checking module triggers a display driving chain of the television terminal and a sensing and collecting ring of the smart screen sound box terminal, and the television terminal and the smart screen sound box terminal automatically establish a time and space synchronization checking mechanism through a topology discovery protocol of the service platform to output an end-to-end ready state signal.
[0016] Optionally, the scene communication establishing subsystem comprises:
[0017] A cross-terminal operation sensing module is configured to receive a television terminal physical button signal or a smart screen terminal acoustic or touch signal, encode the signal into a call request packet in a unified format, and transmit the call request packet to a background service instruction distribution hub through a persistent connection channel.
[0018] A dual-device cooperative control module is configured to retrieve a pre-stored device binding topology according to an account identifier in the call request packet, and execute a device cooperative decision logic.
[0019] A directional media stream distribution module is configured to transmit an audio and video collecting stream of the smart screen sound box terminal to a media distribution node in a device cooperative ready state, and perform bidirectional routing by the media distribution node to forward an audio and video stream of the terminal to a contact terminal, distribute a remote video stream and an audio stream to the television terminal, and selectively distribute a remote audio stream to the smart screen terminal; and the television terminal performs a decoding and rendering operation on the received media stream to drive screen display and speaker output.
[0020] Optionally, the dual-device cooperative control module comprises:
[0021] Optionally, the dual-device cooperative control module comprises:
[0022] The user initiates a call sub-module, which is used for the user to open a video communication application on the television end, to select a contact on a mobile phone end in an application interface through a television remote control, and to touch a call button; or the user is in front of a smart screen sound box terminal, calls a contact name through a voice instruction, or selects a contact on a smart screen sound box end interface to initiate a call;
[0023] A background service coordination sub-module is used for the television end or the smart screen sound box end to send a call instruction to a background service. After the background service receives the instruction, the user equipment binding information is queried, the television end and the smart screen sound box end equipment connected by the user are confirmed, a coordination instruction is sent to the television end and the smart screen sound box end, and the television end and the smart screen sound box end equipment are notified to prepare to enter a video communication state.
[0024] An audio and video collection and transmission sub-module is used for the smart screen sound box end to start a camera and a microphone after receiving the coordination instruction, to start collecting local audio and video data, to encode the data, and to upload the data to a selective forwarding service platform through a network.
[0025] A video communication display and playing sub-module is used for the television end to receive audio and video data of the opposite end, to perform decoding processing, to display a video picture of the opposite end on a large screen, and to play audio through a loudspeaker; and the smart screen sound box end can select to play audio of the opposite end according to a setting, to realize video communication.
[0026] Optionally, the selective forwarding service platform of the audio and video collection and transmission sub-module selectively forwards a video stream according to device information of a contact of the opposite end, and forwards audio and video data of the contact of the opposite end to the television end and the smart screen sound box end.
[0027] Optionally, the dual-equipment coordination control module further comprises:
[0028] A call notification sub-module is used for the background service to detect that the television end and the smart screen sound box end of the user are both in an online state when there is an incoming call, to send a call notification instruction to the television end and the smart screen sound box end, and to display call information on a television screen and a smart screen sound box interface after the television end and the smart screen sound box end receive the instruction and simultaneously start a ring prompt.
[0029] An answering operation sub-module is used for the user to click an answering button on the television end through a remote control, to answer through a voice instruction on the smart screen sound box end, or to touch an answering icon on the smart screen sound box to perform an answering operation; the answering end equipment sends an answering instruction to the background service, and the background service receives the instruction and notifies the other end equipment to stop the ring.
[0030] A video communication establishment sub-module is used for the background service to coordinate the answering end equipment, the un-answering end equipment, and the selective forwarding service platform to establish a communication connection; and the smart screen sound box end starts to collect local audio and video data and uploads the data to the selective forwarding service platform.
[0031] Optionally, the selective forwarding service platform of the video communication establishment sub-module forwards the data to the opposite contact device, and forwards the audio and video data of the opposite contact to the television end and the smart screen sound box end, the television end displays the video picture and plays the audio on the large screen, and the large screen video communication is realized.
[0032] The application provides a method for realizing video communication on a large screen of a television through a smart screen sound box, and the method comprises the following steps:
[0033] Providing video communication client software installation versions adapted to at least three different terminals, the video communication client software being used to establish communication connections of different terminals under the same account;
[0034] Completing network connections of different terminals under the same account, starting the video communication client software, performing account login, and completing communication connections of different terminals and the selective forwarding unit service platform;
[0035] Under the support of the selective forwarding unit service platform and the network, communication in active call-out scenes and incoming call scenes between different terminals is completed.
[0036] The application realizes end-side cooperation of the smart screen sound box and the television end, fully utilizes the audio and video collection advantages of the smart screen sound box and the large screen display advantages of the television, and provides clearer and more immersive large screen video communication experiences for users.
[0037] Other features and advantages of the present application will be further described in the following description, and become apparent from the description, or be learned through implementation of the present application. The objectives and other advantages of the present application can be achieved and obtained by the structures particularly pointed out in the written description and the accompanying drawings.
[0038] The technical solutions of the present application will be further described in detail below with the help of the accompanying drawings and examples. BRIEF DESCRIPTION OF DRAWINGS
[0039] The accompanying drawings are used to provide further understanding of the present application, and constitute a part of the specification, and are used to explain the present application together with embodiments of the present application, and do not constitute a limitation to the present application. In the drawings:
[0040] Figure 1 It is a system block diagram for realizing video communication on a large screen of a television through a smart screen sound box in embodiment 1 of the present application.
[0041] Figure 2 Account login subsystem block diagram for embodiment 2 of the present application;
[0042] Figure 3 Account login subsystem block diagram for embodiment 3 of the present application;
[0043] Figure 4 Scenario communication establishment subsystem block diagram for embodiment 6 of the present application;
[0044] Figure 5 Call-out scenario schematic diagram for embodiment 7 of the present application;
[0045] Figure 6 Call-in scenario schematic diagram for embodiment 8 of the present application;
[0046] Figure 7 Method flowchart for realizing video communication on a large TV screen through a smart screen sound box in embodiment 9 of the present application;
[0047] Figure 8 Selective forwarding unit service platform schematic diagram in embodiment 9 of the present application. DETAILED DESCRIPTION
[0048] The preferred embodiments of the present application will be described herein below with reference to the drawings, in which it should be understood that the preferred embodiments described herein are intended to illustrate and explain the present application, and are not intended to limit the present application.
[0049] The terms used in the present application are merely for the purpose of describing specific embodiments, and are not intended to limit the present application. As used in the present application, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0050] The following description refers to the accompanying drawings. In the following description, same numbers in different drawings represent same or similar elements unless otherwise represented. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of apparatuses and methods consistent with some aspects of the present application. In the description of the present application, it should be understood that the terms "first", "second", "third", etc. are merely used to distinguish similar objects, and do not necessarily indicate a specific order or sequence, nor can they be understood as indicating or implying relative importance. The specific meanings of the above terms in the present application can be understood by those of ordinary skill in the art according to specific circumstances.
[0051] Embodiment 1: as Figure 1As shown, the embodiment of the present application provides a system for realizing video communication on a large TV screen through an intelligent screen sound box, comprising:
[0052] A terminal communication establishing subsystem is configured to provide video communication client software installation versions adapted to at least three different terminals, and the video communication client software is used to establish communication connections of different terminals under the same account;
[0053] An account login subsystem is configured to complete network connections of different terminals under the same account, start the video communication client software, perform account login, and complete communication connections of different terminals and the selective forwarding unit service platform;
[0054] A scene communication establishing subsystem is configured to complete communication under active call-out scenes and incoming call scenes between different terminals under the support of the selective forwarding unit service platform and the network.
[0055] The working principle and beneficial effects of the above technical solution are as follows: the terminal communication establishing subsystem of the embodiment is configured to provide video communication client software installation versions adapted to at least three different terminals, and the video communication client software is used to establish communication connections of different terminals under the same account; the account login subsystem is configured to complete network connections of different terminals under the same account, start the video communication client software, perform account login, and complete communication connections of different terminals and the selective forwarding unit service platform; and the scene communication establishing subsystem is configured to complete communication under active call-out scenes and incoming call scenes between different terminals under the support of the selective forwarding unit service platform and the network.
[0056] In the embodiment, the three different terminals can include a smart phone, a smart TV or a normal TV connected with a set-top box, and a smart screen sound box; the smart screen sound box is provided with a camera, a microphone, a network communication module (such as a Wi-Fi module) and data processing capability, and a video communication client (a smart screen version) is installed on the smart screen sound box; the smart TV or the normal TV connected with the set-top box is provided with a network communication module, can receive, decode and play audio and video data, and is provided with a display screen and an audio playing device (such as a loudspeaker), and a video communication client (a TV version) is installed on the smart TV or the set-top box; and the smart phone is provided with a camera, a microphone, a network communication module (such as a Wi-Fi module) and data processing capability, and a video communication client (a mobile phone version) is installed on the smart phone.
[0057] This embodiment achieves end-to-end collaboration between the smart screen speaker and the TV, leveraging the audio and video acquisition advantages of the smart screen speaker and the large-screen display advantages of the TV, providing users with a clearer and more immersive large-screen video communication experience. It supports users to initiate and answer calls on either the smart TV or the smart screen speaker, meeting users' diverse operating habits and improving the convenience of video communication operations. The selective forwarding unit service enables selective forwarding of video streams, optimizes the data transmission path, reduces data transmission volume and latency, and improves the stability and fluency of video communication.
[0058] This embodiment reduces costs by reusing existing equipment hardware through end-side collaboration between the smart screen speaker and the TV. It implements selective forwarding of video streams based on the selective forwarding unit service to optimize transmission efficiency. It supports dual-end initiation and reception of calls to enhance operational flexibility.
[0059] Example 2: Figure 2 As shown, based on Example 1, the terminal communication establishment subsystem provided in this embodiment of the present invention includes:
[0060] The two-way channel construction module is used by the TV terminal and the smart screen speaker terminal to initiate authentication requests to the video communication client software through the encrypted handshake protocol. After the authentication is passed, a dynamic transmission key is generated. The dynamic transmission key triggers the two-way verification mechanism to establish a low-latency data channel. The low-latency data channel has an adaptive bandwidth detection feature.
[0061] The heterogeneous terminal function allocation module is used to issue differentiated instruction sets to TV terminals and smart screen speaker terminals based on low-latency data channels. The TV terminal activates the high-resolution frame buffer processor to form the data reconstruction capability of the video image; the smart screen speaker terminal activates the multimodal sensor array to synchronously generate audio stream data. The TV terminal and the smart screen speaker terminal achieve time domain alignment of acquisition and output through the low-latency data channel clock synchronization mechanism.
[0062] The composite terminal system integration module is used to form a closed-loop exchange between the reconstructed data stream of the TV terminal and the original data stream of the smart screen speaker terminal in a low-latency channel based on the function allocation results; a distributed codec coordinator is implanted to enable the data streams of the TV terminal and the smart screen speaker terminal to be processed by the cross-device codec pipeline and then integrated into a unified media processing unit.
[0063] The working principle and beneficial effects of the technical solution are as follows: The bidirectional channel construction module of the embodiment is used to initiate an authentication request to the video communication client software by the television terminal and the smart screen audio box terminal through an encrypted handshake protocol, and a dynamic transmission key is generated after the authentication is passed; the dynamic transmission key triggers a bidirectional verification mechanism to establish a low-delay data channel; the low-delay data channel has an adaptive bandwidth detection feature; the heterogeneous terminal function distribution module is used to distribute a differentiated instruction set to the television terminal and the smart screen audio box terminal based on the low-delay data channel: the television terminal activates a high-resolution frame buffer processor to form the data reconstruction capability of a video picture; the smart screen audio box terminal starts a multi-modal sensing array to synchronously generate data of an audio stream; the television terminal and the smart screen audio box terminal realize time domain alignment of acquisition and output through a low-delay data channel clock synchronization mechanism; the composite terminal system integration module is used to form a closed loop exchange of the reconstructed data stream of the television terminal and the original data stream of the smart screen audio box terminal in the low-delay channel based on the function distribution result; and a distributed codec coordinator is implanted, so that the data streams of the television terminal and the smart screen audio box terminal are fused into a unified media processing unit after being processed through a cross-device codec pipeline. The above scheme realizes efficient cooperation of heterogeneous terminals; the encrypted transmission system established by the bidirectional channel construction module provides two core capabilities for the system: a bidirectional authentication mechanism based on a dynamic key ensures the confidentiality of communication between devices, and adaptive bandwidth detection enables the data channel to have network environment perception capability, providing QoS guarantee for subsequent media transmission. The heterogeneous terminal function distribution module realizes precise scheduling of device computing power, the television terminal focuses on video frame buffer and picture reconstruction processing, and the smart screen audio box terminal specializes in multi-modal audio stream generation, and the clock synchronization mechanism controls the heterogeneous processing delay within a coordinatable range. The media fusion processing layer, the composite terminal system integration module constructs a cross-device processing pipeline, realizes lossless exchange of video / audio streams between devices through the distributed codec coordinator, forms a closed loop data exchange system, and finally fuses the separated media streams into a unified output unit with consistent space-time.
[0064] In summary, under the premise of ensuring communication security, the embodiment not only fully utilizes the differentiated hardware advantages of heterogeneous terminals, but also eliminates the performance loss caused by multi-device cooperation through precise time control and distributed processing.
[0065] Embodiment 3: Based on embodiment 2, the bidirectional channel construction module provided by the embodiment of the application comprises:
[0066] An initial authentication submodule is configured to generate a random chaotic matrix as an initial authentication factor by the television terminal, and the initial authentication factor is deformed in topology to form an anti-interception pulse signal stream; and the smart screen audio box terminal is configured to activate a hardware feature extractor to encode a device physical fingerprint into a non-reproducible oscillation waveform;
[0067] The key output submodule is configured to superimpose the pulse signal stream and the oscillation waveform through a video communication client software to generate a composite carrier with device correlation; the composite carrier triggers a quantumized entropy value detector, and after being screened by a probability cloud, outputs a chaotic key segment meeting a dynamic threshold value;
[0068] The reversible transformation submodule is configured to generate a dynamic transmission key with time constraint through a non-reversible transformation operation on the chaotic key segment.
[0069] The working principle and beneficial effects of the above technical solution are as follows: the initial authentication submodule of the embodiment is configured to generate a random chaotic matrix as an initial authentication factor by a television terminal, and the initial authentication factor is formed into an anti-interception pulse signal stream through topological deformation; a smart screen sound box terminal synchronously activates a hardware feature extractor to encode a device physical fingerprint into an uncopyable oscillation waveform; the key output submodule is configured to superimpose the pulse signal stream and the oscillation waveform through a space-time interleaving transmission module of a video communication client software to generate a composite carrier with device correlation; the composite carrier triggers a quantumized entropy value detector, and after being screened by a probability cloud, outputs a chaotic key segment meeting a dynamic threshold value; and the reversible transformation submodule is configured to generate a dynamic transmission key with time constraint through a non-reversible transformation operation on the chaotic key segment. The above solution realizes an end-to-end authentication key system with multiple security features: the initial authentication submodule establishes a physical layer security foundation, a television terminal generates a random authentication factor by a chaotic matrix generation algorithm, and the authentication factor is converted into an anti-interception pulse signal through topological deformation technology; a smart screen sound box terminal synchronously extracts hardware fingerprint features and encodes them into oscillation waveforms, and double physical features provide unclonable authentication basis for the system. The key output submodule realizes dynamic key generation, the pulse signal and the oscillation waveform are superimposed through space-time interleaving technology to form a composite carrier containing device features of both ends, a quantumized entropy value detector performs probability screening to output a chaotic key segment meeting a dynamic threshold value. The reversible transformation submodule completes time constraint control on the key, implements a non-reversible transformation on the chaotic key segment, and generates a dynamic transmission key with time constraint, thereby ensuring short-term effectiveness of the key.
[0070] In summary, the embodiment establishes an authentication mechanism of device feature binding, realizes anti-interception signal transmission, generates a dynamically changing session key, guarantees time safety of the key, and forms a complete bidirectional authentication key system; through technical combinations such as physical feature extraction, chaotic signal processing, and dynamic key generation, a secure communication channel with device authentication, transmission security, and key update features is constructed. The technologies of the modules are connected to form a closed loop protection, and finally a dynamic transmission key meeting safety requirements is output.
[0071] In the embodiment 3, the key output submodule provided by the embodiment of the application comprises:
[0072] The atlas output unit is used for phase entanglement of a phase modulation track of a pulse signal stream and a frequency spectrum feature of an oscillation waveform, and is used for inducing a carrier resonance vortex; a chaotic fluctuation amplitude of the carrier resonance vortex triggers an energy level transition determinator of quantumized entropy value detection, and an entropy value fluctuation atlas is output by measuring a dispersion gradient of a vortex particle group;
[0073] The interval separation unit is used for separating an energy band interval conforming to a chaotic attractor model from a dynamic convolution grid of the entropy value fluctuation atlas input into a probability cloud verifier after filtering by a non-local correlation sieve;
[0074] The folding transformation unit is used for topological folding transformation of the separated energy band interval in a threshold compressor, and a chaotic key fragment meeting a dynamic stability condition is obtained as a collapse product.
[0075] The working principle and beneficial effects of the technical solution are as follows: the atlas output unit is used for phase entanglement of a phase modulation track of a pulse signal stream and a frequency spectrum feature of an oscillation waveform, and is used for inducing a carrier resonance vortex; a chaotic fluctuation amplitude of the carrier resonance vortex triggers an energy level transition determinator of quantumized entropy value detection, and an entropy value fluctuation atlas is output by measuring a dispersion gradient of a vortex particle group; the interval separation unit is used for separating an energy band interval conforming to a chaotic attractor model from a dynamic convolution grid of the entropy value fluctuation atlas input into a probability cloud verifier after filtering by a non-local correlation sieve; and the folding transformation unit is used for topological folding transformation of the separated energy band interval in a threshold compressor, and a chaotic key fragment meeting a dynamic stability condition is obtained as a collapse product. The key output sub-module realizes a dynamic key generation mechanism based on quantum characteristics through cascade processing of the three units. The atlas output unit completes quantum characteristic extraction, phase entanglement of a phase modulation track of a pulse signal and a frequency spectrum feature of an oscillation waveform, generates a carrier resonance vortex as a quantum state carrier, triggers energy level transition determination by a chaotic fluctuation amplitude, and measures a dispersion gradient of a vortex particle group to output an entropy value fluctuation atlas. The interval separation unit realizes feature screening, inputs an entropy value fluctuation atlas into a dynamic convolution grid, performs probability cloud verification by a non-local correlation sieve, and screens an energy band interval conforming to a chaotic attractor model to ensure chaotic characteristics of key materials. The folding transformation unit completes key generation, inputs an energy band interval into a threshold compressor, performs topological folding transformation, generates a final key fragment by a collapse effect, and outputs a key meeting dynamic stability requirements.
[0076] In summary, the embodiment establishes an information bearing mechanism of quantum state carrier, realizes randomness extraction based on physical entropy source, completes mathematical modeling verification of chaotic characteristics, ensures unpredictability of key generation, and forms key fragments meeting dynamic stability requirements. Through quantum state manipulation, chaotic characteristic screening, topological transformation and other technical means, the random characteristics of the physical layer are converted into mathematical key materials that can be used for encryption. Each processing link forms a progressive processing link, and finally outputs key fragments with quantum randomness and chaotic characteristics.
[0077] Embodiment 5: as shown in Figure 3 Based on the embodiment 1, the account login subsystem provided by the embodiment of the application comprises:
[0078] The network access initialization module is configured to inject network topology parameters into the configuration interface of the smart screen sound box terminal, activate the underlying transmission protocol stack, form a physical layer connection with the available network base station, and synchronously start the video interaction application to complete the first authentication handshake with the service platform through the account credential verification mechanism.
[0079] The cross-device account binding module is configured to input the same network topology parameters into the television terminal in the setting menu, and the protocol stack triggered by the television terminal forms a symmetrical structure with the smart screen sound box terminal. The same account credential of the smart screen sound box terminal is used to start the authentication handshake, and an account-level device binding identifier is generated, so that the television terminal and the smart screen sound box terminal are mapped to the same virtual terminal group in the video communication client software.
[0080] The cooperative channel self-checking module is configured to, based on the account binding identifier, download a cooperative configuration vector to the television terminal and the smart screen sound box terminal by the service platform. The cooperative configuration vector triggers the display driver chain of the television terminal and the acquisition sensor ring of the smart screen sound box terminal. The television terminal and the smart screen sound box terminal automatically establish a space-time synchronization verification mechanism through the topology discovery protocol of the service platform, and output an end-to-end ready state signal.
[0081] The working principle and beneficial effects of the above technical solution are as follows: the network access initialization module of this embodiment is used for the smart screen speaker terminal to inject network topology parameters into the configuration interface, activate the underlying transmission protocol stack, and form a physical layer connection with the available network base station; synchronously start the video interactive application, and complete the first authentication handshake with the service platform through the account credential verification mechanism; the cross-device account binding module is used for the TV terminal to input the same network topology parameters in the setting menu, and the protocol stack response triggered by it forms a symmetrical structure with the smart screen speaker terminal; use the same account credentials of the smart screen speaker terminal to start the authentication handshake, generate an account-level device binding identifier, so that the TV terminal and the smart screen speaker terminal are mapped to the same virtual terminal group in the video communication client software; the collaborative channel self-test module is used for the service platform to send a collaborative configuration vector to the TV terminal and the smart screen speaker terminal based on the account binding identifier; the collaborative configuration vector triggers the display drive chain of the TV terminal and the acquisition sensor ring of the smart screen speaker terminal, and the TV terminal and the smart screen speaker terminal automatically establish a time and space synchronization verification mechanism through the topology discovery protocol of the service platform, and output an end-to-end ready status signal. The account login subsystem in the aforementioned solution achieves a technical closed-loop for multi-terminal collaborative access and management through a modular design. The network access initialization module establishes unified physical layer connection specifications and achieves homogeneous protocol stack processing for heterogeneous terminals (smart screens, speakers, and TVs) through parameterized configuration. This design enables devices with different hardware architectures to establish standardized transmission channels based on the same network topology parameters, providing a physical foundation for subsequent account binding. The cross-device account binding module establishes a device-independent authentication system, elevating device binding relationships to the virtual terminal group dimension through generalization of account credentials. This enables transparent handling of hardware differences, allowing the server to maintain only logical terminal group identifiers without having to understand specific device types. The collaborative channel self-test module utilizes a configuration vector-driven strategy to encapsulate the hardware differences between the display driver (TV) and the acquisition sensor (speaker) into dispatchable control parameters. The spatiotemporal synchronization mechanism established through the topology discovery protocol ensures timing consistency at the application layer for heterogeneous hardware, achieving an end-to-end verifiable collaborative readiness state.
[0082] To summarize, this embodiment constructs a standardized access framework that supports heterogeneous collaboration of multiple terminals through three levels of abstraction: physical layer parameter injection, logical layer credential binding, and application layer vector control. While maintaining the hardware independence of each device, a unified virtual terminal management model is implemented on the server side.
[0083] Example 6: Figure 4 As shown, based on Example 1, the scene communication establishment subsystem provided by the embodiment of the present invention includes:
[0084] A cross-terminal operation awareness module is configured to receive a television terminal physical button signal or a smart screen terminal acoustic or touch signal, encode the signal into a call request package in a unified format, and transmit the call request package to a background service instruction distribution hub through a persistent connection channel.
[0085] A dual-device cooperative control module is configured to search a pre-stored device binding topology according to an account identifier in the call request package, and execute a device cooperative decision logic.
[0086] In an outgoing call scenario, a display ready instruction is sent to the bound television terminal, and a collection ready instruction is sent to the smart screen sound box terminal.
[0087] In an incoming call scenario, a ring synchronization instruction is sent to both terminals in parallel, and when a response to answer is returned by any terminal, an instruction termination signal is sent to the unresponsive terminal.
[0088] A directional media stream distribution module is configured to, in a device cooperative ready state, upload an audio and video collection stream of the smart screen sound box terminal to a media distribution node, perform bidirectional routing by the media distribution node, forward the audio and video stream of the terminal to the contact terminal, distribute a remote video stream and an audio stream to the television terminal, selectively distribute a remote audio stream to the smart screen terminal, and perform decoding and rendering operations on the received media stream by the television terminal to drive screen display and speaker output.
[0089] The working principle and beneficial effects of the technical solution are as follows: the cross-terminal operation perception module of the embodiment is used to receive a television terminal physical button signal or a smart screen terminal acoustic or touch signal, encode the signal into a unified format call request package, and transmit the call request package to a background service instruction distribution hub through a persistent connection channel; the dual-device cooperative control module is used to retrieve a pre-stored device binding topology according to an account identifier in the call request package, execute device cooperative decision logic, and call a scene, and issue a display ready instruction to the bound television terminal and an acquisition ready instruction to the smart screen sound box terminal; the incoming call scene, the dual-terminal parallel ring synchronization instruction is sent; when any terminal returns an answering response, an instruction termination signal is sent to the unresponsive terminal; the directional media stream distribution module is used to upload the smart screen sound box terminal audio and video acquisition stream to the media distribution node in the device cooperative ready state, and the media distribution node executes bidirectional routing, forwards the local audio and video stream to the contact terminal, distributes the remote video stream and audio stream to the television terminal, and selectively distributes the remote audio stream to the smart screen terminal; the television terminal performs decoding and rendering operations on the received media stream, and drives the screen display and the loudspeaker output. The scene communication establishment subsystem of the above scheme realizes the cross-device cooperative communication function through modular design. The cross-terminal operation perception module converts heterogeneous input signals (physical buttons / acoustics / touch) into standardized call request packages through a unified encoding mechanism, eliminating communication barriers caused by device differences; the persistent connection channel ensures the real-time and reliability of signaling transmission. The dual-device cooperative control module realizes device topology discovery based on the account identifier, and dynamically generates a control instruction set through a decision engine. In the outgoing call scene, the parallel initialization of the display / acquisition device is realized, and in the incoming call scene, the dual-terminal ring synchronization and conflict resolution are completed, and the first responding terminal triggers the termination mechanism. The directional media stream distribution module builds a hierarchical transmission system: the smart screen terminal acts as an acquisition source and realizes uplink transmission through the media distribution node, the television terminal acts as a main presentation device and receives downlink video stream, and the sound box terminal obtains audio stream on demand; the television terminal integrates a decoding and rendering pipeline to complete media presentation.
[0090] In the embodiment, the process of the outgoing call scene is as follows: a user initiates a video communication request by operating a television interface through a television remote control or by giving voice instructions and touch operations on a smart screen sound box; when the user initiates a call on the television end, the television end sends a call instruction to a background service through a network; when the user initiates a call on the smart screen sound box end, the smart screen sound box end also sends a call instruction to the background service; the background service refers to a connection service that keeps the connection between the client and the server, which is a long connection protocol. The television end and the smart screen sound box end can keep the connection according to the protocol; after the background service receives the call instruction, the background service judges the device information of the television end and the smart screen sound box end connected by the user according to a preset rule, sends a coordination instruction to the television end and the smart screen sound box end, and makes the television end and the smart screen sound box end enter a coordinated working state; when the user logs in an account on the television end and the smart screen sound box end, the device type under the current account is recorded; the smart screen end starts a camera and a microphone to collect local video pictures and audio data, and uploads the collected data to a selective forwarding unit service platform through a network; the selective forwarding unit service platform processes the data, selectively forwards the video stream to a contact device on the opposite end according to the device information on the opposite end, and forwards the audio and video data of the contact on the opposite end to the television end and the smart screen sound box end; the television end receives and decodes the audio and video data on the opposite end, displays the video pictures on the opposite end on a large screen and plays the audio, and the smart screen sound box end can also play the audio on the opposite end as needed, thereby realizing video communication.
[0091] The process of the incoming call scene is as follows: when there is an incoming call, if the television end and the smart screen sound box end are both in an online state, the background service sends an incoming call notification to the two ends, and the two ends ring simultaneously to prompt the user that there is an incoming call; the user can answer the call on the television end by operating a remote control or on the smart screen sound box end by giving voice instructions, touch operations or the like; when any one end answers the call, the end sends an answering instruction to the background service, the background service notifies the other end to stop ringing, and coordinates the two ends and the selective forwarding service platform to establish a stable communication connection and enter a video communication state. The smart screen sound box end collects local audio and video data and uploads the data to the selective forwarding service platform, the selective forwarding service platform forwards the data to a contact device on the opposite end and forwards the audio and video data of the contact on the opposite end to the television end and the smart screen sound box end, the television end displays the video pictures on a large screen and plays the audio, thereby realizing large screen video communication.
[0092] In summary, the embodiment realizes dynamic scheduling of cross-device communication resources, forms a closed loop path of collection-transmission-presentation, optimizes bandwidth utilization while ensuring media stream synchronization, and realizes full media reception on the television end and selective reception on the sound box end; the device coordination logic effectively reduces the complexity of user operations and maintains the consistency of the states of multiple devices through a topology binding mechanism.
[0093] In the embodiment 7, on the basis of the embodiment 6, the double-device cooperative control module comprises:
[0094] The user initiates a call sub-module, which is configured to open a video communication application on the television end, select a contact person on the mobile phone end in the application interface through the television remote control, and touch a call button; or call the contact person by voice instruction in front of the smart screen sound box terminal, or select the contact person on the interface of the smart screen sound box to initiate a call;
[0095] The background service cooperation sub-module is configured to send a call instruction to the background service from the television end or the smart screen sound box end, query user device binding information after the background service receives the instruction, confirm the television end and the smart screen sound box end devices connected by the user at the same time, send a cooperation instruction to the television end and the smart screen sound box end, and notify the television end and the smart screen sound box end to prepare to enter a video communication state;
[0096] The audio and video collection and transmission sub-module is configured to start the camera and the microphone after the smart screen sound box end receives the cooperation instruction, start collecting local audio and video data, encode the data, and upload the data to the selective forwarding service platform through the network; the selective forwarding service platform selectively forwards the video stream according to the device information of the opposite contact person, and forwards the audio and video data of the opposite contact person to the television end and the smart screen sound box end;
[0097] The video communication display and playing sub-module is configured to decode the data after the television end receives the audio and video data of the opposite end, display the video picture of the opposite end on the large screen, and play the audio through the loudspeaker; the smart screen sound box end can play the audio of the opposite end according to the setting, and realize the video communication.
[0098] The working principle and beneficial effects of the above technical solution are as follows: the user-initiated call submodule of this embodiment is used for the user to open the video communication application on the TV side, select the contact on the mobile phone side in the application interface through the TV remote control, and touch the call button; or the user calls the contact name through voice commands in front of the smart screen speaker terminal, or selects the contact on the smart screen speaker interface to initiate a call; the background service collaboration submodule is used for the TV side or the smart screen speaker side to send the call instruction to the background service. After receiving the instruction, the background service queries the user device binding information, confirms the TV side and the smart screen speaker side devices connected at the same time by the user, and sends a collaboration instruction to the TV side and the smart screen speaker side to notify the TV side and the smart screen speaker side devices to prepare. The device enters the video communication state; the audio and video acquisition and transmission submodule is used to start the camera and microphone after the smart screen speaker receives the collaborative instruction, start collecting local audio and video data, and encode the data before uploading it to the selective forwarding service platform through the network; the selective forwarding service platform selectively forwards the video stream according to the device information of the other party's contact, and at the same time forwards the audio and video data of the other party's contact to the TV end and the smart screen speaker end; the video communication display and playback submodule is used for the TV end to decode the audio and video data received by the other party, display the video picture of the other party on the large screen, and play the audio through the speaker; the smart screen speaker end can choose to play the audio of the other party according to the settings to realize video communication (such as Figure 5 As shown). The dual-device collaborative control module of the above solution realizes cross-terminal video communication collaboration through a layered architecture; the user-initiated call submodule supports three interaction methods: remote control touch, voice command, and screen selection, covering typical input scenarios of the TV and smart screen speaker, ensuring that users can initiate call requests through any bound device. The background service collaboration submodule dynamically generates a collaborative instruction set by querying the device binding topology in real time to achieve parallel state switching of the two devices. The TV enters the display-ready state and the smart screen enters the acquisition-ready state, maintaining state consistency between devices. After the audio and video acquisition and transmission submodule completes the acquisition and encoding on the smart screen, it realizes intelligent routing of streaming media through the selective forwarding service platform, forwards the local audio and video stream to the contact on the other end, distributes the complete audio and video stream to the TV, and distributes the pure audio stream to the smart screen speaker on demand, thereby optimizing bandwidth allocation. The video communication display and playback submodule completes video decoding and large-screen rendering on the TV, giving full play to its display advantages; the smart screen only processes audio output, forming a complementary device capability.
[0099] In summary, this embodiment establishes an end-to-end collaborative communication link. By dividing device roles, the TV focuses on presentation, while the smart screen focuses on acquisition, maximizing hardware efficiency while maintaining a unified user interface. A selective forwarding mechanism reduces redundant data transmission and ensures that media streams are precisely matched to device capabilities.
[0100] In the embodiment 6, the double-device cooperative control module comprises:
[0101] The incoming call notification submodule is configured to, when there is an incoming call, the background service detects that the television terminal and the smart screen sound box terminal of the user are both in an online state, send an incoming call notification instruction to the television terminal and the smart screen sound box terminal, and after the television terminal and the smart screen sound box terminal receive the instruction, simultaneously start a ringing prompt and display the incoming call information on the television screen and the smart screen sound box interface.
[0102] The answering operation submodule is configured to, the user answers the call by clicking an answering button on the television terminal through a remote controller, answers the call by a voice instruction on the smart screen sound box, or answers the call by touching an answering icon on the smart screen sound box; the answering terminal device sends an answering instruction to the background service, and after the background service receives the instruction, notifies the other terminal device to stop the ringing.
[0103] The video communication establishment submodule is configured to, the background service coordinates the answering terminal device, the un-answering terminal device and the selective forwarding service platform to establish a communication connection; the smart screen sound box terminal starts to collect local audio and video data and uploads the local audio and video data to the selective forwarding service platform, the selective forwarding service platform forwards the data to the opposite contact device and forwards the audio and video data of the opposite contact to the television terminal and the smart screen sound box terminal, the television terminal displays a video picture and plays audio on a large screen, and large-screen video communication is realized.
[0104] The working principle and beneficial effects of the above technical solution are as follows: the incoming call notification submodule is configured to, when there is an incoming call, the background service detects that the television terminal and the smart screen sound box terminal of the user are both in an online state, send an incoming call notification instruction to the television terminal and the smart screen sound box terminal, and after the television terminal and the smart screen sound box terminal receive the instruction, simultaneously start a ringing prompt and display the incoming call information on the television screen and the smart screen sound box interface; the answering operation submodule is configured to, the user answers the call by clicking an answering button on the television terminal through a remote controller, answers the call by a voice instruction on the smart screen sound box, or answers the call by touching an answering icon on the smart screen sound box; the answering terminal device sends an answering instruction to the background service, and after the background service receives the instruction, notifies the other terminal device to stop the ringing; the video communication establishment submodule is configured to, the background service coordinates the answering terminal device, the un-answering terminal device and the selective forwarding service platform to establish a communication connection; the smart screen sound box terminal starts to collect local audio and video data and uploads the local audio and video data to the selective forwarding service platform, the selective forwarding service platform forwards the data to the opposite contact device and forwards the audio and video data of the opposite contact to the television terminal and the smart screen sound box terminal, the television terminal displays a video picture and plays audio on a large screen, and large-screen video communication is realized. Figure 6The double-device cooperative control module of the above scheme realizes seamless cross-terminal communication experience through linkage of the three subsystems; through the double-terminal online detection mechanism of the television end and the smart screen sound box, it ensures that devices at different positions in the home scene can synchronously perceive the incoming call state; the parallel triggering design of the double-end ringing eliminates the risk of missed calls of a single device; physical keys of a remote controller (television end) are provided; voice instructions (smart screen sound box) are supported; touch interaction (smart screen sound box interface) is retained, and the three answering modes cover the operation preferences of different user groups; the ringing of the un-answered end device is terminated immediately after the answering instruction is triggered, and the intelligent routing mechanism of the selective forwarding service platform is selected to realize dynamic allocation of network bandwidth and terminal computing resources; the television end focuses on video presentation due to the large screen advantage, and the smart screen sound box undertakes the audio and video collection function; a complementary architecture between devices is formed.
[0105] In summary, the embodiment establishes a technical framework for cross-terminal cooperative communication, and realizes a system-level cooperative effect by means of device state perception, instruction routing optimization, media stream intelligent distribution and other technical means, while maintaining the independent functions of each device.
[0106] Embodiment 9: as Figure 7 On the basis of embodiments 1-8, the method for realizing video communication on a television large screen through a smart screen sound box provided by the embodiment of the application comprises the following steps:
[0107] S100: providing a video communication client software installation version adapted to at least three different terminals, the video communication client software being used to establish a communication connection between different terminals under the same account;
[0108] S200: completing network connection of different terminals under the same account, starting the video communication client software, performing account login, and completing communication connection of different terminals and a selective forwarding unit service platform;
[0109] S300: under the support of the selective forwarding unit service platform and the network, completing communication in an active call-out scene and an incoming call scene between different terminals.
[0110] The working principle and beneficial effects of the above technical scheme are as follows: the embodiment first provides a video communication client software installation version adapted to at least three different terminals, the video communication client software being used to establish a communication connection between different terminals under the same account; secondly, network connection of different terminals under the same account is completed, the video communication client software is started, account login is performed, and communication connection of different terminals and a selective forwarding unit service platform (its principle is referred to in the description of the selective forwarding unit service platform) is completed; Figure 8) are connected; finally, under the support of the selective forwarding unit service platform and the network, the communication between different terminals is completed in the active outgoing call scene and the incoming call scene. The technical scheme of the television large-screen video communication realized by the intelligent screen sound box, and the core is to build a cross-terminal, high-compatibility real-time audio and video communication system. The heterogeneous terminal interconnection system is realized, the terminal type independence is realized through the multi-version client software, the hardware difference limitation is broken through; based on the same account system, the standardized communication link is established, the intelligent sound box, the mobile terminal, the television and other heterogeneous devices form the logically unified communication node, and the terminal abstraction is realized. The selective forwarding unit service platform realizes the end-to-end low delay connection.
[0111] The embodiment specifically relates to audio and video collection and display cooperation, network communication protocol, real-time audio and video processing (SFU service) and the like, and is suitable for the video communication scene in the family intelligent device ecology. The expandable technical field: (1) intelligent home device linkage (such as the cooperative communication of the intelligent screen and the projector, the intelligent screen and the computer display); (2) multi-device audio and video cooperation in the enterprise conference scene (such as the large-screen communication of the conference tablet and the intelligent terminal).
[0112] Obviously, those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application belong to the scope of equivalent technologies of the present application, the present application also intends to include these modifications and variations.
Claims
1. A system for enabling video communication on a large screen TV through a smart screen soundbar, characterized in that, The application relates to a video communication system, which comprises a terminal communication establishment subsystem, an account login subsystem and a scene communication establishment subsystem. The terminal communication establishment subsystem is used for providing video communication client software installation versions adapted to at least three different terminals, and the video communication client software is used for establishing communication connections of different terminals under the same account. The account login subsystem is used for completing network connections of different terminals under the same account, starting the video communication client software, performing account login, and completing communication connections of different terminals and a selective forwarding unit service platform. The scene communication establishment subsystem is used for completing communication under outgoing call scenes and incoming call scenes between different terminals under the support of the selective forwarding unit service platform and a network.
2. The system for video communication on a large screen TV through a smart screen sound box according to claim 1, characterized in that, The account login subsystem comprises a network access initialization module, a cross-device account binding module and a cooperative channel self-checking module. The network access initialization module is used for injecting network topology parameters into a configuration interface by a smart screen sound box terminal, activating a bottom layer transmission protocol stack, forming a physical layer connection with an available network base station, synchronously starting a video interaction application, and completing first authentication handshake with a service platform through an account credential verification mechanism. The cross-device account binding module is used for inputting the same network topology parameters into a setting menu by a television terminal, and a protocol stack triggered by the television terminal forms a symmetrical structure with the smart screen sound box terminal. An authentication handshake is started by using the same account credential of the smart screen sound box terminal, an account-level device binding identifier is generated, the television terminal and the smart screen sound box terminal are mapped to the same virtual terminal group in the video communication client software, and a cooperative configuration vector is issued to the television terminal and the smart screen sound box terminal by the service platform based on the account binding identifier. The cooperative configuration vector of the cooperative channel self-checking module triggers a display driving chain of the television terminal and a collection sensing ring of the smart screen sound box terminal, and the television terminal and the smart screen sound box terminal automatically establish a time and space synchronization verification mechanism through a topology discovery protocol of the service platform, and output an end-to-end ready state signal.
3. The system for enabling video communication on a large screen TV through a smart screen soundbar according to claim 2, wherein, The scene communication establishment subsystem comprises a cross-terminal operation sensing module and a double-device cooperative control module.
4. The system for video communication on a large screen TV through a smart screen sound box according to claim 1, characterized in that, The cross-terminal operation sensing module is used for receiving television terminal physical button signals or smart screen terminal acoustic or touch signals, encoding the signals into a unified format call request package, and transmitting the call request package to a background service instruction distribution hub through a persistent connection channel. The double-device cooperative control module is used for searching a pre-stored device binding topology according to an account identifier in the call request package, and executing device cooperative decision logic. A directional media stream distribution module is used for transmitting the smart screen sound box terminal audio and video collection stream to a media distribution node under the device cooperative ready state, and the media distribution node performs bidirectional routing, forwards the local audio and video stream to a contact terminal, and distributes remote video and audio streams to the television terminal. The smart screen terminal is selectively distributed with remote audio streams, and the television terminal performs decoding and rendering operations on the received media stream, drives screen display and speaker output. The double-device cooperative control module issues a display ready instruction to the bound television terminal and issues a collection ready instruction to the smart screen sound box terminal in the outgoing call scene, and issues a ring synchronization instruction to the double terminals in parallel in the incoming call scene.
5. The system for video communication on a large screen TV through a smart screen sound box according to claim 4, characterized in that, When any terminal returns a call answering response, an instruction termination signal is sent to the unresponsive terminal.
6. The system for video communication on a large screen TV through a smart screen sound box according to claim 5, characterized in that, The double-device cooperative control module comprises a cross-terminal operation sensing module, a double-device cooperative control module and a directional media stream distribution module. The user initiates a call sub-module, which is used for the user to open a video communication application on the television end, select a contact on the mobile phone end in the application interface through the television remote control, and touch the call button; or the user is in front of the smart screen sound box terminal, calls the contact name through the voice instruction, or selects the contact on the smart screen sound box end interface to initiate the call; The background service coordination sub-module is used for the television end or the smart screen sound box end to send a call instruction to the background service. After the background service receives the instruction, it queries the user equipment binding information, confirms that the user is connected to the television end and the smart screen sound box end equipment at the same time, sends a coordination instruction to the television end and the smart screen sound box end, and notifies the television end and the smart screen sound box end equipment to prepare to enter the video communication state; The audio and video collection and transmission sub-module is used for the smart screen sound box end to receive the coordination instruction, start the camera and microphone, start collecting local audio and video data, and upload the data to the selective forwarding service platform after encoding processing; The video communication display and playing sub-module is used for the television end to receive the opposite end audio and video data, perform decoding processing, display the opposite end video picture on the large screen, and play the audio through the loudspeaker. The smart screen sound box end can select to play the opposite end audio according to the setting, and realize the video communication.
7. The system for video communication on a large screen TV through a smart screen sound box according to claim 6, characterized in that, The selective forwarding service platform of the audio and video collection and transmission sub-module selectively forwards the video stream according to the device information of the opposite contact, and forwards the audio and video data of the opposite contact to the television end and the smart screen sound box end.
8. The system for video communication on a large screen TV through a smart screen sound box according to claim 5, wherein, The dual-device coordination control module further comprises: The incoming call notification sub-module is used for the background service to detect that the television end and the smart screen sound box end of the user are both in an online state when there is an incoming call, send an incoming call notification instruction to the television end and the smart screen sound box end, and display the incoming call information on the television screen and the smart screen sound box interface after the television end and the smart screen sound box end receive the instruction and simultaneously start the ring prompt. The answering operation sub-module is used for the user to click the answer button on the television end through the remote control, or to answer through the voice instruction on the smart screen sound box end, or to touch the answer icon on the smart screen sound box to perform the answering operation. The answering end device sends an answering instruction to the background service, and the background service receives the instruction and notifies the other end device to stop the ring. The video communication establishment sub-module is used for the background service to coordinate the answering end device, the un-answered end device, and the selective forwarding service platform to establish a communication connection; and the smart screen sound box end starts to collect local audio and video data and uploads the data to the selective forwarding service platform.
9. The system for video communication on a large screen TV through a smart screen sound box according to claim 8, characterized in that, The selective forwarding service platform of the video communication establishment sub-module forwards the data to the opposite contact device, and forwards the audio and video data of the opposite contact to the television end and the smart screen sound box end, displays the video picture on the television end, and plays the audio, thereby realizing the large-screen video communication.
10. A method for video communication on a large screen of a television through a smart screen sound box, characterized in that, The method comprises the following steps: Providing video communication client software installation versions adapted to at least three different terminals, which are used to establish communication connections of different terminals under the same account; Completing the network connection of different terminals under the same account, starting the video communication client software, logging in the account, and completing the communication connection of different terminals and the selective forwarding unit service platform; Under the support of the selective forwarding unit service platform and network, communication is completed between different terminals in the active outgoing call scene and the incoming call scene.
Citation Information
Patent Citations
Television video call system and method based on WebRTC (Web Real Time Communication)
CN106454543A
Method for cooperation of intelligent sound box and electronic device and electronic device
CN111628916A
Video call method, device and system and storage medium
CN113824918A
Equipment interaction method, electronic equipment and system
CN115729392A
Method and apparatus for processing media stream, computer device, and storage medium
US20250023936A1