System and method for realizing data sharing between home multimedia terminal equipment
Through the data sharing and collaborative processing system of the home edge gateway and the cloud AI service platform, the data island problem between set-top boxes and mobile smart terminal devices is solved, seamless switching and personalized recommendations across terminal devices are achieved, and the user experience and device collaboration efficiency are improved.
Patent Information
- Application Number
- CN202511082969.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-08-04
- Publication Date
- 2025-10-28
AI Technical Summary
In existing technologies, there is a lack of data sharing and collaborative processing capabilities between set-top boxes and mobile smart terminal devices, resulting in an insufficient user experience. This makes it impossible to achieve rapid synchronization and personalized recommendation of film and television content, and fails to meet the diverse content needs of multiple family members.
By leveraging home edge gateways and cloud-based AI service platforms, data sharing and collaborative processing between set-top boxes and mobile smart terminal devices are achieved. Operational data is collected and uploaded, aggregated, and analyzed to form data update models and strategies, thereby updating the content recommendation list and display order of terminal devices.
It enables seamless switching and data sharing across terminal devices, improves the overall user experience, increases the accuracy of personalized recommendations, reduces content filtering time, and enhances the synergy of home devices and privacy protection.
Smart Images
Figure CN120856908A_ABST
Abstract
Description
Technical Field
[0001] The exemplary embodiments of this disclosure generally relate to the field of smart home technology, and more specifically, this disclosure relates to a system and method for enabling data sharing between home multimedia terminal devices. Background Art
[0002] With the widespread adoption of smart home devices, set-top boxes and mobile smart terminals (such as smartphones) have become core terminal devices for home users to access audio-visual entertainment content. However, current set-top box and mobile smart terminal applications often operate independently, creating data silos. For example, users' saved movies and TV shows on their mobile smart terminals cannot be quickly and easily synchronized to the set-top box for viewing on the large screen of a TV, and personalized recommendations generated by the set-top box based on historical viewing records cannot adapt to the user's usage scenarios on the mobile smart terminal. Furthermore, traditional devices lack the data analysis capabilities to consider the usage characteristics of multiple family members' mobile smart terminals, thus failing to meet the diverse content needs of multiple family members.
[0003] Therefore, how to provide a system that enables data sharing and collaborative processing among home multimedia terminal devices to improve the overall user experience is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention
[0004] In view of this, the present disclosure provides a system and method for realizing data sharing among home multimedia terminal devices, which can realize data sharing and collaborative processing among home multimedia terminal devices, thereby improving the overall user experience.
[0005] To achieve the above objectives, this disclosure provides a system for enabling data sharing among home multimedia terminal devices, comprising a set-top box, a mobile smart terminal, a home edge gateway, and a cloud AI service platform. The set-top box uploads set-top box operation data generated by user operations to the home edge gateway. The mobile smart terminal encrypts and uploads mobile smart terminal operation data generated by user operations to the home edge gateway or the cloud AI service platform. The home edge gateway aggregates the received set-top box operation data and the mobile smart terminal operation data, or aggregates only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploads the set-top box-mobile smart terminal data packet or the set-top box data packet to the cloud AI service platform. The cloud-based AI service platform decrypts and parses the received set-top box-mobile smart terminal data packets, or decrypts and parses both the received set-top box data packets and the encrypted mobile smart terminal operation data, to form a mobile smart terminal data update model and a data strategy corresponding to the mobile smart terminal data update model. The platform then distributes the mobile smart terminal data update model and the data strategy to the mobile smart terminal and the home edge gateway, respectively. The home edge gateway forms a set-top box data update model based on the data strategy and transmits the set-top box data update model to the set-top box. The mobile smart terminal updates its content recommendation list based on the mobile smart terminal data update model, and the set-top box updates its content display order based on the set-top box data update model.
[0006] Optionally, when the mobile smart terminal is in a home network environment: the set-top box uploads its operation data to the home edge gateway; the mobile smart terminal encrypts and uploads its operation data to the home edge gateway; the home edge gateway aggregates the received set-top box operation data and the mobile smart terminal operation data to form a set-top box-mobile smart terminal data packet, and uploads the set-top box-mobile smart terminal data packet to the cloud AI service platform; and the cloud AI service platform decrypts and parses the received set-top box-mobile smart terminal data packet to form a first mobile smart terminal data packet. According to the update model and the first data strategy corresponding to the first mobile smart terminal data update model, the first mobile smart terminal data update model and the first data strategy are respectively sent to the mobile smart terminal and the home edge gateway. The home edge gateway forms a first set-top box data update model based on the first data strategy and transmits the first set-top box data update model to the set-top box. The mobile smart terminal updates its content recommendation list based on the first mobile smart terminal data update model, and the set-top box updates its content display order based on the first set-top box data update model.
[0007] Optionally, when the mobile smart terminal is in a non-home network environment: the set-top box uploads its operation data to the home edge gateway; the mobile smart terminal directly encrypts and uploads its operation data to the cloud AI service platform; the home edge gateway aggregates the received set-top box operation data to form a set-top box data packet, and uploads the set-top box data packet to the cloud AI service platform; and the cloud AI service platform decrypts and parses the received set-top box data packet and the encrypted mobile smart terminal operation data to form a second mobile smart terminal data update model and... A second data strategy corresponding to the second mobile smart terminal data update model is generated, and the second mobile smart terminal data update model and the second data strategy are respectively sent to the mobile smart terminal and the home edge gateway. The home edge gateway forms a second set-top box data update model based on the second data strategy and transmits the second set-top box data update model to the set-top box. The mobile smart terminal updates its content recommendation list based on the second mobile smart terminal data update model, and the set-top box updates its content display order based on the second set-top box data update model.
[0008] Optionally, when the mobile smart terminal is in a home network environment, the set-top box uploads its operation data to the home edge gateway via HTTPS, and the mobile smart terminal also encrypts and uploads its operation data to the home edge gateway in real time based on a hybrid communication protocol of HTTP / 3 and WebSocket. When the mobile smart terminal is in a non-home network environment, the set-top box uploads its operation data to the home edge gateway via HTTPS, and the mobile smart terminal stores its own operation data. When a specific threshold is met, the mobile smart terminal uploads its operation data to the cloud AI service platform via cellular network or the currently connected WiFi or hotspot outside the home network environment in encrypted form. The specific threshold includes at least one of the following: the number of stored mobile smart terminal operation data entries reaches 1000 and the storage time of the mobile smart terminal operation data reaches one week. Alternatively, the specific threshold can be customized by the user.
[0009] Optionally, the set-top box includes a data acquisition and processing unit, used to collect and perform preliminary cleaning and feature extraction on the set-top box operation data before uploading it to the home edge gateway; and the mobile smart terminal includes a data acquisition module, used to collect the mobile smart terminal operation data.
[0010] The user can provide feedback to the cloud AI service platform on whether the content recommendation list on the mobile smart terminal and the content display order on the set-top box meet the user's expectations, so as to optimize the cloud AI service platform.
[0011] Optionally, the user can register a user account by scanning a QR code on the set-top box using the mobile smart terminal, and then bind the mobile smart terminal to the set-top box for the user account.
[0012] Optionally, the user can register the user account on one or more of the mobile smart terminals, and one or more of the user accounts can also be registered on the mobile smart terminals.
[0013] Optionally, the user accounts have permission levels, and the user account with higher-level permissions can set some or all of the operations of the user account with lower-level permissions.
[0014] In addition, this disclosure provides a method for realizing data sharing between home multimedia terminal devices, comprising: a set-top box uploading set-top box operation data generated by a user operating the set-top box to a home edge gateway; a mobile smart terminal uploading encrypted mobile smart terminal operation data generated by a user operating the mobile smart terminal to the home edge gateway or a cloud AI service platform; the home edge gateway aggregating the received set-top box operation data and the mobile smart terminal operation data, or aggregating only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploading the set-top box-mobile smart terminal data packet or the set-top box data packet to the cloud AI service platform; and the cloud AI service platform ... operation data packet or the set-top box data packet to the cloud AI service platform; and the cloud AI service platform aggregating the received set-top box operation data and the mobile smart terminal operation data, or aggregating only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploading the set-top box operation data packet to the cloud AI service platform; and the cloud AI service platform aggregating the received set-top box operation data and the mobile smart terminal operation data, or aggregating only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploading the set-top The system decrypts and parses the received set-top box-mobile smart terminal data packets, or decrypts and parses both the received set-top box data packets and the encrypted mobile smart terminal operation data, to form a mobile smart terminal data update model and a data strategy corresponding to the mobile smart terminal data update model. The mobile smart terminal data update model and the data strategy are then distributed to the mobile smart terminal and the home edge gateway, respectively. The home edge gateway forms a set-top box data update model based on the data strategy and transmits the set-top box data update model to the set-top box. The mobile smart terminal updates its content recommendation list based on the mobile smart terminal data update model, and the set-top box updates its content display order based on the set-top box data update model.
[0015] Compared with the prior art, the system and method for enabling data sharing between home multimedia terminal devices provided in this disclosure have at least the following beneficial effects:
[0016] This system and method enable data sharing and collaborative processing among home multimedia terminal devices such as set-top boxes and mobile smart terminals through a home edge gateway and cloud AI service platform, achieving seamless switching across terminal devices and thus improving the overall user experience. Attached Figure Description
[0017] To more clearly illustrate the technical solutions of this disclosure, the embodiments of this disclosure will be further explained and described with reference to the following drawings. These drawings are only used to more conveniently and specifically describe the embodiments of this disclosure and are not intended to limit this disclosure. In the drawings:
[0018] Figure 1 The workflow of a system for enabling data sharing between home multimedia terminal devices according to one embodiment of the present disclosure is shown when the mobile smart terminal is in a home network environment.
[0019] Figure 2 The workflow of a system for enabling data sharing between home multimedia terminal devices according to one embodiment of the present disclosure is shown when the mobile smart terminal is in a non-home network environment.
[0020] Figure 3 This illustrates a workflow of a mobile smart terminal uploading its operational data to a cloud AI service platform when in a non-home network environment, according to one embodiment of the present disclosure; and
[0021] Figure 4 The flowchart illustrates the data transmission and corresponding data return logic between a set-top box, a mobile smart terminal, a home edge gateway, and a cloud AI service platform according to one embodiment of the present disclosure. Detailed Implementation
[0022] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, specific embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. These embodiments are provided by way of example only. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. Based on the described embodiments of this disclosure, all other embodiments obtained by those skilled in the art without inventive effort are also within the scope of protection claimed by this disclosure.
[0023] In the description of this disclosure, unless otherwise expressly specified and limited, the term "comprising" and similar expressions should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. Those skilled in the art can understand the specific meaning of the above terms in this disclosure according to the specific circumstances. Furthermore, the terms "first", "second", etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.
[0024] One embodiment of this disclosure provides a system for enabling data sharing between home multimedia terminal devices. Figure 1 The following describes the workflow 100 of a system for enabling data sharing between home multimedia terminal devices according to an embodiment of the present disclosure when the mobile smart terminal is in a home network environment; Figure 2 The following describes the workflow 200 of a system for enabling data sharing between home multimedia terminal devices according to one embodiment of the present disclosure when the mobile smart terminal is in a non-home network environment. Reference Figure 1 and Figure 2 The system for enabling data sharing between home multimedia terminal devices generally includes a set-top box 10, a mobile smart terminal 20, a home edge gateway 30, and a cloud AI service platform 40.
[0025] The set-top box 10 collects set-top box operation data generated by users (e.g., family members) operating the set-top box 10, and uploads this data to the home edge gateway 30. Before uploading the set-top box operation data to the home edge gateway 30, the set-top box 10 also collects and performs preliminary cleaning and feature extraction on the data through its data acquisition and processing unit. Specifically, the data acquisition and processing unit can be built into the set-top box 10, and the collected set-top box operation data can include program viewing duration, pause / fast forward times, search keywords, etc. Simultaneously, the data acquisition and processing unit can be equipped with a lightweight AI model inference engine to support the rapid operation of local personalized recommendation algorithms. The viewing records (e.g., audio and video data) selected by the set-top box 10 via the remote control, as well as the user behavior operation data opened in the surrounding life page, will be recorded in the database built into the set-top box 10 for storage. And when the storage data or storage time meets the requirements, this set-top box operation data will be uploaded by the home edge gateway 30 to the cloud AI service platform 40 through the interface of the cloud AI service platform 40 (e.g., uploaded to the back-end server of the cloud AI service platform 40).
[0026] The mobile smart terminal 20 is used to collect mobile smart terminal operation data generated by the user's operation of the mobile smart terminal 20, and encrypts and uploads the mobile smart terminal operation data to the home edge gateway 30 or the cloud AI service platform 40. The mobile smart terminal 20 may include a data acquisition module, which is used to collect mobile smart terminal operation data. In addition to the user's audio-visual operation data on the mobile smart terminal 20 (e.g., clicking, swiping, page turning, searching, switching rankings, etc.), it may also include the user's mobile smart terminal 20 location information, usage time, social sharing, and other data. Specifically, the data acquisition module can be a multimodal data acquisition module that collects multimodal input data (e.g., at least one of text input (search history), voice commands, and gesture operations, or other existing or future data types). Through timestamp alignment and feature association algorithms, it fuses mobile smart terminal operation data from different modalities to form a complete user behavior sequence. For example, after a user searches for a movie on the mobile smart terminal 20, when watching the movie on a TV connected to the set-top box 10, the data acquisition module can analyze the correlation between the search intent of the mobile smart terminal 20 and the viewing behavior on the TV to determine the user's true intention. The mobile smart terminal 20 can also ensure the security and privacy of data transmission through a device security authentication module.
[0027] The home edge gateway 30 aggregates received set-top box operation data and mobile smart terminal operation data, or aggregates only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploads the set-top box-mobile smart terminal data packet or set-top box data packet to the cloud AI service platform 40. As the core hub for data interaction within the home, the home edge gateway 30 performs protocol conversion and format unification on the data uploaded by the set-top box 10 and the mobile smart terminal 20 (only when both are in the same home network environment), and utilizes edge computing capabilities to perform localized processing of some sensitive data to reduce data transmission latency and cloud load. More importantly, the home edge gateway 30 merges the data uploaded by the set-top box 10 and the mobile smart terminal 20 into a large data set packet (or set-top box-mobile smart terminal data packet), and then uploads it to the cloud AI service platform 40 through the interface protocol. For example, when both the set-top box 10 and the mobile smart terminal 20 are in a home network environment, the operation data of both the set-top box and the mobile smart terminal will be uploaded to the home edge gateway 30, and then uploaded to the cloud AI service platform 40 via the home edge gateway 30. Furthermore, the home edge gateway 30 also receives the data strategy returned by the cloud AI service platform 40 after successful upload, and uses this data strategy to generate a set-top box data update model. This model is then transmitted to the set-top box 10, which updates its content display order based on the data update model.
[0028] The cloud-based AI service platform 40 decrypts and parses the received set-top box-mobile smart terminal data packets, or decrypts and parses both the received set-top box data packets and the encrypted mobile smart terminal operation data, to form a mobile smart terminal data update model and a corresponding data strategy. The platform then distributes the mobile smart terminal data update model and data strategy to the mobile smart terminal 20 and the home edge gateway 30, respectively. The home edge gateway 30 forms a set-top box data update model based on the data strategy and transmits it to the set-top box 10. The mobile smart terminal 20 updates its content recommendation list based on the mobile smart terminal data update model, and the set-top box 10 updates its content display order based on the set-top box data update model, thereby achieving data sharing and collaborative processing between the mobile smart terminal 20 and the set-top box 10.
[0029] For example, in one exemplary embodiment, after receiving a data packet from a set-top box to a mobile smart terminal, or both a set-top box data packet and encrypted mobile smart terminal operation data, the cloud-based AI service platform 40 first decrypts the data packet using a pre-defined encryption method agreed upon by both ends. After decryption, it uses the device corresponding to the key to parse the current data packet or operation data to determine which terminal device the data belongs to. The parsed data is then written to the corresponding database table, and a fusion query is performed. A deep neural network model is deployed to perform fusion analysis on multi-source heterogeneous data (e.g., multimodal input data) to construct dynamic user behavior data for family members. The cloud-based AI service platform 40 continuously optimizes its content recommendation strategy through reinforcement learning algorithms and directly or indirectly sends the updated AI model parameters to the terminal devices (e.g., set-top boxes, mobile smart terminals). Simultaneously, the cloud-based AI service platform 40 also provides data upload and retrieval interfaces and uses an AI-response streaming data return mode to feed back the data uploaded by the terminal devices (including at least status information and the latest fusion data) to the terminal devices for more accurate display.
[0030] Furthermore, the cloud-based AI service platform 40 constructs a multilayer perceptron (MLP) recommendation model based on fused multi-source heterogeneous data, incorporating dimensions such as user interests, scene information, and family relationships. This model receives user feature vectors, current time, and device type data through its input layer, and outputs a personalized content recommendation list through nonlinear transformations in its hidden layer. The main task of the hidden layer is to extract data features using algorithms and to capture complex patterns in time-series data. Additionally, the model can capture complex patterns and features in the data through linear transformations and activation functions to return corresponding model data. Alternatively, the model also incorporates a collaborative filtering algorithm to analyze the correlation of viewing behaviors among family members. For example, when a family member watches a children's animation, the model automatically recommends similar high-quality animation content to the children's accounts in the family. Furthermore, the cloud-based AI service platform 40 can employ a time-decay-based sliding window algorithm to weight user behavior data. For example, recent behavior data is given higher weight, while historical data weight gradually decreases over time, thereby achieving dynamic updates of user behavior to reflect changes in user interests in real time.
[0031] Refer again Figure 1In a preferred embodiment of this disclosure, when the mobile smart terminal 20 is in a home network environment, the system's workflow 100 can be as follows: the set-top box 10 uploads set-top box operation data to the home edge gateway 30; the mobile smart terminal 20 encrypts and uploads mobile smart terminal operation data to the home edge gateway 30; the home edge gateway 30 aggregates the received set-top box operation data and mobile smart terminal operation data to form a set-top box-mobile smart terminal data packet, and uploads the set-top box-mobile smart terminal data packet to the cloud AI service platform 40; and the cloud AI service platform 40 decrypts and parses the received set-top box-mobile smart terminal data packet to form a first mobile smart terminal data update. The system generates a model and a first data strategy corresponding to the first mobile smart terminal data update model. The first mobile smart terminal data update model and the first data strategy are distributed to the mobile smart terminal 20 and the home edge gateway 30, respectively. The home edge gateway 30 forms a first set-top box data update model based on the first data strategy and transmits the first set-top box data update model to the set-top box 10. The mobile smart terminal 20 updates its content recommendation list based on the first mobile smart terminal data update model, and the set-top box 10 updates its content display order based on the first set-top box data update model. This enables data sharing and collaborative processing between the mobile smart terminal 20 and the set-top box 10 in a home network environment.
[0032] Refer again Figure 2In a preferred embodiment of this disclosure, when the mobile smart terminal 20 is in a non-home network environment, the system's workflow 200 can be as follows: the set-top box 10 uploads set-top box operation data to the home edge gateway 30; the mobile smart terminal 20 directly encrypts and uploads the mobile smart terminal operation data to the cloud AI service platform 40; the home edge gateway 30 aggregates the received set-top box operation data to form a set-top box data packet, and uploads the set-top box data packet to the cloud AI service platform 40; and the cloud AI service platform 40 decrypts and parses the received set-top box data packet and the encrypted mobile smart terminal operation data to form a second mobile smart terminal data update model and a second... The second data strategy corresponding to the second mobile smart terminal data update model is distributed to the mobile smart terminal 20 and the home edge gateway 30, respectively. The home edge gateway 30 forms a second set-top box data update model based on the second data strategy and transmits the second set-top box data update model to the set-top box 10. The mobile smart terminal 20 updates its content recommendation list based on the second mobile smart terminal data update model, and the set-top box 10 updates its content display order based on the second set-top box data update model. This enables data sharing and collaborative processing between the mobile smart terminal 20 and the set-top box 10 in a non-home network environment.
[0033] In a preferred embodiment of this disclosure, when the mobile smart terminal 20 is in a home network environment, the set-top box 10 uploads its operation data to the home edge gateway 30 via the HTTPS protocol. The mobile smart terminal 20 also uploads its operation data to the home edge gateway 30 in real time via Bluetooth or a hybrid communication protocol based on HTTP / 3 and WebSocket, thereby achieving real-time data synchronization between the home edge gateway 30 and the mobile smart terminal 20. For data with high real-time requirements, such as current playback progress and pause / play status, the WebSocket protocol can be used for push. For batch data, such as user profile updates and historical viewing records, the HTTP / 3 protocol can be used for efficient transmission, but it is not limited to HTTP / 3; HTTP / 2 or other protocols can also be used. In a preferred embodiment of this disclosure, when the mobile smart terminal 20 is in a non-home network environment, the set-top box 10 uploads its operation data to the home edge gateway 30 via HTTPS. The mobile smart terminal 20 stores its own operation data and, upon meeting a specific threshold, encrypts and uploads the data to the cloud AI service platform 40 via a cellular network or the currently connected WiFi or hotspot outside the home network environment. The specific threshold includes at least one of the following: the number of stored mobile smart terminal operation data entries reaches 1000, and the storage time reaches one week. Alternatively, the specific threshold can be customized by the user according to their needs. For example, the workflow 300 for uploading mobile smart terminal operation data to the cloud AI service platform 40 when the mobile smart terminal 20 is in a non-home network environment can be as follows: Figure 3 As shown, when the mobile smart terminal operation data meets a specific threshold (i.e., the number of stored data reaches 500, 1000, or 1500, or the storage time is one or two weeks), the mobile smart terminal operation data is encrypted and uploaded to the cloud AI service platform 40 via the interface of the cloud AI service platform 40 through the currently connected WiFi or hotspot outside the cellular network or home network environment; if the specific threshold is not met, the mobile smart terminal operation data continues to be stored in the local database of the mobile smart terminal 20.
[0034] In a preferred embodiment of this disclosure, the term "aggregation" can include the combination, classification, integration, protocol conversion, and format unification of data, etc. For example, when the mobile smart terminal 20 is in a home network environment, "aggregation" in this disclosure can include classifying the set-top box operation data of the set-top box 10 (such as clicks, viewing, swiping, page opening, searching, and other related data operations performed on the set-top box 10) and the mobile smart terminal operation data of the mobile smart terminal 20 (where the operation type performed on the mobile smart terminal 20 corresponds to the operation type performed on the set-top box 10) according to the operation type and combining them into initial data packets in the form of data groups (for example, a "click" operation in the set-top box 10 is combined into one initial data packet, and a "click" operation in the mobile smart terminal 20 is combined into...). An initial data packet, etc., will eventually be integrated into a large data packet, which may contain one terminal data packet (in the case where no operation is performed on the mobile smart terminal 20 in a home network environment or the mobile smart terminal 20 is not in a home network environment, in which case the single terminal data packet is only a data packet aggregated from set-top box operation data) or two terminal data packets (in the case where operation is performed on the mobile smart terminal 20 in a home network environment, in which case the two terminal data packets include both a data packet aggregated from set-top box operation data and a data packet aggregated from mobile smart terminal operation data). Additionally, the term "aggregation" can also include protocol conversion and format unification. For example, the above aggregation of received set-top box operation data and mobile smart terminal operation data also includes protocol conversion and format unification of the received set-top box operation data and mobile smart terminal operation data. Because the application (APP) software development languages of the set-top box 10 and the mobile smart terminal 20 are typically different, the data is converted into a unified data type (e.g., a JSON string) when it reaches the home edge gateway 30. This means that the received set-top box operation data and mobile smart terminal operation data undergo protocol conversion and format unification. Those skilled in the art should understand that even if the mobile smart terminal 20 is not in a home network environment (i.e., only one terminal data packet (set-top box operation data) reaches the home edge gateway 30) or if the software development languages of the various terminal applications are the same, the data will still be converted into a unified data type (e.g., a JSON string).
[0035] In a preferred embodiment of this disclosure, the home edge gateway 30 can be integrated into the set-top box 10. For example, the set-top box 10 carrying the home edge gateway 30 can be connected to a TV or other display via an HDMI cable, and the user can access the set-top box 10 via WiFi or wired network to complete the account login and settings functions of the set-top box 10.
[0036] In a preferred embodiment of this disclosure, the user can provide feedback to the cloud AI service platform 40 on whether the content recommendation list of the mobile smart terminal 20 and the content display order of the set-top box 10 meet the user's expectations, so as to optimize the cloud AI service platform 40.
[0037] In a preferred embodiment of this disclosure, the mobile smart terminal 20 can be any type of mobile or portable terminal with communication capabilities, including mobile phones, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal digital assistants (PDAs), audio / video players, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. More specifically, for example, the mobile smart terminal 20 of this disclosure has a dedicated APP for use with the set-top box application (APP) in the set-top box 10, such as an APP named "Yiban".
[0038] In a preferred embodiment of this disclosure, a user registers a user account by scanning a QR code on a set-top box 10 (e.g., a set-top box app on the set-top box 10) using a mobile smart terminal 20 (e.g., an app on the mobile smart terminal 20), and then binds the mobile smart terminal 20 and the set-top box 10 for the user account. For example, when using the mobile smart terminal 20 for the first time, the user only needs to scan the QR code on the set-top box 10 using the "scan" function on the mobile smart terminal 20 to register a user account (i.e., user identity binding), and then bind the mobile smart terminal 20 to the set-top box 10 for that user account.
[0039] In a preferred embodiment of this disclosure, Figure 1 and Figure 2 There can be multiple mobile smart terminals 20 and multiple users (e.g., family members), and each user corresponds one-to-one with a registered user account. For example, a user can register a user account on one or more mobile smart terminals 20, and one or more user accounts can also be registered on a mobile smart terminal 20. Additionally or alternatively, there are permission levels between user accounts, and a user account with higher-level permissions (e.g., a parent's account) can set some or all of the operations of a user account with lower-level permissions (e.g., a child's account). For example, in a preferred embodiment of this disclosure, "permission" refers to the interaction and sharing permissions between user accounts, such as a parent having the permission to recommend suitable content for children to the set-top box 10 or mobile smart terminal 20 (e.g., a children's watch) of the child's account through the parent's mobile smart terminal 20, or to limit the time children spend watching television content.
[0040] Additionally or alternatively, in a preferred embodiment of this disclosure, the system also introduces a version control mechanism to ensure data consistency during updates across different terminal devices. For example, when the mobile smart terminal 20 modifies personal preference settings, the version number automatically increments, and the set-top box 10 actively retrieves the latest data for updates when it detects version differences. Simultaneously, the set-top box 10 and the mobile smart terminal 20 synchronize the latest model data through the interface of the cloud AI service platform 40 after each startup and data upload. Furthermore, the system introduces privacy protection (i.e., encrypted storage of uploaded data) and access control. The cloud AI service platform 40 employs federated learning technology to achieve cross-terminal device AI model training without disclosing the original data. Each terminal device only uploads encrypted model parameter update values to the cloud AI service platform 40, which performs deep cloud aggregation, effectively protecting user privacy. The cloud AI service platform 40 sets independent data access permissions for each family member. Parents can restrict the content and usage time of children's accounts, while also supporting the separation of permissions for shared content libraries and private personal content among family members.
[0041] A preferred embodiment of this disclosure provides hardware deployment and software implementation of the aforementioned components and terminal devices. Specifically, for set-top box 10, a high-performance ARM processor and at least 512MB of memory expansion are added to the existing set-top box hardware to run the AI inference engine and data processing program; simultaneously, the network module is upgraded to support WiFi 6 and Bluetooth 5.2 protocols to ensure data transmission stability. Mobile smart terminal 20 (e.g., its dedicated app used in conjunction with the set-top box app of set-top box 10) is compatible with Android 8.0 and above, and iOS 11.0 and above, utilizing the sensors (such as GPS, gyroscope, etc.) of mobile smart terminal 20 to collect more multi-dimensional user scenario data. The set-top box app of set-top box 10 is based on the Linux operating system, uses C++ and Java languages to develop data acquisition and processing modules, and uses the TensorFlow Lite framework to deploy lightweight AI models; the home edge gateway 30 achieves real-time communication with mobile smart terminal 20 via WebSocket and uses an SQLite database to store local user data. The mobile smart terminal 20 uses localized user behavior data storage and performs business logic matching with the set-top box 10 via WebSocket or Bluetooth. After verifying the identity information, it calls the interface of the cloud AI service platform 40 to upload user operation data for further data logic processing.
[0042] For example, in a preferred embodiment of this disclosure, Figure 4It provides a workflow 400 for data transmission and corresponding data backhaul logic between the set-top box 10, mobile smart terminal 20, home edge gateway 30, and cloud AI service platform 40. For example... Figure 4 As shown, the data from the mobile smart terminal 20 is transmitted to the home edge gateway 30 in encrypted JSON format. The home edge gateway 30 then transmits the data to the cloud AI service platform 40. The cloud AI service platform 40 then transmits the returned aggregation command (e.g., update data packet) to the home edge gateway 30. The home edge gateway 30 then transmits the data back to the set-top box 10. The set-top box 10 then synchronizes the data with the mobile smart terminal 20.
[0043] The cloud-based AI service platform 40 adopts a hybrid architecture of "enterprise AI cloud service + dual public clouds," achieving capability integration through a unified service mesh. Specifically, the cloud-based AI service platform 40 uses enterprise AI cloud services for data management and AI model training management; it is built on Alibaba Cloud / Tencent Cloud, with AI model training and management modules developed using Python, and container orchestration and cluster management using Kubernetes. The database uses MongoDB to store user data, and Redis is used for data caching, thereby improving system response speed.
[0044] Those skilled in the art will readily understand that the data acquisition and processing units, data acquisition modules, and device security authentication modules described above are merely units or modules established for the purpose of clearly illustrating this disclosure. They can be implemented individually or integrated into one or more composite modules. Those skilled in the art should also understand that the aforementioned data acquisition and processing units, data acquisition modules, and device security authentication modules can be implemented using various methods (e.g., software, hardware, firmware, or any combination thereof). In some embodiments, these units or modules can be implemented using software and / or firmware (e.g., machine-executable instructions stored on a storage medium). In addition to or as an alternative to machine-executable instructions, some or all of the units or modules in the system can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include Field-Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Samples (ASSPs), System-on-Chip (SOCs), Complex Programmable Logic Devices (CPLDs), and so on.
[0045] Furthermore, utilizing the aforementioned system, one embodiment of this disclosure provides a method for achieving data sharing between home multimedia terminal devices. The method includes: a set-top box 10 collecting set-top box operation data generated by a user operating the set-top box 10, and uploading the set-top box operation data to a home edge gateway 30; a mobile smart terminal 20 collecting mobile smart terminal operation data generated by a user operating the mobile smart terminal 20, and encrypting and uploading the mobile smart terminal operation data to the home edge gateway 30 or a cloud AI service platform 40; the home edge gateway 30 aggregating the received set-top box operation data and mobile smart terminal operation data, or aggregating only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and then transmitting the set-top box-mobile smart terminal data packet or set-top box data packet. The data is uploaded to the cloud AI service platform 40; the cloud AI service platform 40 decrypts and parses the received set-top box-mobile smart terminal data packet or decrypts and parses both the received set-top box data packet and the encrypted mobile smart terminal operation data to form a mobile smart terminal data update model and a data strategy corresponding to the mobile smart terminal data update model. The mobile smart terminal data update model and data strategy are then distributed to the mobile smart terminal 20 and the home edge gateway 30, respectively. The home edge gateway 30 forms a set-top box data update model based on the data strategy and transmits the set-top box data update model to the set-top box 10; the mobile smart terminal 20 updates its content recommendation list based on the mobile smart terminal data update model, and the set-top box 10 updates its content display order based on the set-top box data update model.
[0046] One embodiment of this disclosure discloses a system for data sharing among home multimedia terminal devices. Through a home edge gateway 30 and a cloud AI service platform 40, it enables data sharing and collaborative processing between home multimedia terminal devices such as a set-top box 10 and a mobile smart terminal 20. This achieves seamless switching across terminal devices, breaks down data silos between devices, and realizes intelligent collaboration among home multimedia devices. Content marked for viewing on the mobile smart terminal 20 can be automatically synchronized to the set-top box 10, allowing continued viewing on the TV screen connected to the set-top box 10 without repeated searching. Simultaneously, personalized recommendations generated by the set-top box 10 based on historical viewing records can adapt to the user's usage scenario on the mobile smart terminal 20, significantly improving the accuracy of personalized recommendations and reducing the time users spend filtering content on the mobile smart terminal 20, thereby enhancing the overall user experience. This system enhances the synergy of home devices and promotes interaction and sharing among family members through a shared home content library and related recommendations. For example, parents can push content suitable for children to their children's accounts on the mobile smart terminal 20 or set-top box 10 with a single click. Furthermore, by combining edge computing with a local inference engine, the system reduces the pressure on cloud data processing, decreases data transmission bandwidth consumption, and improves recommendation response speed. Moreover, through federated learning and hierarchical permission management mechanisms, the system ensures both the effectiveness of data sharing and strengthens privacy protection, guaranteeing user privacy and security.
[0047] Furthermore, this system addresses the issues of data silos between home multimedia devices and insufficient personalized user experience. By constructing a multimodal data interaction protocol and combining edge computing with a cloud-based collaborative processing architecture, it enables bidirectional real-time sharing of user profiles, viewing preferences, and intelligent recommendations between the set-top box 10 and the mobile smart terminal 20. The system can automatically optimize content recommendation strategies based on family members' usage habits, enhancing the intelligence and personalization of the home audio-visual entertainment system. Compared to traditional devices, it results in more accurate content acquisition for users and more efficient collaboration between home multimedia terminal devices.
[0048] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of the systems and methods according to various embodiments of this disclosure. Each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which includes one or more executable instructions for implementing a specified logical function. In some alternative embodiments, each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0049] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be readily understood by those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to better understand the various implementations disclosed herein.
Claims
1. A system for enabling data sharing between home multimedia terminal devices, characterized in that, This includes set-top boxes, mobile smart terminals, home edge gateways, and cloud-based AI service platforms; The set-top box is used to upload set-top box operation data generated by user operations to the home edge gateway; The mobile smart terminal is used to encrypt and upload the mobile smart terminal operation data generated by the user's operation to the home edge gateway or the cloud AI service platform. The home edge gateway is used to aggregate both the received set-top box operation data and the mobile smart terminal operation data, or only the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploads the set-top box-mobile smart terminal data packet or the set-top box data packet to the cloud AI service platform; and The cloud-based AI service platform decrypts and parses the received data packets from the set-top box to the mobile smart terminal, or decrypts and parses both the received set-top box data packets and the encrypted mobile smart terminal operation data, to form a mobile smart terminal data update model and a corresponding data strategy. The platform then distributes the mobile smart terminal data update model and the data strategy to the mobile smart terminal and the home edge gateway, respectively. The home edge gateway, based on the data strategy, forms a set-top box data update model and transmits it to the set-top box. The mobile smart terminal updates its content recommendation list based on the mobile smart terminal data update model, and the set-top box updates its content display order based on the set-top box data update model.
2. The system according to claim 1, characterized in that, When the mobile smart terminal is in a home network environment: The set-top box uploads its operation data to the home edge gateway; The mobile smart terminal encrypts and uploads its operation data to the home edge gateway; The home edge gateway aggregates the received set-top box operation data and mobile smart terminal operation data to form a set-top box-mobile smart terminal data packet, and uploads the set-top box-mobile smart terminal data packet to the cloud AI service platform; and The cloud-based AI service platform decrypts and parses the received data packets from the set-top box to the mobile smart terminal to form a first mobile smart terminal data update model and a first data strategy corresponding to the first mobile smart terminal data update model. The platform then distributes the first mobile smart terminal data update model and the first data strategy to the mobile smart terminal and the home edge gateway, respectively. The home edge gateway, based on the first data strategy, forms a first set-top box data update model and transmits it to the set-top box. The mobile smart terminal updates its content recommendation list based on the first mobile smart terminal data update model, and the set-top box updates its content display order based on the first set-top box data update model.
3. The system according to claim 1, characterized in that, When the mobile smart terminal is in a non-home network environment: The set-top box uploads its operation data to the home edge gateway; The mobile smart terminal directly encrypts and uploads its operation data to the cloud AI service platform. The home edge gateway aggregates the received set-top box operation data to form the set-top box data packet, and uploads the set-top box data packet to the cloud AI service platform; and The cloud-based AI service platform decrypts and parses the received set-top box data packets and encrypted mobile smart terminal operation data to form a second mobile smart terminal data update model and a second data strategy corresponding to the second mobile smart terminal data update model. The platform then distributes the second mobile smart terminal data update model and the second data strategy to the mobile smart terminal and the home edge gateway, respectively. The home edge gateway, based on the second data strategy, forms a second set-top box data update model and transmits it to the set-top box. The mobile smart terminal updates its content recommendation list based on the second mobile smart terminal data update model, and the set-top box updates its content display order based on the second set-top box data update model.
4. The system according to claim 1, characterized in that, When the mobile smart terminal is in a home network environment, the set-top box uploads its operation data to the home edge gateway via the HTTPS protocol, and the mobile smart terminal uploads its operation data to the home edge gateway in real time with encryption based on a hybrid communication protocol of HTTP / 3 and WebSocket. When the mobile smart terminal is in a non-home network environment, the set-top box uploads its operation data to the home edge gateway via HTTPS protocol. The mobile smart terminal stores its own operation data and, when a specific threshold is met, encrypts and uploads the operation data to the cloud AI service platform via cellular network or WiFi or hotspot outside the home network environment. The specific threshold includes at least one of the following: the number of stored mobile smart terminal operation data entries reaches 1000 and the storage time of the mobile smart terminal operation data reaches one week. Alternatively, the specific threshold can be customized by the user.
5. The system according to claim 1, characterized in that, The set-top box includes a data acquisition and processing unit, used to acquire and perform preliminary cleaning and feature extraction on the set-top box operation data before uploading it to the home edge gateway; and the mobile smart terminal includes a data acquisition module, used to acquire the mobile smart terminal operation data.
6. The system according to claim 1, characterized in that, The user can provide feedback to the cloud AI service platform on whether the content recommendation list on the mobile smart terminal and the content display order on the set-top box meet the user's expectations, so as to optimize the cloud AI service platform.
7. The system according to claim 1, characterized in that, The user registers a user account by scanning the QR code on the set-top box using the mobile smart terminal, and then binds the mobile smart terminal to the set-top box for the user account.
8. The system according to claim 7, characterized in that, The user can register the user account on one or more of the mobile smart terminals, and one or more of the user accounts can also be registered on the mobile smart terminals.
9. The system according to claim 7, characterized in that, The user accounts have permission levels, and the user account with higher-level permissions can set some or all of the operations of the user account with lower-level permissions.
10. A method for enabling data sharing between home multimedia terminal devices, characterized in that, include: The set-top box uploads the set-top box operation data generated by the user's operation to the home edge gateway; The mobile smart terminal operation data generated by the user's operation is encrypted and uploaded to the home edge gateway or cloud AI service platform; The home edge gateway aggregates the received set-top box operation data and the mobile smart terminal operation data, or only aggregates the received set-top box operation data, to form a set-top box-mobile smart terminal data packet or a set-top box data packet, and uploads the set-top box-mobile smart terminal data packet or the set-top box data packet to the cloud AI service platform; The cloud-based AI service platform decrypts and parses the received set-top box-mobile smart terminal data packets, or decrypts and parses both the received set-top box data packets and the encrypted mobile smart terminal operation data, to form a mobile smart terminal data update model and a data strategy corresponding to the mobile smart terminal data update model. The mobile smart terminal data update model and the data strategy are then sent to the mobile smart terminal and the home edge gateway, respectively. The home edge gateway forms a set-top box data update model based on the data strategy and transmits the set-top box data update model to the set-top box. as well as The mobile smart terminal updates its content recommendation list based on the mobile smart terminal data update model, and the set-top box updates its content display order based on the set-top box data update model.