Image device application method and system using set-top box as super portal

Abstract

The application discloses an image device application method and system taking a set top box as a super portal, relates to the technical field of television playing, and comprises the set top box and a remote controller. The set top box establishes a data connection relationship with a plurality of other smart home devices outside a television set. The set top box is configured to perform scene demand analysis on one or more of voice information, use records and monitoring data by using preloaded AIGC and AIoT models, or to perform scene demand analysis on one or more of voice information, use records and monitoring data by using a pre-connected AIGC platform and an AIoT platform. The application determines a matched pre-installed application App according to the scene demand analysis result and imports the demand analysis result. The application displays response information of the application App after the demand analysis result is imported. The application has the effects of reducing the limitation of smart home experience improvement and reducing cost.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of television playing, in particular to an image device application method and system taking a set-top box as a super portal. BACKGROUND

[0002] With the development of Internet of Things technology, home devices gradually develop towards intelligence, which greatly improves the user's home experience, but the current intelligent home has problems such as supporting many and high cost.

[0003] Taking a smart sound box as an example, it can be used to collect the user's audio after being connected to the living room and the like, and the audio is connected to identify and play music or control the paired lamps, air conditioners and the like, but it is relatively closed, and the brand ecology is highly dependent, and the demand involved in the home is high, and the diversified customized service is limited, so the present application provides a new technical solution. SUMMARY

[0004] In order to reduce the limitation of intelligent home experience improvement and reduce the cost, the present application provides an image device application method and system taking a set-top box as a super portal.

[0005] In a first aspect, the present application provides an image device application system taking a set-top box as a super portal, which adopts the following technical solution:

[0006] An image device application system taking a set-top box as a super portal, comprising:

[0007] A set-top box adapted to a target television;

[0008] A remote controller adapted to the set-top box and the television;

[0009] Among them, the set-top box and / or the remote controller integrates a microphone, the set-top box establishes a data connection relationship with a plurality of other smart home devices and environment information monitoring modules outside the television, the other smart home devices at least include one or more of a smart air conditioner, a smart lamp, a smart sound, and a smart door and window, and the environment information monitoring module includes one or more of a human body infrared sensor, a VOC environment monitoring unit, and a gas sensor;

[0010] The set-top box is configured to:

[0011] Audio recognition is performed on the user voice data picked up by itself, or audio recognition is performed on the audio data picked up by the remote controller to obtain voice information;

[0012] Obtain the use records and monitoring data of the television and other smart home devices, and obtain the monitoring data of the environment monitoring module;

[0013] The preloaded AIGC and AIoT model are used to analyze the scene demand of one or more of the voice information, use records and monitoring data; or, the pre-connected AIGC platform and AIoT platform are used to analyze the scene demand of one or more of the voice information, use records and monitoring data;

[0014] The matched pre-installed application App is determined according to the scene demand analysis result, and the demand analysis result is imported;

[0015] The response information after the demand analysis result is imported into the application App is displayed through the television set; or, the response information after the demand analysis result is imported into the application App is sent to other smart home devices, and the response results of the other smart home devices are displayed through the television set.

[0016] Optionally, the set-top box is provided with a physical data interface and is configured to:

[0017] If the physical data interface is connected, then:

[0018] The ID of the connected device is obtained, and screen projection inquiry and resource sharing inquiry are performed;

[0019] If the screen projection sharing inquiry is passed, the display data interaction with the connected device is performed, and a wireless data connection is requested to be established based on the ID of the device, and the display data interaction is maintained through the wireless network when the physical data interface is disconnected;

[0020] If the resource sharing inquiry is passed, a shared window is requested to be established, the app and resource data dragged into the window are read, the app installation program is obtained, and the resource data is copied.

[0021] Optionally, the set-top box further establishes a data connection relationship with a smart wearable device, and the smart wearable device includes a smart ring and a smart watch.

[0022] The set-top box is configured to:

[0023] The body index collected by the smart wearable device is obtained, and scene demand analysis is performed based on the body index;

[0024] If the scene demand analysis result includes a health suggestion scene, a health / medical function APP in the application APP is called to generate a health management suggestion.

[0025] Optionally, the set-top box is configured to:

[0026] The collected user audio data is subjected to human voice recognition and user identity binding;

[0027] The user identity is identified based on the ID corresponding to the current body index;

[0028] If the current time is not a health management suggestion display period, the corresponding historical entertainment behavior record is found according to the user identity, and entertainment preference analysis is performed.

[0029] The television or other smart home device displays content according to the entertainment preference analysis result.

[0030] Optionally, the set-top box is configured to:

[0031] Record the installation position of the television.

[0032] If two or more user identities are currently identified, indoor positioning is performed based on the interaction information of the smart wearable device.

[0033] According to the positions of the users, a user in the visible range of the television is determined as a target user.

[0034] The entertainment preference analysis is matched with the target user.

[0035] Optionally, the set-top box is configured to pre-establish a personalized information display logic.

[0036] The personalized information display logic includes: if two or more user identities are currently identified, receiving a user's active request to switch the television to display content; if no active request is received, the television is stopped from displaying information matched with another user identity before the health management suggestion or the entertainment preference content display matched with any one user identity is ended.

[0037] Optionally, the set-top box is configured to:

[0038] Record the television display duration of the content matched with any one user identity.

[0039] If the television display duration is greater than a preset lower limit of the duration, behavior scene analysis is performed based on the user's physical indicators, and the television is stopped from working when the behavior scene is sleep.

[0040] Optionally, the set-top box is configured to:

[0041] Record the permission level of the user identity.

[0042] If an active request of a user is received and the corresponding permission level is higher than the permission level of the user identity responded by the current television or other smart home device, the active request is updated and responded.

[0043] Optionally, the set-top box imports a preset AIGC program or sets up an interface to an AIGC platform, and performs scene demand analysis using the AIGC program or the AIGC platform.

[0044] Optionally, the set top box is connected with a pre-installed security system and / or a home energy management system, and the set top box is configured to cause the television to display the real-time energy consumption information and the security information if the real-time energy consumption information and the security information meet preset prompt conditions.

[0045] In a second aspect, the application provides an image device application method using a set top box as a super portal, which uses the following technical solution:

[0046] An image device application method using a set top box as a super portal, which uses the image device application system data connection target television of any of the above.

[0047] In summary, the application has the following beneficial technical effects:

[0048] 1. Using a set top box as an intermediate body, multiple home appliances are interconnected, the set top box can be installed with multiple applications to meet the diversified customized smart home needs, different needs and different configurations, and the price is more easily accepted by users;

[0049] 2. Television covers a wide range, and the old television can be used by purchasing a set top box, which is more cost-effective;

[0050] 3. Although the television and the set top box are fixed, a movable remote controller can be used as a relay, and the use is less limited. BRIEF DESCRIPTION OF DRAWINGS

[0051] Figure 1 It is a system structure schematic diagram of the application.

[0052] Marked with 1, set top box; 2, remote controller. DETAILED DESCRIPTION

[0053] The following will be combined with the Figure 1 The application will be further described in detail.

[0054] The application embodiment discloses an image device application system using a set top box as a super portal.

[0055] Refer to Figure 1 The image device application system using a set top box as a super portal includes a set top box 1 and a remote controller 2, wherein the set top box 1 should integrate a Bluetooth module, a WIFI module and the like, so as to be connected with an adapted target television and also to be connected with a plurality of other smart home devices and environmental information monitoring modules; the remote controller 2 is adapted to the set top box 1 and the television; in order to meet the use requirements, the set top box 1 and / or the remote controller 2 are required to integrate a microphone in the application, so that the user can control the television through voice.

[0056] The other smart home devices include one or more of a smart air conditioner, a smart lamp, a smart sound, and a smart door and window, to realize functions such as automatic adjustment of indoor temperature and humidity, automatic adjustment of lighting, automatic playing of music, and automatic opening and closing of doors and windows. The environmental information monitoring module includes one or more of a human body infrared sensor, a VOC environmental monitoring unit, and a gas sensor, to detect the position of the user and indoor air.

[0057] The set top box 1 is configured to:

[0058] 1. Perform audio recognition on the user voice data picked up by itself, or perform audio recognition on the audio data picked up by the remote controller 2 to obtain voice information; audio-to-text is prior art, and thus will not be described again.

[0059] 2. Obtain the use records and monitoring data of the television and other smart home devices, and obtain the monitoring data of the environmental monitoring module.

[0060] 3. Perform scene demand analysis on one or more of the voice information, use records, and monitoring data by using a preloaded AIGC and AIoT model, or perform scene demand analysis on one or more of the voice information, use records, and monitoring data by using a pre-connected AIGC platform and AIoT platform; the AIGC is, for example, Kimi or chatgpt, and when the program model monomer is too large, an interface connection form can also be used to realize, that is, to connect to the corresponding cloud platform; the AIoT is an artificial intelligence Internet of Things system, and the same applies.

[0061] Scene demand analysis examples: A. The user is located in the living room from 8 a.m. to 9 a.m. on Saturday, and at this time in the past, the user was playing music or watching a certain news channel, so the current scene demand is to control the smart sound to play music or turn on the television to watch the corresponding news channel; B. The audio picked up by the set top box 1 indicates that the user wants to open the smart window in the bedroom, so the current scene demand is to open the smart window in the bedroom.

[0062] 4. Determine the matched pre-installed application App according to the scene demand analysis result, and import the demand analysis result; it can be understood that in this embodiment, the set top box 1 serves as a vertical application super portal, and can install diversified customized application Apps, such as a music App, a health management App, a control App for a smart lamp, a control App for a smart air conditioner, and the like, so that the set top box 1 can make the matched devices run to meet the user's demand; the matching relationship can be pre-recorded or automatically recognized by AI.

[0063] 5, the response information after the demand analysis result is imported into the application App is displayed through the TV set; or, the response information after the demand analysis result is imported into the application App is sent to other smart home devices, and the response result of other smart home devices is displayed through the TV set; that is, the TV set exists as an information large screen at this time to improve the user's smart interaction experience.

[0064] According to the above, the system has the following advantages:

[0065] 1. The set-top box is used as an intermediate body to interconnect multiple home appliances, the set-top box can install multiple applications to meet the diversified customization needs of smart home, different configurations for different needs, and the price is more acceptable to users.

[0066] 2. The TV set covers a wide range, and the old TV set can be used by purchasing the set-top box, which has a lower cost.

[0067] 3. Although the TV set and the set-top box are fixed, they can use a movable remote control as a relay, and the use is less limited.

[0068] It can be understood that in addition to using the smart air conditioner to sense the temperature and humidity of the environment, an independent temperature and humidity sensor can also be installed as a component of the environment monitoring module, so the set-top box 1 uses the temperature sensor to feedback the indoor temperature > 28℃, the scene demand analysis is a cooling scene, and the corresponding smart air conditioner works.

[0069] In an embodiment of the system, the set-top box 1 is provided with a physical data interface, for example, a USB data interface, and is configured to:

[0070] If the physical data interface is connected, for example, a mobile phone is connected with a USB data line and a Type-c data line, then:

[0071] Get the ID of the connected device and ask for screen projection and resource sharing;

[0072] If the screen projection and resource sharing inquiry is passed, the display data interaction is carried out with the connected device, and a wireless data connection is requested based on the ID of the device, and the display data interaction is maintained through the wireless network when the physical data interface is disconnected. One advantage of this setting is that the existing TV set screen projection is not simple to operate, especially for the elderly and users with limited education, and the operation is more difficult. After applying the present application, the set-top box is used as a super entry, and the user only needs to interconnect the set-top box and the mobile phone with a data line to project the video played on the mobile phone to the TV set large screen, which is convenient for the elderly to enjoy, and the present application does not completely rely on the data line. The data line is connected more to simplify the process of establishing the screen projection relationship, and after the data line is pulled out, it can continue to maintain, which can effectively improve the use effect of the set-top box as a super entry.

[0073] If the resource sharing inquiry passes, a shared window is requested to be established, an app and resource data dragged into the window are read, and an app installer is acquired and resource data is copied.

[0074] Example: the shared window, which can be a small program with data reading and copying functions, is automatically and quickly installed after access and pops up a window for use, and is automatically uninstalled within 1 minute after the data line is disconnected. In addition to helping users copy resource data to the set-top box, the shared window is more important in that the name of the app on the mobile phone or other device dragged into the window is read, because the application needs to meet the requirements of the super portal, which involves various device corresponding function apps. It would be cumbersome for users to enter the app market one by one to download apps through the TV remote control or the set-top box remote control, especially since the app download channel of some smart devices is now shared on the instruction manual in the form of a two-dimensional code, and the set-top box does not have a code scanning function, which makes it cumbersome to install apps on the set-top box. The above setting can be used to solve this problem.

[0075] In an embodiment of the system, the set-top box 1 also establishes a data connection relationship with a smart wearable device, which includes a smart ring and a smart watch.

[0076] In this embodiment, the smart wearable device can be interconnected with the set-top box 1 and the remote control 2 through the internally integrated Bluetooth module. The reason for using Bluetooth connection is to facilitate indoor positioning of users, which is described in another embodiment.

[0077] On the basis of the above, the set-top box 1 is configured to:

[0078] Obtain the body index collected by the smart wearable device, and perform scene demand analysis based on the body index;

[0079] If the scene demand analysis result includes a health suggestion scene, a health / medical function APP in the application APP is called to generate a health management suggestion.

[0080] Example: the scene demand analysis result includes heart rate and walking data indicating that the user has just gotten up in the morning, and the APP can be used to process the user's sleep data to generate a sleep quality report as a suggestion; if the body index indicates that the user is overweight, the APP can be used to generate a weight loss plan and an exercise plan as a suggestion. It can be understood that the above-mentioned health / medical function APP is not only a localized application, but also a digital human of traditional Chinese and Western medicine, which is connected to the API interface of the third-party platform of the operator signed by the set-top box 1.

[0081] According to the above, the set top box 1 can also establish a connection with the smart wearable device to play a health assistant, digital doctor according to the user's physical indicators, and guide the user to manage health; at the same time, because it is displayed by the TV, the visualization and communication experience are better.

[0082] In another embodiment of the system, the set top box 1 is configured to:

[0083] Perform human voice recognition on the collected user audio data and bind the user identity;

[0084] Identify the user identity based on the ID corresponding to the current physical indicators;

[0085] If the current time is not a health management suggestion display period (for example, the user sets health suggestions from 7 to 7:30 every day, and the current time is 8), the corresponding historical entertainment behavior records are searched according to the user identity, and entertainment preference analysis is performed;

[0086] Make the TV or other smart home devices display content according to the entertainment preference analysis results.

[0087] According to the above settings, the system can cooperate with the smart wearable device to determine who the user at home is, and then analyze the historical entertainment behavior records of the user and push TV, movies, news, music, etc. to achieve a relatively comfortable home life experience.

[0088] It should be noted that unlike traditional APPs that make recommendations based on user portraits, because they are based on platform promotion purposes (such as advertising, movie recommendations, etc.), they often encounter recommendations that are not what the user wants at the moment; the system is based on user real-time data such as voice call content and TV play records for analysis and push, so it is more in line with the user's real needs.

[0089] The above human voice recognition technology is a prior art, so it will not be described again. The above entertainment preference analysis, for example, the historical records show that the user plays music from 8 to 9 every Monday to Friday at least three days a week, so playing music from 8 to 9 every Monday to Friday is determined as a preference.

[0090] It can be understood that the above entertainment preference analysis, etc. will be relatively rigid if the analysis logic conditions are written in advance, so the generative AI is introduced into the set top box 1, and the AI is more flexible in analyzing and understanding the user's needs, so that the set top box 1 can serve as the user's second brain, providing personal TV content, health, information, psychological and physiological, education expert assistant services.

[0091] In another embodiment of the system, the set top box 1 is configured to:

[0092] Record the installation position of the TV set; in this embodiment, the installation position is, for example, a living room or a master bedroom, which is a range value rather than a single point position;

[0093] If two or more user identities are currently identified, indoor positioning is performed based on the interaction information of the smart wearable device.

[0094] According to the positions of the users, a user in the visible range of the TV set is determined as a target user.

[0095] The entertainment preference analysis is matched with the target user.

[0096] According to the above settings, when there are multiple users at home, it is possible to actively identify which user is suitable for the system to recommend personalized news, TV, and the like for the user; more importantly, it is not necessary to lay out other devices, and it is only necessary to reasonably utilize the existing devices to achieve the purpose.

[0097] The indoor positioning is exemplified as follows: the set-top box 1 prewrites a calling function and opens the permission to acquire the signal strength, finds the pre-recorded signal strength-distance relationship table according to the signal strength, obtains the distance between the user and the set-top box 1, and locates whether the user is in the living room. In this way, the permission can be opened to the user, and the user can actively modify the signal-distance relationship table to improve the customization effect.

[0098] On the basis of the above, the set-top box 1 is configured to pre-establish a personalized information display logic.

[0099] The personalized information display logic includes:

[0100] If two or more user identities are currently identified, the following is performed: receiving a user active request to switch the display content of the TV set; if the user active request is not received, the display of the information matched with another user identity is terminated before the display of the health management suggestion and the entertainment preference content matched with any one user identity is terminated.

[0101] According to the above settings, it is possible to prevent a user from watching recommended news and the like, and another user from coming over, and the system from directly switching and interrupting the first user, so as to improve the user experience; after the above adjustment, if a news is being played, the news is played to the end before the system responds to the user active request and switches the content.

[0102] Further, in order to facilitate parents and the like to manage the smart home devices, the set-top box 1 is configured to:

[0103] Record the permission level of the user identity; for example, the parents are the first-level permission, the children are the second-level permission, and the first-level permission is greater than the second-level permission.

[0104] If a user initiates a request and the corresponding permission level is higher than the permission level of the user identity responded by the TV set and other smart home devices, the active request is updated and responded.

[0105] In another embodiment of the system, the set-top box 1 is configured to:

[0106] The TV set displays the duration of the content matching any user identity.

[0107] If the TV set display duration is greater than the preset lower limit of the duration (e.g., 1.5 hours), the behavior scene analysis is performed based on the user's physical indicators, and the TV set is stopped when the behavior scene is sleep.

[0108] According to the above content, the set-top box 1 can evaluate whether the user is asleep based on the physical indicators collected by the smart wearable device, and if it is found that the user has fallen asleep, the TV set will be automatically stopped to avoid disturbing the user's rest and save energy.

[0109] It can be understood that, on the basis of the above, the set-top box 1 can also be connected to a security system and / or a home energy management system through a network, the security system such as a door camera and a doorbell, and the home energy management system such as a smart meter.

[0110] The set-top box 1 is configured to: if the real-time energy consumption information and security information meet the preset prompt conditions, for example, the remaining power is less than 50 degrees, and the doorbell is pressed, the TV set displays the real-time energy consumption information and security information, that is, the remaining power and the real-time image of the camera.

[0111] The application also discloses an image device application method taking a set-top box as a super portal.

[0112] The image device application method taking the set-top box as the super portal includes connecting a target TV set to the image device application system taking the set-top box as the super portal.

[0113] The above are preferred embodiments of the application, and are not intended to limit the protection scope of the application, so: any equivalent changes made on the basis of the structure, shape, principle of the application shall be covered within the protection scope of the application.

Claims

1. A video equipment application system using a set-top box as a super entry point, characterized in that, include: Set-top box (1), which is compatible with the target television set; Remote control (2), which is compatible with set-top box (1) and television; The set-top box (1) and / or remote control (2) integrate a microphone. The set-top box (1) establishes a data connection relationship with several other smart home devices and an environmental information monitoring module outside the television. The other smart home devices include at least one or more of smart air conditioners, smart lamps, smart speakers, and smart doors and windows. The environmental information monitoring module includes one or more of human infrared sensors, VOC environmental monitoring units, and gas sensors. The set-top box (1) is configured as follows: Perform audio recognition on the user voice data picked up by itself; or, perform audio recognition on the audio data picked up by the remote control (2) to obtain voice information; Acquire usage records and monitoring data from the TV and other smart home devices, as well as monitoring data from the environmental monitoring module; Analyze the scenario requirements of one or more of the following using pre-loaded AIGC and AIoT models: voice information, usage records, and monitoring data; or, analyze the scenario requirements of one or more of the following using pre-connected AIGC and AIoT platforms: voice information, usage records, and monitoring data. Based on the scenario requirements analysis results, determine the matching pre-installed application apps and import the requirements analysis results; The response information after importing the requirements analysis results into the application app can be displayed on a TV; or, the response information after importing the requirements analysis results into the application app can be sent to other smart home devices, and the response results of other smart home devices can be displayed on a TV. The set-top box (1) is equipped with a physical data interface and is configured as follows: If a physical data interface is connected, then: Obtain the ID of the access device and perform screen mirroring and resource sharing inquiries; If the screen sharing query is successful, it will interact with the access device to display data, and establish a wireless data connection based on the device ID. It will maintain the display data interaction via wireless network when the physical data interface is disconnected. If the resource sharing query is successful, a sharing window is requested to be established, and the app and resource data dragged into the window are read. The app installation program is obtained and the resource data is copied. The set-top box (1) also establishes a data connection relationship with the smart wearable device, which includes a smart ring and a smart watch. The set-top box (1) is configured as follows: Acquire body metrics collected by smart wearable devices and conduct scenario demand analysis based on these metrics; If the scenario requirements analysis results include health advice scenarios, then the health / medical function app in the application APP will be called to generate health management suggestions; The set-top box (1) is configured as follows: Perform voice recognition on the collected user audio data and bind it to the user's identity; User identity is identified based on the ID corresponding to the current physical indicators; If the current time is not within the period for displaying health management suggestions, then search for the corresponding historical entertainment behavior records based on the user's identity and perform entertainment preference analysis; This allows televisions or other smart home devices to display content based on entertainment preference analysis results. The set-top box (1) is configured as follows: Record the installation location of the television; If two or more user identities are identified, indoor positioning is performed based on the interaction information of the smart wearable device; Based on the location of each user, users within the visible range of the television are identified as target users; The entertainment preference analysis is used to match target users.

2. The imaging equipment application system using a set-top box as a super-entry point according to claim 1, characterized in that, The set-top box (1) is configured to: pre-establish personalized information display logic; The personalized information display logic includes: if two or more user identities are currently identified, then: receive a user's active request and switch the content displayed on the TV. Without receiving a user's active request, the TV will stop displaying information matching another user's identity before the display of health management suggestions and entertainment preference content matching any user identity ends.

3. The imaging equipment application system using a set-top box as a super-entry point according to claim 2, characterized in that, The set-top box (1) is configured as follows: Record the duration of TV display for content matching any user's identity; If the TV display duration exceeds the preset minimum duration, behavioral scenario analysis will be performed based on the user's physical indicators, and the TV will stop working when the behavioral scenario is sleep.

4. The imaging equipment application system using a set-top box as a super-entry point according to claim 2, characterized in that, The set-top box (1) is configured as follows: Record the user's access level; If a user's active request is received and the corresponding permission level is higher than the permission level of the user identity responded to by the current TV or other smart home devices, then the active request will be updated and responded to.

5. The imaging equipment application system using a set-top box as a super-entry point according to claim 1, characterized in that: The set-top box (1) is connected to a pre-installed security system and / or home energy management system. The set-top box (1) is configured to display the real-time energy consumption information and security information on the television if the real-time energy consumption information and security information meet the preset prompt conditions.

6. A method for applying imaging equipment using a set-top box as a super-entry point, characterized in that: The image device application system, which uses a set-top box as a super access point, as described in any one of claims 1-5, connects to the target television set.

Images