Image equipment application method and system using set top box as super entrance

Abstract

The invention discloses an image equipment application method and system with a set top box as a super entrance, and relates to the technical field of television playing, and the image equipment application system comprises the set top box and a remote controller; the set top box establishes a data connection relationship with a plurality of other smart home devices outside the television, and the set top box is configured to perform scene demand analysis on one or more of voice information, use records and monitoring data by using preloaded AIGC and AIoT models; or, scene demand analysis is performed on one or more of the voice information, the use record and the monitoring data through an AIGC platform and an AIoT platform which are docked in advance; determining a matched pre-installed application App according to the scene demand analysis result, and importing the demand analysis result; and displaying response information after the demand analysis result is imported into the App through the television. The method and the device have the effects of reducing the limitation when the smart home experience is improved and reducing the cost.

Description

Technical Field

[0001] The present application relates to the field of television broadcasting technology, and in particular to an application method and system of an imaging device using a set-top box as a super portal. Background Art

[0002] With the development of Internet of Things technology, home appliances are gradually moving towards intelligence, which greatly improves the user's home experience. However, current smart homes have problems such as too many supporting facilities and high costs.

[0003] Taking smart speakers as an example, after being connected to the Internet and placed in a living room or other place, they can be used to collect the user's audio, and identify the audio through the Internet to control music playback or control paired lamps, air conditioners, etc. However, they are relatively closed and highly dependent on the brand ecosystem. Home furnishings involve many needs, and diversified customized services are limited. Therefore, this application proposes a new technical solution. Summary of the invention

[0004] In order to reduce the limitations when improving the smart home experience and lower the cost, the present application provides an imaging device application method and system using a set-top box as a super portal.

[0005] In a first aspect, the present application provides an imaging device application system using a set-top box as a super portal, which adopts the following technical solutions: An imaging device application system using a set-top box as a super portal, comprising: A set-top box adapted to a target television set; A remote control, which is suitable for set-top boxes and televisions; The set-top box and / or remote control has an integrated microphone, and the set-top box establishes a data connection relationship with a number of other smart home devices and an environmental information monitoring module outside the TV set, wherein the other smart home devices include at least one or more of smart air conditioners, smart lamps, smart speakers, and smart doors and windows, and the environmental information monitoring module includes one or more of a human infrared sensor, a VOC environmental monitoring unit, and a gas sensor; The set-top box is configured as follows: Perform audio recognition on the user voice data picked up by itself; or perform audio recognition on the audio data picked up by the remote control to obtain voice information; Obtain usage records and monitoring data of TVs and other smart homes, and obtain monitoring data of environmental monitoring modules; Use pre-loaded AIGC and AIoT models to perform scenario demand analysis on one or more of voice information, usage records, and monitoring data; or use pre-connected AIGC platforms and AIoT platforms to perform scenario demand analysis on one or more of voice information, usage records, and monitoring data; Determine matching pre-installed applications based on the scenario demand analysis results, and import the demand analysis results; The response information after the demand analysis results are imported into the application App is displayed through the TV; or, the response information after the demand analysis results are imported into the application App is sent to other smart home devices, and the response results of other smart home devices are displayed through the TV.

[0006] Optionally, the set-top box is provided with a physical data interface and is configured as follows: If the physical data interface is connected, then: Get the ID of the access device and make screen projection and resource sharing inquiries; If the screen sharing query is passed, display data interaction is performed with the access device, and a wireless data connection is established based on the device ID request, and display data interaction is maintained over the wireless network when the physical data interface is disconnected; If the resource sharing query is passed, a request is made to establish a shared window, read the app and resource data dragged into the window, obtain the app installation program, and copy the resource data.

[0007] Optionally, the set-top box also establishes a data connection relationship with a smart wearable device, and the smart wearable device includes a smart ring, a smart watch or a smart watch; The set-top box is configured as follows: Obtain body indicators collected by smart wearable devices and perform scenario demand analysis based on the body indicators; If the scenario demand analysis results include health advice scenarios, the health / medical function APP in the application APP will be called to generate health management advice.

[0008] Optionally, the set-top box is configured as follows: Perform voice recognition on the collected user audio data and bind the user identity; Identify the user based on the ID corresponding to the current physical indicator; If the current time is not a health management recommendation display period, the corresponding historical entertainment behavior records are searched according to the user's identity, and entertainment preference analysis is performed; Enable TVs or other smart home devices to display content based on the results of entertainment preference analysis.

[0009] Optionally, the set-top box is configured as follows: Record the TV's installation location; If two or more user identities are currently identified, indoor positioning is performed based on the interactive information of the smart wearable devices; According to the location of each user, the user who is within the visible range of the TV is determined as the target user; Match the target users with entertainment preference analysis.

[0010] Optionally, the set-top box is configured to: pre-establish personalized information display logic; The personalized information display logic includes: if two or more user identities are currently identified, then: receiving an active request from the user and switching the content displayed on the TV; if no active request from the user is received, stopping the TV from displaying information matching another user identity before the display of health management suggestions and entertainment preference content matching any user identity ends.

[0011] Optionally, the set-top box is configured as follows: Record the TV display time of content matching any user identity; If the TV display time is longer than the preset lower limit, a behavior scenario analysis is performed based on the user's physical indicators, and the TV is stopped when the behavior scenario is sleep.

[0012] Optionally, the set-top box is configured as follows: Record the permission level of the user identity; If an active request from a user is received and the corresponding permission level is higher than the permission level of the user identity responded by the current TV or other smart home devices, the active request is updated and responded.

[0013] Optionally, the set-top box imports a preset AIGC program or sets an interface for docking with the AIGC platform, and uses the AIGC program or the AIGC platform to perform scenario demand analysis.

[0014] Optionally, the set-top box is connected to a pre-installed security system and / or home energy management system, and the set-top box is configured to enable the TV to display the real-time energy consumption information and security information if the real-time energy consumption information and security information meet preset prompt conditions.

[0015] In a second aspect, the present application provides an imaging device application method using a set-top box as a super portal, which adopts the following technical solution: A method for applying an image device using a set-top box as a super portal uses any of the above-mentioned image device application systems using a set-top box as a super portal to connect to a target television.

[0016] In summary, this application includes the following beneficial technical effects: 1. Using the set-top box as an intermediary to interconnect multiple home appliances, the set-top box can be installed with a variety of applications to meet the diverse needs of customized smart homes. Different needs have different configurations, and the price is more acceptable to users; 2. TV sets have a wide coverage, and you can use old TV sets by purchasing a set-top box, which is more cost-effective; 3. Although the TV and set-top box are fixed, a movable remote control can be used as a transfer, which has fewer restrictions on use. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic diagram of the system structure of this application.

[0018] Explanation of the accompanying drawings: 1. set-top box; 2. remote control. DETAILED DESCRIPTION

[0019] The following is combined with Figure 1 This application is described in further detail.

[0020] The embodiment of the present application discloses an imaging device application system using a set-top box as a super portal.

[0021] Reference Figure 1 The imaging device application system with the set-top box as the super entrance includes a set-top box 1 and a remote control 2, wherein the set-top box 1 should be integrated with a Bluetooth module, a WIFI module, etc., so that in addition to being connected to the adapted target TV, it can also be interconnected with several other smart home devices and environmental information monitoring modules; the remote control 2 is adapted to the set-top box 1 and the TV; in order to meet the usage requirements in this application, the set-top box 1 and / or the remote control 2 are also required to integrate a microphone so that the user can control the TV by voice, etc.

[0022] The above-mentioned other smart home devices include one or more of smart air conditioners, smart lamps, smart speakers, and smart doors and windows to achieve functions such as automatic adjustment of indoor temperature and humidity, automatic adjustment of lighting, automatic music playback, and automatic opening and closing of doors and windows. The environmental information monitoring module includes one or more of human infrared sensors, VOC environmental monitoring units, and gas sensors to detect the user's location, indoor air, etc.

[0023] Set-top box 1 is configured as follows: 1. Perform audio recognition on the user voice data picked up by itself; or, perform audio recognition on the audio data picked up by the remote control 2 to obtain voice information; audio-to-text conversion is an existing technology, so it will not be repeated here.

[0024] 2. Obtain the usage records and monitoring data of TVs and other smart homes, and obtain the monitoring data of the environmental monitoring module.

[0025] 3. Use preloaded AIGC and AIoT models to perform scenario demand analysis on one or more of voice information, usage records, and monitoring data; or, use pre-connected AIGC platforms and AIoT platforms to perform scenario demand analysis on one or more of voice information, usage records, and monitoring data; among them, AIGC such as Kimi and chatgpt can also be implemented in the form of a docking interface when the program model monomer is too large, that is, docking with the corresponding cloud platform; AIoT is an artificial intelligence Internet of Things system, and is set up in the same way.

[0026] Example of scenario demand analysis: A. The user is in the living room between 8 and 9 a.m. on Saturday. In the past, the user played music or watched a news channel at this time. In this case, the current scenario demand is to control the smart speaker to play music or turn on the TV to watch the corresponding news channel. B. The audio picked up by the set-top box 1 indicates that the user wants to open the smart window in the bedroom. In this case, the current scenario demand is to open the smart window in the bedroom.

[0027] 4. Determine the matching pre-installed application App based on the scenario demand analysis results, and import the demand analysis results; it can be understood that in this embodiment, the set-top box 1 serves as a vertical application super portal, and can install a variety of customized application Apps, such as: music App, health management App, smart lamp control App, smart air conditioner control App, etc., so that the set-top box 1 can enable the matching devices to run and meet the needs of users; the matching relationship can be pre-recorded or automatically identified using AI.

[0028] 5. Display the response information after the demand analysis results are imported into the application App through the TV; or, send the response information after the demand analysis results are imported into the application App to other smart home devices, and display the response results of other smart home devices through the TV; that is, the TV serves as a large information screen to improve the user's smart interactive experience.

[0029] Based on the above content, we can know that this system: 1. Using the set-top box as an intermediary to interconnect multiple home appliances, the set-top box can be installed with a variety of applications to meet the diverse needs of customized smart homes. Different needs have different configurations, and the price is more acceptable to users; 2. TV sets have a wide coverage, and you can use old TV sets by purchasing a set-top box, which is more cost-effective; 3. Although the TV and set-top box are fixed, a movable remote control can be used as a transfer, which has fewer restrictions on use.

[0030] It is understandable that in addition to using smart air conditioning to sense the temperature and humidity of the environment, independent temperature and humidity sensors can also be installed as components of the environmental monitoring module. Therefore, an example of using the set-top box 1: the temperature sensor feeds back that the indoor temperature is greater than 28°C, and the scene demand analysis is a cooling scene, which causes the smart air conditioning to work accordingly.

[0031] In one embodiment of the system, the set-top box 1 is provided with a physical data interface, for example, a USB data interface, and its configuration is: If the physical data interface is connected, such as: the mobile phone is connected with a data cable with one end USB and the other end Type-c, then: Get the ID of the access device and make screen projection and resource sharing inquiries; If the screen projection sharing inquiry is passed, display data interaction is performed with the access device, and a wireless data connection is established based on the device's ID request, and display data interaction is maintained via a wireless network when the physical data interface is disconnected; one benefit of this setting is that the existing TV screen projection is not simple to operate, especially for the elderly and users with limited education. After applying this application, with the set-top box as the super entrance, users only need to use a data cable to connect the set-top box and the mobile phone to project the videos played on the mobile phone onto the large screen of the TV, which is convenient for elderly users to appreciate. Moreover, this application does not rely entirely on data cables. Data cable access is more to simplify the process of establishing a screen projection relationship. After that, the data cable can be unplugged to continue to maintain it, which can effectively improve the use effect of the set-top box as a super entrance.

[0032] If the resource sharing query is passed, a request is made to establish a shared window, read the app and resource data dragged into the window, obtain the app installation program, and copy the resource data.

[0033] Example: A shared window can be a small program with data reading and copying functions. It will be automatically installed quickly after access and a pop-up window will be displayed for use. It will be automatically uninstalled within 1 minute after the data cable is disconnected. In addition to helping users copy resource data to the set-top box, the setting of the shared window is more important to read the name of the app on a device such as a mobile phone dragged into the window. Because this application wants to meet the needs of a super portal, it will involve functional apps corresponding to a variety of devices. If users are required to use TV remote controls or set-top box remote controls to enter the application market and download apps one by one, it will be cumbersome. In particular, the app download channels for some smart devices are now shared in the instruction manual in the form of QR codes, and the set-top box does not have a code scanning function, which will make it cumbersome to install apps on the set-top box. The above settings can be used to solve this problem.

[0034] In one embodiment of the present system, the set-top box 1 also establishes a data connection relationship with a smart wearable device, and the smart wearable device includes a smart ring, a smart watch or a smart watch.

[0035] In this embodiment, the smart wearable device can be interconnected with the set-top box 1 and the remote control 2 through an internally integrated Bluetooth module. The reason for using Bluetooth connection is to facilitate indoor positioning of the user, which will be described in detail in another embodiment.

[0036] On the basis of the above, the set-top box 1 is configured as follows: Obtain body indicators collected by smart wearable devices and perform scenario demand analysis based on the body indicators; If the scenario demand analysis results include health advice scenarios, the health / medical function APP in the application APP will be called to generate health management advice.

[0037] Example: The results of scenario demand analysis include: heart rate and walking data indicate that the user has just woken up in the morning, so the APP can be used to process the user's sleep data and generate a sleep quality report as a suggestion; if the body indicators indicate that the user is overweight, the APP can be used to generate a weight loss plan and exercise plan as a suggestion. It is understandable that the above health / medical function APP, in addition to being a localized application, can also be a digital person of Chinese and Western medicine, and the set-top box 1 can be connected to the API interface of a third-party platform signed by the operator.

[0038] According to the above content, the set-top box 1 can also establish a connection with a smart wearable device to act as a health assistant and digital doctor according to the user's physical indicators to guide the user to manage their health; at the same time, because it uses a TV for display, the visualization and communication experience are better.

[0039] In another embodiment of the system, the set-top box 1 is configured as follows: Perform voice recognition on the collected user audio data and bind the user identity; Identify the user based on the ID corresponding to the current physical indicator; If the current time is not a time period for displaying health management suggestions (for example, the user sets health suggestions from 7:00 to 7:30 every day, and the current time is 8:00), the corresponding historical entertainment behavior records are searched according to the user's identity, and entertainment preference analysis is performed; Enable TVs or other smart home devices to display content based on the results of entertainment preference analysis.

[0040] According to the above settings, the system can cooperate with smart wearable devices to determine who the user is at home, and then analyze the user's historical entertainment behavior records in a targeted manner, and push TV, movies, news, music, etc. to them, so as to achieve a relatively comfortable home life experience.

[0041] It should be noted that unlike traditional APPs that make recommendations based on user portraits, because they are based on platform promotion purposes (such as advertising, movie recommendations, etc.), it is often the case that the recommendations are not what the user currently wants; this system is based on the user's real-time data, such as voice call content, TV playback records for analysis and push, so it is more in line with the user's real needs.

[0042] The above-mentioned human voice recognition technology is an existing technology, so it will not be described in detail. For example, the above-mentioned entertainment preference analysis shows that the historical records show that the user plays music at 8-9 o'clock on at least three days from Monday to Friday, so playing music at 8-9 o'clock from Monday to Friday is determined as a preference.

[0043] It is understandable that the above entertainment preference analysis would be relatively rigid if the analysis logic conditions were pre-written. Therefore, generative AI is introduced into the set-top box 1, and AI is used to more flexibly analyze and understand user needs, allowing the set-top box 1 to serve as the user's second brain and provide personal TV content, health, information, psychology and physiology, and education expert assistant services.

[0044] In another embodiment of the system, the set-top box 1 is configured as follows: Record the installation location of the TV; in this embodiment, the installation location is such as: living room, master bedroom, which is a range value rather than a single point location; If two or more user identities are currently identified, indoor positioning is performed based on the interactive information of the smart wearable devices; According to the location of each user, the user who is within the visible range of the TV is determined as the target user; Match the target users with entertainment preference analysis.

[0045] According to the above settings, when there are multiple users at home, it is possible to actively identify which user is suitable for the system to recommend personalized news, TV, etc. to him; more importantly, there is no need to deploy other equipment, and it can be achieved by rationally utilizing existing equipment.

[0046] For the above-mentioned indoor positioning, an example is as follows: the set-top box 1 pre-writes a calling function and opens permissions to obtain the signal strength, searches the pre-recorded signal strength-distance relationship table according to the signal strength, obtains the distance between the user and the set-top box 1, and thereby locates whether the user is in the living room; this method can open permissions to the user, allowing him to actively modify the signal-distance relationship table to improve the customization effect.

[0047] On the basis of the above, the set-top box 1 is configured to pre-establish personalized information display logic.

[0048] Personalized information display logic, including: If two or more user identities are currently recognized, then: upon receiving an active user request, switch the TV display content; if no active user request is received, stop the TV display of information matching another user identity before the display of health management suggestions and entertainment preference content matching any user identity is finished.

[0049] According to the above settings, it can prevent a situation where another user comes over while a user is watching recommended news or other content, and the system directly switches to interrupt the previous user, so as to improve the user experience; after making the above adjustments, if a news is already being played, the news will be played first and the system will not respond and switch content until it receives an active request from the user.

[0050] Furthermore, in order to facilitate parents and others to manage smart home devices, the set-top box 1 is configured as follows: Record the permission level of the user identity; for example: parents have level 1 permission, children have level 2 permission, and level 1 permission > level 2 permission; If an active request from a user is received and the corresponding permission level is higher than the permission level of the user identity responded by the current TV or other smart home devices, the active request is updated and responded.

[0051] In another embodiment of the system, the set-top box 1 is configured as follows: Record the TV display time of content matching any user identity; If the TV display time is longer than the preset lower limit (e.g. 1.5h), a behavioral scenario analysis is performed based on the user's physical indicators, and the TV is stopped when the behavioral scenario is sleep.

[0052] According to the above content, the set-top box 1 can evaluate whether the user is asleep based on the physical indicators collected by the smart wearable device. If it is found that the user has fallen asleep, the TV will be automatically stopped to avoid disturbing the user's rest and save energy.

[0053] It is understandable that, based on the above, the set-top box 1 can also be connected to a security system and / or a home energy management system through a network. The security system is such as a camera and doorbell at the door; the home energy management system is such as a smart meter.

[0054] The set-top box 1 is configured as follows: if the real-time energy consumption information and security information meet the preset prompt conditions, for example, the remaining power is less than 50 degrees and the doorbell is pressed, the TV will display the real-time energy consumption information and security information, that is, the remaining power and the real-time picture of the camera will be displayed.

[0055] The embodiment of the present application also discloses an imaging device application method using a set-top box as a super portal.

[0056] The method for applying an imaging device using a set-top box as a super portal comprises applying any of the above-described imaging device application systems using a set-top box as a super portal to connect a target television.

[0057] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.

Claims

1. An imaging device application system using a set-top box as a super portal, characterized in that: include: A set-top box (1), which is adapted to a target television set; A remote control (2), which is adapted for use with a set-top box (1) and a television; The set-top box (1) and / or the remote control (2) are integrated with a microphone, and the set-top box (1) establishes a data connection relationship with a plurality of other smart home devices and an environmental information monitoring module outside the television set, wherein the other smart home devices include at least one or more of smart air conditioners, smart lamps, smart speakers, and smart doors and windows, and the environmental information monitoring module includes one or more of a human infrared sensor, a VOC environmental monitoring unit, and a gas sensor; The set-top box (1) is configured as follows: Performing audio recognition on the user voice data picked up by itself; or performing audio recognition on the audio data picked up by the remote controller (2) to obtain voice information; Obtain usage records and monitoring data of TVs and other smart homes, and obtain monitoring data of environmental monitoring modules; Use pre-loaded AIGC and AIoT models to perform scenario demand analysis on one or more of voice information, usage records, and monitoring data; or use pre-connected AIGC platforms and AIoT platforms to perform scenario demand analysis on one or more of voice information, usage records, and monitoring data; Determine matching pre-installed applications based on the scenario demand analysis results, and import the demand analysis results; The response information after the demand analysis results are imported into the application App is displayed on the TV; or, the response information after the demand analysis results are imported into the application App is sent to other smart home devices, and the response results of other smart home devices are displayed on the TV.

2. The imaging device application system using a set-top box as a super portal according to claim 1, characterized in that: The set-top box (1) is provided with a physical data interface and is configured as follows: If the physical data interface is connected, then: Get the ID of the access device and make screen projection and resource sharing inquiries; If the screen sharing query is passed, display data interaction is performed with the access device, and a wireless data connection is established based on the device ID request, and display data interaction is maintained over the wireless network when the physical data interface is disconnected; If the resource sharing query is passed, a request is made to establish a shared window, read the app and resource data dragged into the window, obtain the app installation program, and copy the resource data.

3. The imaging device application system using a set-top box as a super portal according to claim 1, characterized in that: The set-top box (1) also establishes a data connection relationship with a smart wearable device, wherein the smart wearable device includes a smart ring, a smart watch or a smart watch; The set-top box (1) is configured as follows: Obtain physical indicators collected by smart wearable devices and perform scenario demand analysis based on the physical indicators; If the scenario demand analysis results include health advice scenarios, the health / medical function APP in the application APP will be called to generate health management advice.

4. The imaging device application system using a set-top box as a super portal according to claim 3, characterized in that: The set-top box (1) is configured as follows: Perform voice recognition on the collected user audio data and bind the user identity; Identify the user based on the ID corresponding to the current physical indicator; If the current time is not a health management recommendation display period, the corresponding historical entertainment behavior records are searched according to the user's identity, and entertainment preference analysis is performed; Enable TVs or other smart home devices to display content based on the results of entertainment preference analysis.

5. The imaging device application system using a set-top box as a super portal according to claim 4, characterized in that: The set-top box (1) is configured as follows: Record the TV installation location; If two or more user identities are currently identified, indoor positioning is performed based on the interactive information of the smart wearable devices; According to the location of each user, the user who is within the visible range of the TV is determined as the target user; Match the target users with entertainment preference analysis.

6. The imaging device application system using a set-top box as a super portal according to claim 5, characterized in that: The set-top box (1) is configured to: pre-establish personalized information display logic; The personalized information display logic includes: if two or more user identities are currently identified, then: receiving an active request from the user and switching the content displayed on the television; Without receiving an active user request, the TV stops displaying information matching another user identity before the display of health management suggestions and entertainment preference content matching any user identity ends.

7. The imaging device application system using a set-top box as a super portal according to claim 6, characterized in that: The set-top box (1) is configured as follows: Record the TV display time of content matching any user identity; If the TV display time is longer than the preset lower limit, a behavioral scenario analysis is performed based on the user's physical indicators, and the TV is stopped when the behavioral scenario is sleep.

8. The imaging device application system using a set-top box as a super portal according to claim 6, characterized in that: The set-top box (1) is configured as follows: Record the permission level of the user identity; If an active request from a user is received and the corresponding permission level is higher than the permission level of the user identity responded to by the current TV or other smart home devices, the active request is updated and responded to.

9. The imaging device application system using a set-top box as a super portal according to claim 1, characterized in that: The set-top box (1) is connected to a pre-installed security system and / or a home energy management system, and the set-top box (1) is configured to: if the real-time energy consumption information and security information meet preset prompt conditions, then the television sets are enabled to display the real-time energy consumption information and security information.

10. An application method of an imaging device using a set-top box as a super portal, characterized in that: The image device application system data using the set-top box as a super portal as described in any one of claims 1-9 is used to connect the target TV.

Images