Display device, smart home system and media asset triggering linkage method

Abstract

The embodiment of the invention provides a display device, a smart home system and a media asset triggering linkage method, and the method can respond to a media asset playing instruction to obtain a media asset label of a currently played media asset. And if the media asset label is used for representing that the currently played media asset is suitable for the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning equipment to control the air conditioning equipment to operate according to the target operation parameters. Wherein the target operation parameter comprises a stage parameter value set according to at least one of the media asset attribute of the currently played media asset, the current scene parameter and the playing control instruction. According to the method, the linkage control instruction can be generated according to the media asset label, so that when the played media assets meet the preset conditions, the air conditioning equipment is automatically controlled to operate, the linkage control precision is improved, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device, a smart home system, and a media resource triggering linkage method. Background Art

[0002] A smart home system is a system that uses the Internet, the Internet of Things, artificial intelligence and other technologies to connect multiple devices in a scene to achieve intelligent control and management. The smart home system aims to improve the safety, convenience, comfort and energy efficiency of the home.

[0003] The smart home system may include a central control module and at least one controlled device, wherein the central control module is responsible for coordinating and managing the electronic devices in the scene. The central control module can implement interactive operations through an application or a physical control panel. For example, a display device with data processing and communication functions can serve as a central control module of the smart home system by running a smart home application. Other electronic devices in the scene can establish a communication connection with the display device, and can receive and respond to control instructions sent by the display device to act as a controlled device and realize linkage control with the display device.

[0004] However, the linkage control of the smart home system requires the user to actively initiate control commands, that is, the user inputs control commands through voice interaction or control devices such as remote controls to control the operating parameters of the controlled devices. Alternatively, the linkage control needs to cooperate with sensors to detect environmental parameters, and control the operating parameters of the controlled devices when the environmental parameters meet the preset trigger conditions. For example, through target detection technology such as infrared, linkage control is triggered when a target enters the scene. The triggering process of linkage control is complicated and the control accuracy is low, which affects the user experience. Summary of the invention

[0005] The present application provides a display device, a smart home system, and a media resource triggering linkage method to solve the problem of low linkage control accuracy.

[0006] In a first aspect, some embodiments of the present application provide a display device, comprising: a display, a communication device, and a controller. The display is configured to display a user interface; the communication device is configured to establish a communication connection with an air conditioning device to form a smart home system; and the controller is configured to perform the following steps:

[0007] In response to a media asset playing instruction, a media asset tag of the currently playing media asset is obtained, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, and the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content;

[0008] If the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device, wherein the linkage control instruction is used to control the air conditioning device to operate according to the target operation parameters; wherein the target operation parameters include a phased parameter value set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameters, and the playback control instruction;

[0009] If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated.

[0010] In a second aspect, some embodiments of the present application further provide a smart home system, including: a display device and an air conditioning device, wherein a communication connection is established between the display device and the air conditioning device;

[0011] The display device is configured to: in response to a media asset playing instruction, obtain a media asset tag of a currently playing media asset, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, wherein the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content;

[0012] If the media asset tag is used to indicate that the currently played media asset is applicable to the linkage control function, generating a linkage control instruction, and sending the linkage control instruction to the air conditioning device;

[0013] If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated;

[0014] The air conditioning equipment is configured to: receive the linkage control instruction, and operate according to the target operating parameters in response to the linkage control instruction; wherein the target operating parameters include phased parameter values ​​set according to at least one of the media attributes of the currently playing media, the current scene parameters, and the playback control instruction.

[0015] In a third aspect, some embodiments of the present application further provide a media asset triggering linkage method, which is applied to the display device described in the first aspect, and the method includes:

[0016] In response to a media asset playing instruction, a media asset tag of the currently playing media asset is obtained, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, and the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content;

[0017] If the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device, wherein the linkage control instruction is used to control the air conditioning device to operate according to the target operation parameters; wherein the target operation parameters include a phased parameter value set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameters, and the playback control instruction;

[0018] If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated.

[0019] It can be seen from the above technical solutions that some embodiments of the present application provide a display device, a smart home system and a media asset trigger linkage method, the method can respond to the media asset playback instruction, obtain the media asset tag of the currently played media asset, and determine whether the currently played media asset supports the linkage control function according to the media asset tag. If the media asset tag is used to characterize that the currently played media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device to control the air conditioning device to operate according to the target operation parameters. Among them, the media asset tag is a classification tag set according to the media asset attribute of the currently played media asset, and the media asset attribute includes at least one of the media asset category, the media asset belonging channel, and the media asset screen content; the target operation parameter includes a stage parameter value set according to at least one of the media asset attribute of the currently played media asset, the current scene parameter, and the playback control instruction. The method can automatically control the operation of the air conditioning device according to the media asset tag when the played media meets the preset conditions, improve the linkage control accuracy, and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 A schematic diagram showing usage scenarios of a display device in some embodiments of the present application;

[0022] Figure 2 A hardware configuration block diagram of a display device provided in some embodiments of the present application;

[0023] Figure 3 A schematic diagram of software configuration in a display device provided in some embodiments of the present application;

[0024] Figure 4An architecture diagram of a smart home system provided for some embodiments of the present application;

[0025] Figure 5 A flowchart of a media asset triggering linkage method provided in some embodiments of the present application;

[0026] Figure 6 A schematic diagram of a process for obtaining media asset tags provided in some embodiments of the present application;

[0027] Figure 7 A schematic diagram of a process for detecting current scene parameters according to preset classification tags provided in some embodiments of the present application;

[0028] Figure 8 A schematic diagram of a process for setting media asset tags provided in some embodiments of the present application;

[0029] Fig. 9 An interaction diagram between a display device and a server provided in some embodiments of the present application;

[0030] Fig.10 A schematic diagram of a process for generating a linkage control instruction according to a user location provided in some embodiments of the present application;

[0031] Fig.11 A schematic diagram of a linkage control flow when switching media resources provided in some embodiments of the present application;

[0032] Fig.12 A schematic diagram of a linkage control flow when pausing playback provided in some embodiments of the present application;

[0033] Fig.13 A schematic diagram of a linkage control flow when stopping playback provided in some embodiments of the present application;

[0034] Fig.14 A timing relationship diagram of the linkage control of a smart home system provided in some embodiments of the present application. DETAILED DESCRIPTION

[0035] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0036] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0037] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0038] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0039] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0040] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0041] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0042] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0043] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0044] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0045] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0046] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0047] Figure 2 A hardware configuration block diagram of a display device 200 provided for some embodiments of the present application.

[0048] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0049] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0050] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0051] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0052] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0053] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0054] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0055] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0056] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0057] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0058] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0059] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0060] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0061] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0062] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0063] like Figure 3As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0064] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0065] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0066] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0067] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0068] In some embodiments, the display device 200 can establish a communication connection relationship with multiple electronic devices. In addition, multiple electronic devices and the display device 200 that have established a communication connection relationship can be grouped according to factors such as the user, the area, and the connection network to form a local area network system. When the local area network system is applied to a home environment, such as Figure 4 As shown, when the display device 200 and the electronic device are household appliances, the local area network system formed can be called a smart home system. For example, the display device 200 can be a smart TV, and the electronic device that establishes a communication connection relationship with the smart TV can be a smart refrigerator, a smart oven, a smart range hood, a smart air conditioner, a lamp, a smart speaker, etc. The display device 200 can form a local area network with multiple smart devices by connecting to the same router device, that is, forming a smart home system.

[0069] The display device 200 and the electronic devices that make up the smart home system can transmit data and instructions to each other to achieve coordinated control of the home system. For example, a smart refrigerator can send data such as the temperature, humidity, and food storage time monitored inside to the display device 200 through the smart home system network, so that the display device 200 can display the data content such as the temperature, humidity, and food storage time inside the smart refrigerator.

[0070] like Figure 4 As shown, in some embodiments, in order to build a smart home system, an artificial intelligence & Internet of Things (AIoT) can be built in the home local area network, and the display device 200 and the electronic device can establish a communication connection relationship through the AIoT system. During the operation of the smart home system, any device can send shared data to the AIoT system, and any device can obtain data shared by other devices through the AIoT system, thereby realizing collaborative operation in the smart home system.

[0071] For each device in the smart home system, the user can also control the operation of another device through one device. For example, the user can perform interactive actions on the display device 200 to control the smart range hood to start / stop operation. That is, the user can control the display device 200 to display the smart home application interface, and select the "smart range hood" option in the application interface to control the display device 200 to present the control interface for the smart range hood. Then select the switch option in the control interface. At this time, the display device 200 will generate a switch command for the smart range hood and send it to the smart range hood through the AIoT system. The smart range hood then responds to the received switch command to start or stop operation.

[0072] In the above-mentioned device control process, the display device 200 with which the user performs the interaction can be used as the master device, and the controlled smart range hood can be used as the controlled device. Obviously, the master device and the controlled device are relative, that is, for the same smart device, it can be used as the master device and the controlled device respectively in different control processes. In order to facilitate centralized control, for a single control process, there can be only one master device, but there can be multiple controlled devices. For example, when the user controls the lamps in different rooms through the display device 200, the lamps in each room can be used as separate controlled devices, and the number is multiple. In this control process, there is only one master device, namely the display device 200.

[0073] It should be noted that in the following embodiments, the display device 200 is used as the master control device for example description. It should be understood that other electronic devices in the smart home system can also serve as the master control device when they have the corresponding data processing capabilities. Similarly, the display device 200 can also serve as a controlled device to receive control instructions and data from the electronic device serving as the master control device to achieve linkage control of the display device 200.

[0074] The controlled devices may have different hardware components according to their actual functions. For the controlled devices with different hardware components, the master device may use different methods to perform control. For example, for controlled devices with simple structures and single functions such as lamps, users can send switch instructions, brightness adjustment instructions, etc. to them through the master device, so that the lamps can be turned on, off and the brightness can be adjusted according to the sent instructions. For such controlled devices, users can use the smart home system to realize all control functions.

[0075] In some embodiments, for some controlled devices, an independent operating system can be built in, which supports the interaction mode corresponding to the operating system. For example, the smart home appliances with display screens in the user's smart home system, all kinds of smart scenes of these smart home appliances are presented and interacted with by the user through their built-in display screens. For example, smart TV devices provide users with rich audio-visual entertainment resources; the refrigerator screen can view and automatically identify the ingredients in the refrigerator, and recommend recipes to users accordingly; the oven screen can view the steaming and baking status of food; the range hood screen monitors and sets the operating status of the stove and range hood, etc.

[0076] In some embodiments, the master control device in the smart home system can obtain the current scene parameters in real time, and send a linkage control instruction to the controlled device when the current scene parameters meet the preset linkage conditions to control the operation of the controlled device. For example, the display device 200 can detect the ambient temperature through a temperature sensor, and when it is detected that the ambient temperature is not within the appropriate temperature range, send a linkage control instruction to the air-conditioning device as the controlled device to start the air-conditioning device and adjust the ambient temperature.

[0077] In some embodiments, the display device 200 can also perform linkage control based on the displayed media, that is, some embodiments of the present application provide a media trigger linkage method, which can be run in the display device 200, so that when the display device 200 plays specific media data, it can be linked with the air conditioning device according to the playback status of the media data and combined with the scene parameters. To this end, the display device 200 may include a display 260, a communication device 220 and a controller 250. Among them, the display 260 is configured to display a user interface. The communication device 220 is configured to establish a communication connection with the air conditioning device 500 to form a smart home system. Figure 5 As shown, the controller 250 is configured to execute the steps corresponding to the media asset trigger linkage method, including the following:

[0078] S100: In response to a media asset playing instruction, obtain a media asset tag of the currently playing media asset.

[0079] During operation, the display device 200 may receive control instructions input by the user, and different control instructions may control the display device 200 to perform different control actions. Some control instructions may be used to control the display device 200 to play media data, and such control instructions are called media play instructions.

[0080] Depending on the different interaction modes supported by the display device 200, the user can input the media playback instruction in different ways. In some embodiments, the media playback instruction can be input through the control device 100. For example, the display device 200 can display a user interface, which includes a focus cursor and a media asset control. The user controls the movement of the focus cursor in the user interface by using the direction keys on the control device 100 such as a remote controller, and after selecting a media asset control and pressing the "confirm" key, the display device 200 can be controlled to play the media data corresponding to the media asset control, that is, the media playback instruction is input.

[0081] In some embodiments, the media asset playback instruction can also be input through voice interaction. For example, for a display device 200 that supports voice interaction, the user can input voice data with the content of "play media asset A" after calling the voice assistant application. At this time, the voice interaction application of the display device 200 can recognize the content of the voice data, and after recognizing the playback intention in the voice data, control the display device 200 to play the media asset data corresponding to media asset A, that is, input the media asset playback instruction.

[0082] In some embodiments, the media asset playback instruction may also be input through a channel switching event of the display device 200. For example, when the display device 200 is running a TV live broadcast application or performing TV live broadcast through a signal receiving device such as a set-top box, when the user switches to the TV live broadcast channel corresponding to "media asset B", the display device 200 may be triggered to play the media asset data corresponding to media asset B, i.e., the media asset playback instruction is input.

[0083] In addition, according to the interaction method supported by the display device 200, the user can also input media playback instructions through other methods, such as screen projection to trigger playback, touch interaction to trigger playback, gesture interaction to trigger playback, external device connection to trigger playback, signal access to trigger playback, etc., which will not be repeated here.

[0084] After obtaining the media asset playing instruction, the display device 200 can respond to the media asset playing instruction and obtain the media asset tag of the currently playing media asset. The media asset tag is used to characterize the currently playing media asset as being applicable to the linkage control function, and the media asset tag can be set according to the media asset attributes such as the media asset category, the media asset belonging channel, and the media asset screen content of the currently playing media asset, that is, the media asset tag is a classification tag set according to the media asset attributes of the currently playing media asset, and the media asset attributes include at least one of the media asset category, the media asset belonging channel, and the media asset screen content.

[0085] In some embodiments, when the user clicks the "Media A" option in the user interface and controls the display device 200 to play media A, the display device will search for media resource details in the local storage according to the "Media A" option, or request media resource details from the server according to the identifier corresponding to the "Media A" option.

[0086] In some embodiments, the server will feedback the audio and video data corresponding to the "media asset A" option to the display device for media asset playback according to the identifier corresponding to the "media asset A" option, and feedback the media asset details information corresponding to the "media asset A" option.

[0087] In some embodiments, the display device 200 can read the media asset detail information of media asset A, and read the classification label of media asset A in the media asset detail information. If the media asset detail data of media asset A includes a first classification label of the type "sports, fitness", then media asset A is a fitness video. If the media asset detail data of media asset A includes a second type of classification label of the type "education, classroom", then media asset A is an education video.

[0088] In some embodiments, the display device 200 can determine that the media asset A currently being played has a first classification label, that is, a media asset with a "sports" label, based on the read classification label, which indicates that the linkage control function is supported, and then perform relevant steps of the linkage control function.

[0089] In some embodiments, the display device 200 can determine based on the read classification tag that the media asset tag of the currently played media asset A is not the first classification tag, that is, the media asset tag is other types of media assets, which indicates that the linkage control function is not supported and there is no need to perform relevant steps of the linkage control function.

[0090] In some embodiments, after obtaining the media resource playing instruction, the display device 200 may also detect whether the current display device 200 has enabled the media resource linkage control function. Figure 6 As shown, the display device 200 can read the switch state of the linkage control function from the setting parameters (S601). If the switch state of the linkage function is on, the step of obtaining the media asset tag of the currently playing media asset is executed (S602). If the switch state of the linkage control function is off, the judgment logic of the linkage scene is not executed (S603).

[0091] In some embodiments, the media asset tag of the currently playing media asset can be uniformly configured by the operator of the media asset data. That is, the operator server can set corresponding media asset tags for the media asset data according to the specific content of the media asset data, and record the media asset tags in the media asset data. When the display device 200 plays the media asset data, the media asset tag of the currently playing media asset can be obtained by reading the media asset data.

[0092] In some embodiments, the media asset data may be set with multiple media asset tags. For example, for media asset A whose video content is a fitness video, a first classification tag representing "exercise" may be set. At the same time, according to the intensity of the exercise in the video content, a third tag representing different degrees of exercise such as "intense exercise", "aerobic exercise", and "yoga" may be further set.

[0093] In some embodiments, different motion tags may support different device linkage control modes so that the air conditioning device can perform air conditioning to different degrees.

[0094] In some embodiments, the media asset tag can also be obtained by obtaining the channel to which the media asset data belongs. That is, when the display device 200 obtains the media asset tag of the currently playing media asset, it can first read the media asset detail information of the currently playing media asset so as to read the media asset tag text from the media asset detail information. If the media asset detail information includes the media asset tag text, the display device 200 can filter the media asset tag text to obtain the media asset tag. If the media asset detail information does not include the media asset tag text, the display device 200 can determine the channel to which the currently playing media asset belongs based on the position of the media asset control corresponding to the currently playing media asset in the user interface, and determine the media asset tag based on the channel name or type.

[0095] In some embodiments, the user interface displayed by the display device 200 may include multiple channel tabs such as movies, TV series, and sports. When the user selects media asset A in the tab of the sports channel for playback, the display device 200 may read the channel label "sports" to which media asset A belongs, determine that the channel type to which media asset A belongs is sports, and thereby obtain the media asset label of media asset A, i.e., "sports". The specific name of the channel label may be adjusted according to factors such as the purpose, usage scenario, operation strategy, and user definition of the display device 200, i.e., for channels related to sports and fitness functions, the corresponding channel names may be sports, fitness, square dance, dance practice, etc., and this application does not impose specific restrictions.

[0096] In some embodiments, when obtaining the media asset tag of the currently playing media asset, the display device 200 may also set a media asset tag for some of the media assets. Figure 7 As shown, the display device 200 can detect the preset classification label of the currently playing media asset (S701).

[0097] If the currently playing media asset is not set with a preset classification tag, a preset duration threshold is extracted (S702), wherein the preset duration threshold is a delayed linkage time set according to different application scenarios, that is, the linkage control is triggered only after the display device 200 starts playing the agreed media asset and plays the agreed duration, so as to prevent the user from simply browsing and causing the triggering scenario. The preset classification tag is used to characterize the media asset category or the channel to which the media asset belongs of the currently playing media asset.

[0098] Extract at least one playback picture frame within the detection period corresponding to the duration threshold (S703). And identify the target feature in the playback picture frame (S704). The target feature is used to characterize the picture feature information in the playback picture frame that conforms to the media asset category or the channel to which the media asset belongs. Then set the media asset tag of the currently playing media asset according to the target feature (S705).

[0099] For example, after playing the selected media data, the display device 200 can first extract the preset classification labels for characterizing media types such as "sports" and "fitness" from the media details information of the media data. If the currently playing media does not have a preset classification label, the preset duration threshold of 5 minutes can be extracted, that is, the detection period is determined to be 5 minutes. Therefore, the display device 200 can perform frame extraction on the playback screen within 5 minutes to extract at least one playback screen frame. Then, based on the image recognition algorithm, the characteristic targets of the sports video are identified in the playback screen frame. For example, the sports adaptation includes characteristic areas such as portraits, time, and ratings. Through image recognition, when it is determined that the playback screen frame includes the above-mentioned characteristic areas, it can be determined that the currently playing media belongs to the sports media. Therefore, the media label of the currently playing media can be set to "sports" according to the target characteristics.

[0100] Among them, the media resource tag can be set according to whether the linkage control function is applicable. Figure 8 As shown, in some embodiments, when the display device 200 sets the media asset tag of the currently playing media asset according to the target feature, it can also obtain the recognition result of the target feature in the playing picture frame (S801). If the target feature is recognized in the playing picture frame, a first tag is set for the currently playing media asset (S802), and the first tag is used to indicate that the currently playing media asset is applicable to the linkage control function.

[0101] For example, the display device 200 performs image recognition on the playback screen frame, and after determining that the playback screen frame includes characteristic areas such as portraits, time, and ratings, a media resource label with the content "sports" can be set for the currently playing media resource. When the display device 200 plays sports media resources, since users can follow the movements according to the media resources, there is a need for ventilation and ambient temperature adjustment. Therefore, when playing sports media resources, the air conditioning equipment can be linked to control operation, that is, the media corresponding to the sports media label is applicable to the linkage control function, which is the first label.

[0102] If the target feature is not identified in the playback screen frame, a second label is set for the currently playing media asset (S803). The second label is used to characterize that the currently playing media asset is not applicable to the linkage control function. For example, after the display device 200 performs image recognition on the playback screen frame and determines that the playback screen frame does not include feature areas such as portraits, time, and ratings, a media asset label with the content "sports" may not be set for the currently playing media asset. Through further identification, the category of the currently playing media asset can be determined. For example, by identifying that the aspect ratio of the media asset image is 16:9, and that the image content at the start of the media asset broadcast includes a public screening license graphic, it can be determined that the currently playing media asset is a movie-type media asset. Therefore, a media asset label with the content "movie", i.e., the second label, can be set for the currently playing media asset.

[0103] It should be noted that in the above embodiment, when the display device 200 identifies the target features in the playback picture frame, an appropriate image recognition algorithm can be used according to the actual linkage control requirements. For example, the image recognition algorithm can be convolutional neural networks (CNNs), support vector machines (SVMs), decision trees and random forests, K-nearest neighbors (KNN), deep belief networks (DBNs), recurrent neural networks (RNNs), generative adversarial networks (GANs), etc.

[0104] In some embodiments, after obtaining the media asset tag of the currently playing media asset, the display device 200 can determine whether the currently playing media asset is applicable to the linkage control function based on the media asset tag, that is, the display device 200 can obtain a tag set, and perform type detection on the obtained media asset tag based on the tag set. If the obtained media asset tag is in the tag set, it means that the media asset corresponding to the current media asset tag is applicable to the linkage control function. At this time, the display device 200 can detect the current scene parameters based on the media tag.

[0105] The tag set can be uniformly issued by the operator of the display device 200 and synchronized to the display device 200 through the server 400. Since there may be multiple display devices 200 and air conditioning devices 500 in a smart home scenario, and the amount of media resources started is large, it is not suitable for default reporting. Therefore, the server 400 can issue a strategy in the cloud. When the display device 200 and the air conditioning device 500 establish an association relationship, the display device 200 is notified to enable the linkage control function, so as to achieve precise control. Fig. 9 As shown, in some embodiments, the display device 200 further includes a communication device 220, which is configured to establish a communication connection with the server 400, and the display device 200 can receive the linkage strategy data sent by the server 400, and parse the tag set supporting the linkage control function from the linkage strategy data. If the media asset tag is in the tag set, it means that the currently playing media asset is applicable to the media asset linkage control function.

[0106] S200: Detecting the applicability of the currently played media resource to the linkage control function according to the media resource tag.

[0107] After obtaining the media asset tag of the currently playing media asset, the display device 200 can determine whether the currently playing media asset supports the linkage control function according to the current media asset tag. In some embodiments, in order to determine the applicability of the currently playing media asset to the linkage control function, the display device 200 can obtain a preset classification tag set after obtaining the media asset tag of the currently playing media asset. Among them, the classification tag set includes a first tag set and a second tag set, and the first tag set includes a first classification tag, which is used to characterize the media asset that supports the linkage control function. The second tag set includes a second classification tag, which is used to characterize the media asset that does not support the linkage control function.

[0108] The display device 200 can determine the classification label set to which the current media asset tag belongs. If the media asset tag belongs to the first label set, it means that the current media asset tag is used to characterize that the currently played media asset is applicable to the linkage control function; if the media asset tag belongs to the second label set, it means that the current media asset tag is used to characterize that the currently played media asset is not applicable to the linkage control function.

[0109] S300: If the media asset tag is used to indicate that the currently played media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device.

[0110] When it is determined that the currently playing media asset is suitable for the linkage control function, the display device 200 can generate a linkage control instruction. Among them, the linkage control instruction is used to control the air conditioning device 500 to operate according to the target operating parameters. In some embodiments, the linkage control instruction can directly include the control command and the target operating parameters to which the air conditioning device 500 can respond. That is, the linkage control instruction can be a string data containing a control command. After receiving the linkage control instruction, the air conditioning device 500 can parse the corresponding control command and target operating parameters from the linkage control instruction, and in response to the control command, modify the current operating parameters to the target operating parameters, so that the air conditioning device 500 can operate according to the target operating parameters.

[0111] In some embodiments, the display device 200 sends the linkage control instruction to the air conditioning device 500, and can also use the signal input method supported by the air conditioning device 500, including Bluetooth data signal, infrared data signal, WiFi data signal, etc. The display device 200 can convert the linkage control instruction into a control key value for controlling the operation of the air conditioning device 500 according to the signal input method supported by the air conditioning device 500, and input it to the air conditioning device 500 through an appropriate input method. After receiving the linkage control instruction, the air conditioning device 500 can parse the key value from the received data signal and match the corresponding control program to respond to the linkage control instruction.

[0112] It can be seen that in the above embodiment, the display device 200 detects the media tag corresponding to the currently playing media, and when it determines that the currently playing media is applicable to the linkage control function, generates a linkage control instruction to control the air conditioning device 500 to operate synchronously and linkage-wise, so as to satisfy the user's need for a more comfortable environment when watching a specific type of media, thereby improving the user experience.

[0113] Similarly, in some embodiments, if the media tag is used to characterize that the currently playing media is applicable to the linkage control function, no linkage control instruction is generated to control the air conditioning device 500 and the display device 200 to operate independently of each other to meet the user's personalized needs for different types of media playback environments.

[0114] In some embodiments, the display device 200 can also determine whether the current media asset playback process meets the triggering conditions of the linkage control function. Since different triggering conditions of the linkage control function can be set according to different media assets and different scene characteristics, after obtaining the media asset tag, the display device 200 can determine whether the current media asset playback process meets the triggering conditions of the linkage control function by detecting the current scene parameters.

[0115] The current scene parameters are a series of parameters that can reflect the playback status. For example, the current scene parameters can be at least one of playback duration, ambient temperature, ambient humidity, ambient brightness, current time (segment), network status parameters, logged-in user information, scene images, etc. Different scene parameters can be detected and obtained in different ways.

[0116] In some embodiments, the current scene parameter can be detected and obtained by a detection module built into the controller 250. For example, the current scene parameter can include the playing time, that is, when the display device 200 starts playing the media asset data, the timing module in the controller 250 can record the playing time.

[0117] In some embodiments, the current scene parameter may be obtained through a built-in or external sensor of the display device 200. For example, the device interface 240 of the display device 200 may be connected to a thermometer, and after obtaining the media asset tag, the display device 200 may send a data acquisition request to the thermometer through the device interface 240 to obtain the ambient temperature through the thermometer.

[0118] In some embodiments, the current scene parameters can be obtained through other devices in the smart home system. For example, the smart home system includes a surveillance camera device. After obtaining the media resource tag, the display device 200 can send an image acquisition instruction to the surveillance camera through the smart home system network. After receiving the image acquisition instruction, the surveillance camera device can take a picture of the current scene to obtain a scene image.

[0119] In some embodiments, the current scene parameters can be obtained by performing data monitoring on the current smart home system. For example, in order to obtain the network status of the current smart home system network, the display device 200 can use a ping command, that is, send an Internet Control Message Protocol (ICMP) echo request message to a specified host, and then wait for an echo response, and calculate the round-trip time to estimate the network delay.

[0120] In the process of detecting the current scene parameter, the display device 200 can determine the type of the current scene parameter to be detected based on the linkage strategy data sent by the server 400. Figure 7As shown, in some embodiments, after setting the media asset tag, or when the currently playing media asset is set with a preset classification tag, the display device 200 can query the media asset category or the media asset belonging channel of the currently playing media asset according to the preset classification tag (S706). Since different types of media assets have different linkage control air conditioning devices 500 and corresponding trigger conditions, the display device 200 can determine the category of the scene parameter to be detected according to the media asset category or the media asset belonging channel (S707), so as to subsequently detect the current scene parameter according to the category of the scene parameter to be detected (S708).

[0121] For example, when the media tag of the currently playing media is set to the "sports" tag, the display device 200 can determine the media category as "sports" based on the sports tag. For sports media, the air conditioning device can be triggered to run according to the ambient temperature and the user's training time. Therefore, the display device 200 can determine the category of scene parameters to be detected, including temperature and time, based on the media category of the currently playing media, so that the display device 200 detects the ambient temperature and the media playback time, and triggers the linkage control with the air conditioning device according to the temperature and time.

[0122] In some embodiments, linkage strategy data sent by a server is received, and a tag set supporting a linkage control function is parsed from the linkage strategy data. If the media asset tag is in the tag set, the current scene parameters are detected. For example, when the display device 200 obtains a media asset tag as a "sports" tag, by reading the linkage strategy data about sports media assets sent by the server 400, it can be determined that the tag set includes classification tags such as "sports, fitness, aerobics, weight loss..." At this time, the "sports" tag read by the display device 200 is in the tag set, so the display device 200 can detect the current scene parameters such as the ambient temperature and media playback duration required for linkage control of sports media assets according to the "sports" tag.

[0123] In some embodiments, the current scene parameters include the media resource playback duration, and the media resource playback duration is used to trigger linkage control when the agreed playback duration is reached after the display device 200 starts playing the media resource.

[0124] In some embodiments, by detecting the playback duration of the media data, the display device 200 can obtain the user's viewing status of the current media. If the playback duration is greater than or equal to the duration threshold, it means that the user is not simply browsing the media, so a linkage control instruction can be generated.

[0125] For example, the preset duration threshold T0 is 5 minutes. After playing fitness media data with the "sports" tag, the display device 200 records the playing duration T of the media data. When T≥T0, it can generate a sports oxygen-enhancing instruction for controlling the start-up of the air-conditioning device, and send the sports oxygen-enhancing instruction to the air-conditioning device to start the air-conditioning device and adjust the environmental parameters according to the sports scene.

[0126] If the playback duration is less than the duration threshold, that is, the playback duration of the currently played media asset by the display device 200 does not reach the preset duration threshold, the display device 200 can continue to record the playback duration of the currently played media asset until the playback duration of the currently played media asset reaches the duration threshold and generates a linkage control instruction.

[0127] In some embodiments, when the display device 200 generates a linkage control instruction, it can detect the air conditioning device 500 associated with the display device 200 to determine the air conditioning device that can respond to the linkage control instruction. That is, the display device 200 can parse the target control parameter and the associated device set from the linkage strategy data. The target control parameter is the operating parameter corresponding to the media asset tag; the associated device set includes the device identification information of the air conditioning device associated with the display device.

[0128] Then obtain the device identification information of the air conditioning device that establishes a communication connection with the display device 200. If the device identification information is in the associated device set, calculate the target control parameters according to the current scene parameters, and generate the linkage control instructions according to the target control parameters, thereby sending the linkage control instructions to the air conditioning device 500.

[0129] That is, the server 400 can formulate a linkage strategy and generate linkage strategy data according to the access status of the devices in the smart home system where the display device 200 is located. The linkage strategy data can record the air conditioning devices that can be linked to each media asset tag, as well as the calculation method of the corresponding air conditioning device operating parameters. After obtaining the media asset tag, the display device 200 can extract information from the linkage strategy data to determine the associated device set composed of the air conditioning device information that can be linked. Then, according to the air conditioning devices that are online in the current smart home system, the air conditioning device that responds to the linkage control instruction is determined from the associated device information.

[0130] For example, when the display device 200 plays "sports" media, and the corresponding media tag is "sports", the display device 200 can determine that the devices that can be linked to the sports media include: air conditioning equipment, lighting equipment, speaker equipment and other related equipment sets. Then, based on the devices connected to the current smart home system, the air conditioning equipment is determined to be a controlled device that can respond to the linkage control command. At this time, the display device 200 can calculate the target operating parameters applicable to the air conditioning equipment according to the equipment type of the air conditioning equipment, and send them to the air conditioning equipment to control its operation.

[0131] In some embodiments, the air conditioning device can also operate in stages and scenes in response to the linkage control instruction. That is, the target operation parameter includes a stage parameter value set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameter, and the playback control instruction.

[0132] In some embodiments, the display device 200 can determine the media asset attributes, that is, determine the media asset category, the channel to which the media asset belongs, the media asset screen content, etc., based on the acquired media asset tags. Then, the operating parameters of the air conditioning device 500 are set according to the determined media asset attributes. For example, by reading the media asset tags and determining that the currently played media asset is fitness media, the display device 200 can trigger a sports oxygenation scene. At this time, the display device 200 can set the air supply volume of the air conditioning device according to the intensity of the exercise in the media asset screen content, that is, the more intense the exercise level represented in the media asset screen content, the greater the air supply volume when the air conditioning device is controlled to operate.

[0133] For another example, the display device 200 can trigger a children's animation scene when it determines that the currently playing media belongs to a children's channel by obtaining the channel tab where the media asset corresponding to the media asset being played belongs to the children's channel. In the children's animation scene, direct blowing of the air conditioner should be avoided, so a linkage control instruction containing a direct blowing prevention function can be generated and sent to the air conditioner, so that the air conditioner can supply air according to the linkage control instruction and the blowing prevention function.

[0134] In some embodiments, the target operating parameters can also be adjusted in stages according to the current scene parameters. For example, the display device 200 can also perform temperature detection in the process of generating linkage control instructions, that is, the temperature sensor built into the air-conditioning system (or the thermometer in the smart home system) will continuously monitor the indoor temperature. And according to the indoor temperature and the preset suitable temperature for the sports scene, determine whether to control the air conditioning cooling or heating. In cooling mode, the display device 200 can control the air-conditioning equipment to compress the refrigerant into a high-temperature and high-pressure gas through the compressor, and then release the heat to the outside through the condenser, and the refrigerant becomes a high-pressure liquid. After the liquid refrigerant passes through the expansion valve, the pressure decreases, the temperature drops, and it enters the evaporator to absorb the heat in the room, so the indoor temperature is reduced. Similarly, in heating mode, the display device 200 can control the air-conditioning equipment to enable the heating module and reverse the cooling process to absorb and release the outdoor heat into the room.

[0135] After sending the linkage control instruction to the air-conditioning device, the display device 200 can further set the operating state of the air-conditioning device according to the ambient temperature. That is, when the indoor temperature reaches the set value, the display device 200 can generate a parameter adjustment instruction to control the air-conditioning device to reduce or stop the cooling or heating work to maintain the stability of the indoor temperature. Similarly, if the indoor temperature deviates from the set value again, the display device 200 can also control the air-conditioning device to restart the corresponding cooling or heating mode through the parameter adjustment instruction. When the cooling or heating work of the air-conditioning device is controlled according to the temperature, the display device 200 can also perform air circulation control, that is, through specific control instructions, the fan of the air-conditioning device is controlled to inhale the indoor air, heat exchange through the evaporator or condenser, and then the treated air is sent back to the room through the air outlet. This process is circulated continuously until the indoor temperature reaches the set temperature.

[0136] In some embodiments, the target operating parameters can also be adjusted in stages according to the playback control instructions. For example, when the display device 200 is playing sports media A, it can receive a media switching instruction input by the user, that is, when the user controls the display device 200 to play movie media B through a remote control or other control device 200, the display device 200 will enter the movie playback scene, and in the movie playback scene, exercise oxygenation is no longer required, so an end oxygenation instruction can be generated according to the media switching instruction, and the end oxygenation instruction can be sent to the air conditioning device to control the air conditioning device to stop running.

[0137] It should be noted that the above embodiments are merely examples of periodic adjustment of target operation parameters, and do not limit the specific manner of adjusting the target operation parameters. In practical applications, the target operation parameters may also be periodically adjusted based on other types of parameters, such as parameters of the user's follow-up action detection results, user information, etc. Other parameters that can be associated with by those skilled in the art based on the above parameters also fall within the scope of protection of this application.

[0138] In some embodiments, the current scene parameters also include user location information. The display device 200 can also detect the user's interactive state when generating the linkage control instruction. Fig.10 As shown, the display device 200 can set a detection period (S1001) according to the duration threshold when generating a linkage control instruction, wherein the detection period is less than or equal to the duration threshold. During the detection period, the user position information is obtained through the human target detection sensor (S1002), and the valid user area corresponding to the currently playing media asset is obtained (S1003). If the user position represented by the user position information is located in the valid user area, and when the playing duration reaches the duration threshold, a linkage control instruction is generated (S1004).

[0139] Among them, the human target detection sensor can be a detection module built into the display device 200, for example, the human target detection sensor can be an infrared transceiver, a millimeter wave radar or other detectors set in the screen border area of ​​the display device 200. The human target detection sensor can be a detection device external to the display device 200, for example, the human target detection sensor can be a camera connected to the device interface 240 of the display device 200. The human detection sensor can also be other devices in the smart home system where the display device 200 is located. For example, after the display device 200 and the monitoring device are simultaneously connected to the local area network to form a smart home system, the display device 200 can detect the user's location information through the monitoring device, that is, the human detection sensor is a monitoring device connected to the smart home system.

[0140] Different types of person detection sensors detect user location information in different ways, and the corresponding ways of determining whether the user location represented by the user location information is located in the valid user area are also different. In some embodiments, the user location information can be represented by a numerical value, and the user location information can be the distance between the user and the display device 200, the position coordinates of the user in the detection area, etc. For example, when the person detection sensor is a millimeter wave radar, the millimeter wave radar can be used to transmit electromagnetic waves of a specific frequency to the valid user area, such as the viewing area of ​​the display device 200, and receive the signal reflected by the target on the path. Then, by analyzing the reflected signal, information such as the position, speed and direction of the target can be obtained. Then, based on the target position and the preset valid user area range, it is determined whether the target position is located in the valid user area.

[0141] In some embodiments, the user location information can also be expressed in a non-numerical manner. That is, the display device 200 can detect the user location information by image recognition or other methods other than detecting distance parameters, and judge whether the user location is located in the valid user area in an appropriate manner. For example, when the display device 200 plays sports media and the preset duration threshold is 5 minutes, the display device 200 can set the detection period to 5 minutes according to the duration threshold. And during the detection period, the viewing area in front of the display device 200 is imaged by a built-in or external camera device of the display device 200 to obtain an image of the viewing area. Then, the portrait target in the viewing area image is identified by an image recognition algorithm. If a portrait target is identified in the viewing area image, it means that the user position is located in the valid user area, that is, it is determined that the user is in a fitness training state. At this time, the display device 200 can generate a linkage control instruction to control the operation of the air-conditioning equipment when the playback duration reaches the duration threshold.

[0142] By detecting the user's location information, the display device 200 can determine whether the user is in a specific interactive state such as following a fitness exercise, watching media resources, etc., and thus execute linkage control only when the user is in the corresponding interactive state, thereby improving the accuracy of linkage control and improving user experience.

[0143] In some embodiments, the display device 200 may detect the number of human targets in the effective user area, and control the air conditioning device 500 to operate according to different operating parameters according to different numbers of human targets. That is, after obtaining the user position information, the display device 200 may parse the number of human targets from the user position information, and then calculate the number of participating targets whose user positions are located in the effective user area, wherein the number of participating targets is a positive integer.

[0144] If the number of participating targets is equal to 1, that is, there is only one user in the valid user area, the display device 200 can control the air conditioning device 500 to respond to the linkage control instruction and maintain operation according to the target operation parameters.

[0145] If the number of participating targets is greater than 1, that is, there are two or more users in the valid user area, the display device 200 may generate a first adjustment instruction and send the first adjustment instruction to the air conditioning device. The first adjustment instruction is used to control the air conditioning device to operate according to a first operating parameter, and the air parameter adjustment amount corresponding to the first operating parameter is greater than the air parameter adjustment amount corresponding to the target operating parameter.

[0146] In some embodiments, the effective user area is the viewing area directly in front of the display device 200. After acquiring the image of the viewing area through the camera device, the display device 200 can extract the portrait target from the acquired image and record the number of portrait targets located in the viewing area. When the number of portrait targets is 1, such as when a single user is doing sports training, the display device 200 can control the air conditioning device 500 to maintain operation according to the default parameters. When the number of portrait targets is greater than or equal to 2, such as when multiple users are doing sports training, a first adjustment instruction is generated, and the first adjustment instruction is sent to the air conditioning device 500.

[0147] In some embodiments, the display device 200 can hierarchically adjust the operating parameters of the air conditioning device 500 according to the number of portrait targets. The air parameter adjustment amount corresponding to the adjusted operating parameters is proportional to the number of portrait targets, that is, the more the number of portrait targets in the effective user area, the more the parameter adjustment amount of the linked control air conditioning device 500.

[0148] In some implementations, the display device 200 may pre-set a mapping relationship between the number of portrait targets and the level of operating parameters. For example, when the number of portrait targets is 1, the level of operating parameters is level 1, and under the level 1 operating parameters, the air supply wind force of the air conditioning device 500 is level 1; when the number of portrait targets is 2-3, the level of operating parameters is level 2, and under the level 2 operating parameters, the air supply wind force of the air conditioning device 500 is level 2; when the number of portrait targets is 4-5, the level of operating parameters is level 3, and under the level 3 operating parameters, the air supply wind force of the air conditioning device 500 is level 3. Therefore, when the number of portrait targets is greater than or equal to 2, such as when multiple users perform exercise follow-up training, a first adjustment instruction is generated, and the first adjustment instruction carries the level of operating parameters, which is used to adjust the relevant operating parameters of the air conditioning device 500.

[0149] In some embodiments, the display device 200 may also monitor the media playback status after generating a linkage control instruction and controlling the air conditioning device 500 to operate according to the target operating parameters, and dynamically adjust the operating parameters of the air conditioning device 500 according to the media playback parameters obtained by monitoring. That is, the display device 200 may obtain the media playback parameters of the currently playing media, wherein the media playback parameters include at least one of the media playback speed, the playback interval, and the number of repeated playbacks. The media playback parameters may be obtained by reading the player playback status and counting the interactive actions related to the playback. For example, the media playback interface may be provided with speed controls such as 0.5 times speed, 1 times speed, 1.5 times speed, and 2 times speed. In the process of playing the current media, the display device 200 may read the speed control selected by the user and determine the media playback speed according to the speed control selected by the user.

[0150] In some embodiments, when the user controls the display device 200 to play multiple media asset data in sequence, the display device 200 may also detect the play interval time of two adjacent media asset data. For example, for media asset A and media asset B that are played continuously, the display device 200 may record the end play time of media asset A after monitoring the end play event of media asset A. Then monitor the start play event of media asset A, and after monitoring the start play event of media asset B, record the start play time of media asset B. Then calculate the time difference between the end play time and the start play time to obtain the play interval time.

[0151] In some embodiments, the display device 200 may also detect the number of repeated playbacks of a single or multiple media assets. For example, the display device 200 may monitor the end playback event of media asset A, and each time the end playback event is monitored, the number of records increases once, that is, count (media A) + 1. By counting the number of repeated playbacks, the user's repeated playback behavior of the media asset can be determined, which is used to adjust the operating parameters according to the number of repeated playbacks.

[0152] After obtaining the media playback parameters, the display device 200 can calculate the adjustment parameters according to the media playback parameters and the current scene parameters. Then, a parameter adjustment instruction is generated according to the adjustment parameters, and the parameter adjustment instruction is sent to the air conditioning device, so that the air conditioning device adjusts the operating parameters according to the adjustment parameters. That is, the control switching instruction is used to control the air conditioning device to adjust the operating parameters.

[0153] In some embodiments, for sports media, different media have different amounts of motion. The display device 200 can estimate the total amount of motion within a period of time by counting the media playback parameters, so as to set different operating parameters according to different total amounts of motion. That is, the display device 200 can obtain the media playback parameters of the currently playing media, wherein the media playback parameters include at least one of the media playback speed, the playback interval duration, and the number of repeated playbacks. Then, the motion intensity value is calculated according to the media playback parameters, and the motion intensity value is the weighted summation result of the media playback parameters; if the motion intensity value is in the first motion intensity interval, a second adjustment instruction is generated, and the second adjustment instruction is sent to the air conditioning device, and the second adjustment instruction is used to control the air conditioning device to operate according to the second operating parameter; if the motion intensity value is in the second motion intensity interval, a third adjustment instruction is generated, and the third adjustment instruction is sent to the air conditioning device. Among them, the third adjustment instruction is used to control the air conditioning device to operate according to the third operating parameter; the air parameter adjustment amount corresponding to the third operating parameter is greater than the air parameter adjustment amount corresponding to the second operating parameter.

[0154] When the display device 200 plays sports media, the air conditioner is controlled to perform sports sample delivery linkage control according to different sports intensity levels. For example, different sports intensities corresponding to the media content can be set, such as: 0-100 kcal, 200-300 kcal, 300+ kcal, etc. Different sports levels are set accordingly, such as: elementary, intermediate, advanced, etc. And different air conditioner operation parameters are set according to different stages, such as: warm-up stage, exercise stage, end stage, and according to different sports scenes, such as: teaching version, follow-up version.

[0155] Therefore, the air conditioning equipment can be adjusted as the media is played. For example, a comprehensive evaluation is performed based on the above classification strategy to carry out different levels of oxygen enrichment scene stages. When the agreed media is switched, the agreed duration is run, or someone is exercising, the scene is switched and the oxygen enrichment scene level 1 is executed. In addition, during the playback process, the oxygen enrichment level is adjusted according to the following calculation method:

[0156] K=Math.ceil((k1+k2+k3+k4+k5) / 5)

[0157] Among them, K is the comprehensive level determined according to the current scene parameters; K1 is the intensity exercise weight; k2 is the classification weight; k3 is the stage weight; k4 is the scene weight; k5 is the exercise duration weight.

[0158] That is, according to the above formula, the weights of different intensity exercises k1, different graded weights k2, different stage weights k3, different scene weights k4, and exercise duration weight k5 can be added together and divided by 5, and then the result can be rounded up to the corresponding comprehensive level of the oxygen increase level adjustment strategy, and then the operating parameters of the air-conditioning equipment can be determined based on the comprehensive level.

[0159] The weight values ​​are as follows:

[0160] Weight 1 2 3 default Different intensity exercise (kcal) k1 0-100 200-300 300+ 1 Different grades k2 primary intermediate advanced 1 Different stages k3 Warm-up phase Exercise Phase Ending Phase 1 Different scenes k4 Teaching Edition Practice Version 1 Exercise duration k5 1 / 3 2 / 3 3 / 3 1

[0161] Exemplarily, the display device 200 determines that the current exercise intensity is 200-300 kcal by reading the media asset tag, detecting the current scene parameters and the media asset playback parameters, and correspondingly determines k1=2; the current exercise grade is elementary, and correspondingly determines k2=1; the current exercise stage is the training stage, and correspondingly determines k3=2; the current exercise scene is the follow-up version, and correspondingly determines k4=2; the current exercise duration accounts for 2 / 3 of the total duration, and correspondingly determines k5=2. Then, according to the above weights, calculate (2+1+2+2+2) / 5=1.8, round up the calculation result, and determine the comprehensive level k=2. Therefore, the display device 200 can determine the operating parameters of the air-conditioning equipment according to the comprehensive level k=2, and control the air-conditioning equipment to operate according to the operating parameters.

[0162] In some embodiments, the display device 200 can also synchronously adjust the operating state of the air conditioning device when the user switches to play the media, such as Fig.11 As shown, the display device 200 can obtain the media switching instruction input by the user (S1101), and in response to the media switching instruction, record the first media tag (S1102), wherein the first media tag is the media tag of the currently playing media. Then obtain the second media tag (S1103), wherein the second media tag is the media tag of the media played after the media switching instruction is switched. If the second media tag is different from the first media tag, generate a fourth adjustment instruction, and send the fourth adjustment instruction to the air conditioning device (S1104). The fourth adjustment instruction is used to control the air conditioning device to operate according to the fourth operating parameter, and the fourth operating parameter is different from the target operating parameter. If the second media tag is the same as the first media tag, control the air conditioning device to maintain operation according to the target operating parameter (S1105).

[0163] For example, when the display device 200 is playing media A, it receives a media switching instruction input by the user to switch to playing media B. The display device 200 can record the media tag "sports" corresponding to media A, and obtain the media tag corresponding to media B. If the media tag corresponding to media B is also "sports", the display device 200 can control the air-conditioning equipment to maintain operation according to the target operating parameters to continue exercise and oxygenation.

[0164] Similarly, if the media asset tag corresponding to media asset B is "film and television", since exercise and oxygenation are not required in film and television scenes, the display device 200 can generate a fourth adjustment instruction for the film and television scene according to the media asset tag corresponding to media asset B. The generated fourth adjustment instruction can control the air conditioning device to stop running, that is, stop exercise and oxygenation.

[0165] In some embodiments, the display device 200 may also adjust the operating state of the air conditioning device according to the pause duration. Fig.12 As shown, the display device 200 can obtain a pause playback instruction input by a user (S1201), and in response to the pause playback instruction, record the pause duration (S1202). When the pause duration is greater than or equal to the second duration threshold, a fifth adjustment instruction is generated, and the fifth adjustment instruction is sent to the air conditioning device (S1203). The fifth adjustment instruction is used to control the air conditioning device to operate according to a fifth operating parameter, and the air parameter adjustment amount corresponding to the fifth operating parameter is less than the air parameter adjustment amount corresponding to the target operating parameter.

[0166] For example, when the display device 200 is playing sports media, it receives a pause instruction input by the user through the "pause" key on the control device 100. Then, based on the input time of the pause instruction, the pause duration is recorded. When the pause duration exceeds 5 minutes, the display device 200 can generate a parameter adjustment instruction for reducing the first-level air supply volume, and send the parameter adjustment instruction to the air conditioning device, so that the air conditioning device reduces the first-level air supply volume to adapt to the pause environment.

[0167] In some embodiments, when the single pause duration is less than the pause duration threshold, if a continue playing instruction is received, the fifth adjustment instruction is not generated, so that the air conditioning device maintains operation according to the target operating parameters. That is, when the display device 200 detects that the pause time is short, the operating parameters of the air conditioning device may not be modified, thereby reducing the impact of frequent linkage control on the air conditioning device and user experience.

[0168] In some embodiments, as the user's pause time increases, the display device 200 can adjust the operating parameters of the air conditioning device 500 step by step. For example, the second duration threshold can be set to three gears of 5 minutes, 10 minutes, and 20 minutes. When the pause time exceeds 5 minutes, the display device 200 can control the oxygenation scene of the air conditioning device to drop by one level through the parameter adjustment instruction. When the pause time exceeds 10 minutes, the display device 200 can control the oxygenation scene of the air conditioning device to drop by another level through the parameter adjustment instruction. When the pause time exceeds 20 minutes, the display device 200 can control the oxygenation scene of the air conditioning device to drop by another level through the parameter adjustment instruction until it drops to the lowest level and then turns off.

[0169] In some embodiments, the display device 200 can synchronously control the air conditioning device to stop linkage when the media data is stopped. Fig.13 As shown, the display device 200 can obtain a stop playback instruction input by a user (S1301), and generate a linkage stop instruction (S1302) in response to the stop playback instruction. Then, the linkage stop instruction is sent to the air conditioning device (S1303) so that the air conditioning device no longer operates according to the operating parameters.

[0170] For example, when displaying sports media, the display device 200 receives a stop playback instruction input by the user based on the "return" key on the control device 100, and generates a linkage stop instruction in response to the stop playback instruction and sends it to the air conditioning device. After receiving the linkage stop instruction, the air conditioning device 200 can shut down or enter a standby state and no longer perform sports oxygenation.

[0171] Based on the above display device 200, some embodiments of the present application further provide a media asset trigger linkage method, which is applied to the display device 200 described in the above embodiment, and the method includes:

[0172] In response to a media asset playing instruction, a media asset tag of the currently playing media asset is obtained, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, and the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content;

[0173] If the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device, wherein the linkage control instruction is used to control the air conditioning device to operate according to the target operation parameters; wherein the target operation parameters include a phased parameter value set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameters, and the playback control instruction;

[0174] If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated.

[0175] In conjunction with the display device 200, such as Fig.14 As shown, some embodiments of the present application also provide a smart home system, including: a display device 200 and an air conditioning device 500, wherein a communication connection is established between the display device 200 and the air conditioning device 500;

[0176] The display device 200 is configured to: in response to a media asset playing instruction, obtain a media asset tag of the currently playing media asset, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, wherein the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content;

[0177] If the media asset tag is used to indicate that the currently played media asset is applicable to the linkage control function, generating a linkage control instruction, and sending the linkage control instruction to the air conditioning device;

[0178] If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated.

[0179] The air conditioning equipment 500 is configured to: receive the linkage control instruction, and operate according to the target operating parameters in response to the linkage control instruction; wherein the target operating parameters include phased parameter values ​​set according to at least one of the media attributes of the currently playing media, the current scene parameters, and the playback control instruction.

[0180] It can be seen from the above technical solutions that some embodiments of the present application provide a display device, a smart home system and a media asset trigger linkage method, which can obtain the media asset tag of the currently playing media asset in response to the media asset playback instruction. If the media asset tag is used to characterize that the currently playing media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device to control the air conditioning device to operate according to the target operation parameters. Among them, the media asset tag is a classification tag set according to the media asset attributes of the currently playing media asset, and the media asset attributes include at least one of the media asset category, the media asset channel, and the media asset screen content; the target operation parameters include stage parameter values ​​set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameters, and the playback control instruction. The method can generate a linkage control instruction based on the media asset tag to automatically control the operation of the air conditioning device when the played media meets the preset conditions, improve the linkage control accuracy, and improve the user experience.

[0181] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0182] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0183] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0184] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; A communication device configured to establish a communication connection with the air conditioning device to form a smart home system; The controller is configured as: In response to a media asset playing instruction, a media asset tag of the currently playing media asset is obtained, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, and the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content; If the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device, wherein the linkage control instruction is used to control the air conditioning device to operate according to the target operation parameters; wherein the target operation parameters include a phased parameter value set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameters, and the playback control instruction; If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated.

2. The display device according to claim 1, characterized in that The communication device is further configured to establish a communication connection with the server, and the controller is further configured to: Receive linkage strategy data sent by the server; Parsing a tag set supporting a linkage control function from the linkage policy data; If the media asset tag is in the tag set, marking the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function.

3. The display device according to claim 1, characterized in that The controller executes and generates linkage control instructions, and is further configured to: Detecting current scene parameters, where the current scene parameters include the playing time of the currently playing media asset; Get the duration threshold; If the playback duration is greater than or equal to the duration threshold, generating a linkage control instruction; If the playing time is less than the time threshold, the playing time of the currently playing media asset continues to be recorded.

4. The display device according to claim 3, characterized in that The current scene parameters also include user location information, and the controller is further configured to execute and generate the linkage control instruction: Setting a detection period according to the duration threshold, wherein the detection period is less than or equal to the duration threshold; During the detection period, obtaining user location information through a human target detection sensor; Obtaining a valid user area corresponding to the currently playing media asset; If the user location represented by the user location information is located within the valid user area, a linkage control instruction is generated.

5. The display device according to claim 4, characterized in that The controller is also configured to: Parsing the number of target characters from the user location information; Calculate the number of participating targets whose user locations are within the valid user area, where the number of participating targets is a positive integer; If the number of participating targets is equal to 1, controlling the air conditioning device to respond to the linkage control instruction and maintain operation according to the target operation parameters; If the number of participating targets is greater than 1, a first adjustment instruction is generated and sent to the air conditioning equipment. The first adjustment instruction is used to control the air conditioning equipment to operate according to a first operating parameter. The air parameter adjustment amount corresponding to the first operating parameter is greater than the air parameter adjustment amount corresponding to the target operating parameter.

6. The display device according to claim 1, characterized in that The controller is also configured to: Acquire a media asset playback parameter of the currently playing media asset, wherein the media asset playback parameter includes at least one of a media asset playback speed, a playback interval duration, and a number of repeated playbacks; Calculate a motion intensity value according to the media asset playback parameters, wherein the motion intensity value is a weighted summation result of the media asset playback parameters; If the exercise intensity value is within the first exercise intensity interval, generating a second adjustment instruction, and sending the second adjustment instruction to the air conditioning device, the second adjustment instruction being used to control the air conditioning device to operate according to a second operating parameter; If the exercise intensity value is within the second exercise intensity interval, generating a third adjustment instruction, and sending the third adjustment instruction to the air conditioning device, wherein the third adjustment instruction is used to control the air conditioning device to operate according to a third operating parameter; The air parameter adjustment amount corresponding to the third operating parameter is greater than the air parameter adjustment amount corresponding to the second operating parameter.

7. The display device according to claim 1, characterized in that The controller is also configured to: Get the media resource switching instruction input by the user; In response to the media asset switching instruction, recording a first media asset tag, where the first media asset tag is a media asset tag of the currently playing media asset; Acquire a second media asset tag, where the second media asset tag is a media asset tag of the media asset played after the media asset switching instruction switches; If the second media asset tag is different from the first media asset tag, generating a fourth adjustment instruction, and sending the fourth adjustment instruction to the air conditioning device, the fourth adjustment instruction is used to control the air conditioning device to operate according to a fourth operating parameter, the fourth operating parameter being different from the target operating parameter; If the second media asset tag is the same as the first media asset tag, the air conditioning device is controlled to maintain operation according to the target operation parameters.

8. The display device according to claim 1, characterized in that The controller is also configured to: Get the pause playback command input by the user; In response to the pause playback instruction, recording the pause duration; When the pause duration is greater than or equal to the second duration threshold, generating a fifth adjustment instruction, and sending the fifth adjustment instruction to the air conditioning device, the fifth adjustment instruction is used to control the air conditioning device to operate according to a fifth operating parameter, and the air parameter adjustment amount corresponding to the fifth operating parameter is less than the air parameter adjustment amount corresponding to the target operating parameter; When the single pause duration is less than the pause duration threshold, if a continue playing instruction is received, the fifth adjustment instruction is not generated, so that the air conditioning equipment maintains operating according to the target operating parameters.

9. A smart home system, characterized in that: include: A display device and an air conditioning device, wherein a communication connection is established between the display device and the air conditioning device; The display device is configured to: in response to a media asset playing instruction, obtain a media asset tag of a currently playing media asset, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, wherein the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content; If the media asset tag is used to indicate that the currently played media asset is applicable to the linkage control function, generating a linkage control instruction, and sending the linkage control instruction to the air conditioning device; If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated; The air conditioning equipment is configured to: receive the linkage control instruction, and operate according to the target operating parameters in response to the linkage control instruction; wherein the target operating parameters include phased parameter values ​​set according to at least one of the media attributes of the currently playing media, the current scene parameters, and the playback control instruction.

10. A media resource trigger linkage method, characterized in that: Applied to the display device according to any one of claims 1 to 8, the method comprising: In response to a media asset playing instruction, a media asset tag of the currently playing media asset is obtained, wherein the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, and the media asset tag is a classification tag set according to the media asset attribute of the currently playing media asset, and the media asset attribute includes at least one of a media asset category, a media asset belonging channel, and a media asset screen content; If the media asset tag is used to indicate that the currently playing media asset is applicable to the linkage control function, a linkage control instruction is generated, and the linkage control instruction is sent to the air conditioning device, wherein the linkage control instruction is used to control the air conditioning device to operate according to the target operation parameters; wherein the target operation parameters include a phased parameter value set according to at least one of the media asset attributes of the currently playing media asset, the current scene parameters, and the playback control instruction; If the media asset tag is used to indicate that the currently played media asset is not applicable to the linkage control function, no linkage control instruction is generated.

Images