Display device and channel switching method
By establishing a mapping relationship between external device names and HDMI channel identifiers in the display device, and automatically switching signal source channels using voice commands, the problem of cumbersome operation for switching external devices on the display device is solved, achieving efficient and convenient channel switching and improving the user experience.
Patent Information
- Application Number
- CN202411751705.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-30
- Publication Date
- 2025-12-16
- Estimated Expiration
- 2044-11-30
AI Technical Summary
The current display devices require cumbersome operations when switching external devices, which affects the user experience.
By establishing a mapping relationship between external device names and HDMI channel identifiers in the display device, and using voice commands to parse keywords, the system can automatically switch signal source channels in response to user voice commands.
It improves the efficiency of channel switching, provides a more natural and convenient interaction method, and enhances the user experience.
Smart Images

Figure CN119653144B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the display field, and particularly to a display device and a channel switching method. BACKGROUND
[0002] With the continuous development of display devices in image processing, display presentation, and audio effects, users are increasingly keen to connect other external devices to the display devices to obtain more rich, shocking, and immersive audio-visual entertainment experiences.
[0003] Taking a smart TV as an example, in the daily use process, users usually connect various external devices such as game devices, Blu-ray players, and TV boxes to the smart TV through HDMI interfaces; whenever the user expects to use a specific external device, the user needs to use a remote control or operation buttons on the smart TV to first perform corresponding control operations on the smart TV to achieve channel switching; for example, when the user wants to switch to a game console A connected to the HDMI2 interface to play games, the user performs operation control through operation buttons to enter a list interface corresponding to the external device interface of the smart TV, switches the signal source from the current channel to the HDMI2 channel corresponding to the game console A, so that the smart TV can receive the picture signal and audio signal output by the game console A.
[0004] However, the above control operation needs to be performed every time the external device is switched, which to some extent brings the user operational complexity and affects the user experience. SUMMARY
[0005] The present application provides a display device and a channel switching method, which can quickly switch to a signal source channel required by a user according to a voice of the user.
[0006] In a first aspect, a display device is provided, which includes a display, a controller, and at least one HDMI interface; the controller is configured to: in response to a voice instruction input by a user, receive a keyword obtained by parsing the voice instruction, the keyword being used to represent a business type of an external device; and then determine whether a mapping relationship for indicating channel switching exists between the keyword and an HDMI channel identifier; if the mapping relationship exists between the keyword and the HDMI channel identifier, generate a channel switching instruction, so that content input by the external device can be presented on the display.
[0007] It should be understood that the channel switching instruction is used to instruct switching to a target HDMI channel mapped by the keyword.
[0008] It should also be understood that the mapping relationship is a relationship dynamically established between a device name of any external device, a preset business type corresponding to the device name, and an HDMI channel identifier corresponding to an HDMI transmission channel of the external device.
[0009] The embodiment of the present application shows that the display device has a mapping relationship, which is a relationship dynamically established by the device name of the external device, the preset service type corresponding to the device name, and the HDMI channel identifier. Furthermore, in response to a voice instruction input by a user, a keyword used to represent a service type of the external device is received by parsing the voice instruction. When the keyword and the HDMI channel identifier have a mapping relationship used to indicate channel switching, a channel switching instruction is generated to cause the display to present content input by the external device. This process of automatically responding to the voice instruction of the user to switch the signal source channel improves the processing efficiency of the channel switching service, thereby improving the user experience.
[0010] In a possible implementation, before the controller performs the operation of receiving a keyword used to represent a service type of the external device by parsing the voice instruction input by the user in response to the voice instruction, the controller is further configured to: detect access of the external device, read an HDMI channel identifier corresponding to the access of the external device; obtain a device name of the external device based on the CEC protocol; determine the service type corresponding to the external device based on a matching relationship between the device name and the preset service type; and establish a mapping relationship between the HDMI channel identifier and the service type of the external device.
[0011] The present application can efficiently match the keyword parsed from the voice instruction and the external device by adding the mapping relationship, thereby providing strong support and convenient ways for accurate correspondence between the two. Furthermore, the user can switch the current channel of the display device through voice. This way provides a more natural interaction mode for the user. Compared with the traditional key operation, the voice instruction has significant advantages in channel switching. It can improve the user's satisfaction and make the user more convenient and efficient when operating the display device. The user no longer needs to search for the control device and press the keys. The user can easily complete the channel switching by simply issuing a voice instruction, which greatly improves the user experience.
[0012] In a possible implementation, the controller performs the operation of determining whether the keyword and the HDMI channel identifier have a mapping relationship used to indicate channel switching. If the keyword and the HDMI channel identifier have a mapping relationship, the channel switching instruction is generated. The controller is configured to: match the keyword with the service type in the mapping relationship in the case of receiving the keyword used to represent the service type of the external device by parsing the voice instruction; if the keyword is matched, it is determined that the keyword and the HDMI channel identifier have a mapping relationship used to indicate channel switching; and based on the mapping relationship, determine a target HDMI channel corresponding to the keyword and generate the channel switching instruction.
[0013] The application matches the keyword with the service type in the mapping relationship; in the case that there is a service type matching the keyword in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the service type; this process of matching the keyword with the service type in the mapping relationship can accurately determine the matching external device in the mapping relationship, and then determine the corresponding signal source channel, thereby improving the processing efficiency of channel determination.
[0014] In a possible implementation, the controller is configured to determine the target HDMI channel corresponding to the keyword based on the mapping relationship, and in the case that one external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.
[0015] In the process of matching the keyword with the mapping relationship, multiple cases can occur. In one case, only one external device is matched in the mapping relationship. When this case occurs, in order to accurately match the target HDMI channel corresponding to the voice instruction, the signal source channel corresponding to the only matched external device can be directly determined as the target HDMI channel; this can improve the processing efficiency in this case, avoid complex screening and judgment processes, and enable the system to quickly respond and switch to the correct signal source channel, thereby providing a smoother and more efficient use experience for the user.
[0016] In a possible implementation, the controller is configured to determine the target HDMI channel corresponding to the keyword based on the mapping relationship, and in the case that M external devices are matched in the mapping relationship, M is greater than 1, and the controller is configured to present a first signal source list corresponding to the M external devices on the display; and in response to a first selection instruction of the user, the controller is configured to determine the target HDMI channel based on the external device corresponding to the first selection instruction.
[0017] In the process of matching the keyword with the mapping relationship, multiple cases can occur. In another case, when multiple external devices are matched in the mapping relationship, in order to accurately match the target HDMI channel corresponding to the voice instruction, detailed analysis is required according to different cases. Because multiple possible options exist at this time, further interaction with the user can be performed. Through communication with the user, the specific needs of the user are understood, for example, the user is asked “which device do you want to connect?” or the user is prompted to make a selection according to some specific scenarios. After obtaining the explicit interaction of the user, the external device that the user wants to connect can be determined from the multiple matched external devices, and then the target HDMI channel corresponding to the external device is determined. This processing manner can ensure that the needs of the user are accurately met in the complex case of multiple matched devices, and improve the intelligence and user experience of the system.
[0018] In a possible implementation, the controller is configured to determine the target HDMI channel corresponding to the keyword based on the mapping relationship, and configured to: in a case where M external devices are matched in the mapping relationship, obtain historical use data of the M external devices by the user, where M > 1; determine a second signal source list corresponding to the M external devices based on the historical use data, and present the second signal source list on the display; and in response to a second selection instruction of the user, determine the target HDMI channel based on an external device corresponding to the second selection instruction.
[0019] In the process of matching the keyword with the mapping relationship, multiple cases can occur. Another case is that when multiple external devices are matched in the mapping relationship, the multiple matched external devices can be sorted based on the historical use data of the user, because the historical use data of the user contains rich information, which records the use frequency, use time and use scene of each external device by the user in the past. For example, if a certain external device frequently appears in the recent use of the user, it can be arranged in a relatively high position in the sorting, which means that the device is more likely to be the target pointed to by the voice instruction of the user. This sorting method based on the historical use data can more accurately infer the intention of the user from multiple possible external devices, thereby providing a strong basis for further determining the target HDMI channel, and further optimizing the experience of the user in operating the device through the voice instruction.
[0020] In a possible implementation, after the controller matches the keyword with the device name in the mapping relationship, the controller is further configured to: if a business type corresponding to the keyword is not matched in the mapping relationship, obtain a local application program corresponding to the keyword; and if the number of the local application programs is 0, display a business area corresponding to the keyword.
[0021] In the process of matching the keyword with the mapping relationship, multiple cases can occur. Another case is that there is no business type matched with the keyword in the mapping relationship, and there is also no local application program in the display device, at this time, some function-related system resources can be recommended to the user according to the user demand, to guide the user to better use the resources owned by the system to achieve the purpose.
[0022] In a possible implementation, after the controller matches the keyword with the device name in the mapping relationship, the controller is further configured to: if a business type corresponding to the keyword is not matched in the mapping relationship, obtain a local application program corresponding to the keyword; and if the number of the local application programs is 1, start the local application program.
[0023] In the mapping relationship, there is no service type matching the keyword, and there is only one matching local application program in the display device. When this situation occurs, the only matching local application program can be directly started. The processing efficiency in this case can be improved.
[0024] In a possible implementation, after the controller matches the keyword with the device name in the mapping relationship, the controller is further configured to: if no service type corresponding to the keyword is matched in the mapping relationship, acquire a local application program corresponding to the keyword; if the number of local application programs is N, display an application program list corresponding to each local application program, where N>1; and in response to a third selection instruction of a user, start a first application program based on the first application program corresponding to the third selection instruction, where the local application programs include the first application program.
[0025] In the mapping relationship, there is no service type matching the keyword, and there is only one matching local application program in the display device. When this situation occurs, the only matching local application program can be directly started. The processing efficiency in this case can be improved.
[0026] In a possible implementation, after the controller executes the channel switching instruction, the controller is further configured to: acquire a state of a startup peripheral linkage switch in the display device; and adjust the state of the startup peripheral linkage switch to an open state.
[0027] In order to save energy and quickly respond to the startup instruction, the external device in communication connection with the display device is mostly in a standby mode. The display device can quickly wake up the corresponding external device through the CEC protocol by adjusting the peripheral linkage switch. In order to achieve fast channel switching and use experience after switching, the state of the startup peripheral linkage switch in the display device is monitored to improve the user experience.
[0028] In a possible implementation, after the controller responds to the voice instruction input by the user, the controller is further configured to: receive a keyword and a signal source identifier used to represent a service type of the external device, which are obtained by analyzing the voice instruction; match the signal source identifier and the keyword with a set of mapping data in the mapping relationship, and if the signal source identifier and the keyword completely match the set of mapping data in the mapping relationship, determine a target HDMI channel corresponding to the signal source identifier and the keyword, and generate a channel switching instruction.
[0029] There can be other information in the keyword, such as a signal source identifier. In this scenario, there can be a case where the signal source identifier and the keyword completely match a set of mapping data in the mapping relationship, and the target HDMI channel that the user wants to switch to can be directly determined.
[0030] In a possible implementation, the controller, after responding to the voice instruction entered by the user, is further configured to: receive a keyword and a signal source identifier for representing a service type of the external device parsed from the voice instruction; match the signal source identifier, the keyword, and a set of mapping data in the mapping relationship, and if the signal source identifier, the keyword, and the set of mapping data in the mapping relationship do not completely match, display a list of alternative channels; wherein the list of alternative channels includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and / or at least one set of mapping data corresponding to the keyword; and in response to a fourth selection instruction of the user, determine the target HDMI channel based on the external device corresponding to the fourth selection instruction.
[0031] There can be other information in the keyword, such as a signal source identifier. In this scenario, there can be a case where the signal source identifier and the keyword do not completely match a set of mapping data in the mapping relationship, and at this time, more refined matching is needed to improve the intelligent analysis of the display device. The signal source channel that can be matched with the keyword or the signal source identifier is presented to the user to facilitate communication with the user and understand the specific needs of the user. After obtaining the explicit interaction of the user, the target HDMI channel that the user wants to switch to can be determined from these signal source channels.
[0032] In a possible implementation, the service type of the external device includes a game type and a non-game type; and the controller is further configured to: in a case where the keyword represents the service type of the external device as the game type, determine whether there is a mapping relationship between the keyword and an HDMI channel identifier for indicating channel switching, and if there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction.
[0033] The communication connection between the display device and the game device is increasingly diverse. In this application scenario, the game device is the main external device and is in communication connection with the display device through an HDMI interface. In order to improve the user experience in the channel switching process in this scenario, the external device service type can be divided into game devices and non-game devices to improve the processing speed in the voice channel switching process.
[0034] And, when the voice instruction is received and the keyword in the voice instruction indicates that the external device service type is a game type, the embodiment of the application performs switching of the signal source; it should be understood that the keyword indicating that the external device service type is a game type is a kind of relatively broad language expression, and the embodiment of the application can achieve accurate channel switching by combining the mapping relationship determined by the external device in communication connection with the display device.
[0035] In a possible implementation, the display device includes a voice module, a signal source management module, a middleware module and a display module, and the controller is configured to: the voice module receives a voice instruction, sends the voice instruction to a server, and receives a keyword sent by the server to the display device for indicating an external device service type; the voice module generates a channel switching instruction when it is determined that the keyword and the HDMI channel identifier have a mapping relationship for indicating switching of channels; the signal source management module switches the signal source to a target HDMI channel after receiving the channel switching instruction; and the display module is notified to present content input by the external device corresponding to the target HDMI channel on the display
[0036] The software architecture in the display device includes a voice module, a signal source management module, a middleware module and a display module, the mapping relationship related to the external device in communication connection with the display device is dynamically constructed through the middleware module, the matching of the keyword corresponding to the voice instruction and the mapping relationship is implemented, the target HDMI channel corresponding to the keyword can be quickly locked; then, the signal source of the display device is switched to the target HDMI channel, and the content input by the external device through the target HDMI channel is presented on the display; this process of automatically switching the signal source channel in response to the voice instruction of the user improves the processing efficiency of the channel switching service, thereby improving the user experience.
[0037] In a second aspect, a display device is provided, which includes a display, a controller and at least one HDMI interface; the controller is configured to: in a state where an external device is in communication connection with the display device through a first HDMI interface, receive a voice instruction input by a user, and analyze the voice instruction to obtain identification information of the external device; and according to a mapping relationship between the identification information and a first HDMI channel identifier, switch a signal source to an external device corresponding to the identification information, wherein the first HDMI channel identifier is a channel identifier corresponding to the first HDMI interface in the display device; and the mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device is connected to the first HDMI interface.
[0038] In a third aspect, a channel switching method is provided, which is applied to the display device of the first aspect, and the method includes:
[0039] In response to the voice instruction input by the user, a keyword parsed from the voice instruction is received, the keyword being used to represent a service type of the external device; it is determined whether a mapping relationship exists between the keyword and the HDMI channel identifier for instructing switching of the channel, and if the mapping relationship exists between the keyword and the HDMI channel identifier, a channel switching instruction is generated so that content input by the external device can be presented on the display, wherein the channel switching instruction is used to instruct switching to a target HDMI channel mapped by the keyword; and the mapping relationship is dynamically established between a device name of any read external device, a preset service type corresponding to the device name, and an HDMI channel identifier corresponding to an HDMI transmission channel of the external device.
[0040] In a fourth aspect, a channel switching apparatus is provided, which comprises units for executing the channel switching method of the second aspect. The apparatus can be a terminal device or a chip in the terminal device.
[0041] In a fifth aspect, a computer readable storage medium is provided, which stores a computer program, and when the computer program is run by the channel switching apparatus, the channel switching apparatus executes the channel switching method of the second aspect.
[0042] In a sixth aspect, a computer program product is provided, which comprises a computer program, and when the computer program is run by the channel switching apparatus, the channel switching apparatus executes the channel switching method of the second aspect.
[0043] It can be understood that the beneficial effects of the second aspect to the sixth aspect can be referred to the related description in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS
[0044] Figure 1 A schematic diagram of an operation scenario between a display device and a control apparatus according to some embodiments of the present application is shown;
[0045] Figure 2 A configuration block diagram of the control apparatus 100 according to an exemplary embodiment is exemplarily shown;
[0046] Figure 3 A configuration block diagram of the display device 200 according to an exemplary embodiment is exemplarily shown;
[0047] Figure 4 A system block diagram in the display device 200 according to an exemplary embodiment is exemplarily shown;
[0048] Figure 5 A schematic diagram of a smart television connected with an external device is exemplarily shown;
[0049] Figure 6Fig. 1 shows a schematic diagram of a channel list menu display in a smart TV according to an embodiment of the present application;
[0050] Figure 7 Fig. 2 shows a flow chart of a channel switching method in a display device according to an embodiment of the present application;
[0051] Figure 8 Fig. 3 shows a flow chart of another channel switching method in a display device according to an embodiment of the present application;
[0052] Figure 9 Fig. 4 shows a flow chart of another channel switching method in a smart TV according to an embodiment of the present application;
[0053] Figure 10 Fig. 5 shows a flow chart of another channel switching method in a smart TV according to an embodiment of the present application;
[0054] Figure 11 Fig. 6 shows a flow chart of another channel switching method in a smart TV according to an embodiment of the present application;
[0055] Figure 12 Fig. 7 shows a schematic diagram of a signal source list display in a smart TV according to an embodiment of the present application;
[0056] Figure 13 Fig. 8 shows a flow chart of another channel switching method in a smart TV according to an embodiment of the present application;
[0057] Figure 14 Fig. 9 shows a flow chart of another channel switching method in a smart TV according to an embodiment of the present application;
[0058] Figure 15 Fig. 10 shows an interaction diagram of a channel switching method in a smart TV according to an embodiment of the present application;
[0059] Figure 16 Fig. 11 shows an interaction diagram of another channel switching method in a smart TV according to an embodiment of the present application;
[0060] Figure 17 Fig. 12 shows an interaction diagram of another channel switching method in a smart TV according to an embodiment of the present application;
[0061] Figure 18 Fig. 13 shows a schematic diagram of a channel switching apparatus according to an embodiment of the present application. DETAILED DESCRIPTION
[0062] The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; in this document, "and / or" only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.
[0063] Hereinafter, the terms "first", "second", "third" are only for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second", "third" can explicitly or implicitly include one or more features.
[0064] For the purpose of illustration and not for limitation, specific details such as specific system structures, technologies, etc. are presented in order to thoroughly understand the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits and methods are omitted to avoid unnecessary details that hinder the description of the present application.
[0065] The display device provided by the embodiments of the present application can have various implementation forms, for example, it can be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, etc. Figure 1 And Figure 2 As a specific embodiment of the display device of the present application.
[0066] Figure 1 As shown in the schematic diagram of the operation scenario between the display device and the control device according to the embodiments. As Figure 1 shown, the user can operate the display device 200 through the smart device 300 or the control device 100.
[0067] In some embodiments, the control device 100 can be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-distance communication modes, to control the display device 200 through wireless or wired mode. The user can input user instructions through the keys on the remote controller, voice input, control panel input, etc. to control the display device 200.
[0068] In some embodiments, the smart device 300 (such as a mobile terminal, a tablet, a computer, a notebook, etc.) can also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the smart device.
[0069] In some embodiments, the display device 200 can also be controlled in ways other than the control apparatus 100 and the smart device 300, for example, the display device 200 can directly receive voice instructions from a user through a voice instruction receiving module configured inside the display device 200, or the display device 200 can receive voice instructions from a user through a voice control device configured outside the display device 200.
[0070] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 can be communicatively connected through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactions to the display device 200. The server 400 can be a cluster or multiple clusters, and can include one or more types of servers.
[0071] Figure 2 An exemplary configuration block diagram of the control apparatus 100 according to exemplary embodiments is shown. As shown, the control apparatus 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, a power supply. The control apparatus 100 can receive user input operation instructions and convert the operation instructions into instructions that the display device 200 can recognize and respond to, acting as an intermediary between the user and the display device 200. Figure 2
[0072] The user input / output interface 140 includes keys, microphones, etc., wherein the keys are used for traditional operation input, such as switching channels, switching signal source channels, adjusting volume, etc.; the microphone is used to enable the control apparatus 100 to receive user voice; the microphone can be controlled through the keys or directly receive user voice instructions through the microphone, providing a convenient interaction mode for the user.
[0073] As shown in Figure 3 , the display device 200 includes at least one of a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0074] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an n-th interface for input / output.
[0075] The display 260 includes a display screen component for presenting a picture, and a driving component for driving the image display, a component for receiving an image signal originating from the output of the controller, and a component for displaying video content, image content, and a menu control interface, and a user control UI interface.
[0076] The display 260 can be a liquid crystal display, an OLED display, and a projection display, and can also be a projection device and a projection screen.
[0077] The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator can include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 400 through the communicator 220.
[0078] The user interface can be used to receive control signals of the control apparatus 100 (such as an infrared remote control, etc.).
[0079] The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 can include a sound collector such as a microphone, etc., for receiving external sounds.
[0080] Among them, the microphone is used to receive the sound signal issued by the user, and convert the sound signal into an electric signal, thereby providing raw data for subsequent voice processing; in the scenario where the user does not use the control apparatus 100, the user can perform voice control through the microphone in the display device 200, such as switching channels, adjusting the volume, searching for programs, etc.
[0081] The external device interface 240 includes at least one High Definition Multimedia Interface (HDMI), and can also include but is not limited to any one or more of the following: an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), an RGB port, a DisplayPort (DP), a USB interface (such as USB Type-C). It can also be a composite input / output interface formed by the above multiple interfaces.
[0082] Among them, the HDMI is a digital video / audio interface that can simultaneously transmit audio and video signals without the need for additional audio connection lines, simplifying the installation difficulty of the line and ensuring high-quality audio / video signal transmission. With the development of HDMI technology, the width of HDMI is constantly improving, with a high transmission bandwidth that can support high-definition, ultra-high-definition, and even higher resolution video transmission, meeting the growing demand for high-definition video.
[0083] It should be understood that various external devices such as game consoles, Blu-ray players, TV boxes, etc. can be connected to the display device 200 through HDMI, so that users can obtain more rich and immersive audio-visual entertainment experience.
[0084] It should also be understood that in order to facilitate the distinction and management of HDMI interfaces, the display device and the system of the display device can label the HDMI interfaces, form interface names of the HDMI interfaces, and different HDMI interfaces can be represented by numbers, letters or special symbols, such as HDMI1, HDMI2, or HDMIA, HDMIB, etc. These labels are displayed to users to help users distinguish different HDMI interfaces.
[0085] In the system of the display device, each HDMI interface corresponding to the HDMI transmission channel has its independent corresponding HDMI channel identifier, which can be identified by a number code, and there is a corresponding relationship between the HDMI channel identifier and the label of the HDMI interface. For example, the HDMI channel identifier corresponding to HDMI1 is 1281, and the HDMI channel identifier corresponding to HDMI2 is 1282.
[0086] The tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals and EPG data signals from a plurality of wireless or wired broadcast television signals.
[0087] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, i.e. the tuner demodulator 210 can also be in an external device of the main body device where the controller 250 is located, such as an external TV box, etc.
[0088] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object displayed on the display 260, the controller 250 can perform an operation related to the object selected by the user command.
[0089] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a random access memory (RAM), a read-only memory (ROM), a first interface to an n-th interface for input / output, a communication bus, etc.
[0090] The user can input a user command through a graphic user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphic user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor.
[0091] A "user interface" is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes conversion between an internal form of information and a form acceptable by the user. A commonly used form of the user interface is a graphic user interface (GUI), which refers to a user interface related to computer operation displayed in a graphic manner. The graphic user interface can be an interface element such as an icon, a window, a control, and the like displayed in a display screen of a display device, and the control can include a visible interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a widget, and the like.
[0092] As Figure 4 In some embodiments, the system is divided into four layers from top to bottom, namely, an applications layer (referred to as "application layer" for short), an application framework layer (referred to as "framework layer" for short), an Android runtime and system library layer (referred to as "system runtime library layer" for short), and a kernel layer.
[0093] In some embodiments, at least one application program is running in the application layer, which can be a window (Window) program, a system setting program, or a clock program provided by the operating system, or an application program developed by a third-party developer. In a specific implementation, the application program package in the application layer is not limited to the above examples.
[0094] The framework layer provides an application programming interface (API) and a programming framework for the application program. The application framework layer includes some pre-defined functions. The application framework layer is equivalent to a processing center, which decides to make the application program in the application layer act. The application program can access resources in the system and obtain services of the system in execution through the API interface.
[0095] As Figure 4As shown, the application program framework layer in the embodiments of the present application includes managers (Managers) and content providers (Content Provider) and the like, wherein the managers include at least one of the following modules: an activity manager (ActivityManager) for interacting with all activities running in the system; an interaction manager (InteractionManager) for processing voice input and voice output; a location manager (Location Manager) for providing system location services to system services or applications; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; and a window manager (Window Manager) for managing icons, windows, toolbars, wallpapers and desktop components on the user interface.
[0096] In some embodiments, the kernel layer is a layer between hardware and software. As Figure 4 As shown, the kernel layer includes at least one of the following drivers: an audio driver, a display driver, a WIFI driver, a USB driver, an HDMI driver, and a power supply driver and the like.
[0097] Display devices continue to develop and progress in image processing, display presentation, and audio effects. In this case, users are increasingly keen to connect other external devices to display devices to obtain more rich and immersive audio-visual entertainment experiences. For example, a smart TV, in the daily use process, users usually connect various external devices such as game devices, Blu-ray players, TV boxes, etc. to the smart TV through the HDMI interface; whenever the user expects to use a specific external device, the user needs to use the remote control or the operation button on the smart TV to perform corresponding control operations on the smart TV, including displaying a list interface corresponding to all external device interfaces matched by the smart TV through the operation button, selecting a signal source corresponding to the specific external device through the operation button, and determining to switch to the signal source through the operation button to realize channel switching.
[0098] The smart TV and the external device are both provided with an HDMI interface, and the user usually connects the external device to the smart TV using an HDMI connection line; for example, the game device as a sending end and the smart TV as a receiving end, the audio and video signals are transmitted through the HDMI connection line, so that the user can obtain the audio-visual entertainment experience of large-screen display with fast, high-quality, smooth picture and shocking sound effect.
[0099] For example, the smart TV connects the external device through its HDMI interface and the HDMI connection line, Figure 5 For example, a schematic diagram of the connection of the smart TV and the external device is shown as follows: Figure 5 As shown, the smart TV has three HDMI ports on the back: HDMI1, HDMI2 and HDMI3. The smart TV is connected to the first TV box 510 via HDMI1, to the first gaming device 520 via HDMI2, and to the second gaming device 530 via HDMI3.
[0100] Currently, the display interface of a smart TV system allows users to switch to playing games using a primary gaming device connected via HDMI2. This is done via the remote control or operation buttons on the smart TV. First, the operation buttons display a list of all external device interfaces compatible with the smart TV, such as... Figure 6 As shown in (a), the first option is selected by default in the channel list menu; then, select the HDMI2 channel using the operation buttons on the remote control or smart TV, and confirm the switch to the HDMI2 channel by pressing the OK button. Figure 6 As shown in (b), the signal source is switched from the system to the HDMI2 channel corresponding to the first gaming device to achieve channel switching.
[0101] It should be understood that if the first gaming device is powered on, the smart TV displays the interface output by the first gaming device; if the first gaming device is in sleep or powered off state, the smart TV displays an interface with no signal input, such as a black screen.
[0102] It should also be understood that, such as Figure 6 As shown in (a), the channel list menu only displays the names of each channel, such as HDMI1, HDMI2, and USB, without displaying the corresponding device information, such as the device name. During channel switching, users may not know which channel their gaming device is connected to, or that the smart TV may connect to multiple gaming devices through multiple channels. This increases the user's interaction with the smart TV and reduces the user experience.
[0103] In view of this, embodiments of this application provide a display device and a channel switching method. The display device includes a display, a controller, and at least one HDMI interface. The controller is configured to execute the following channel switching method: in response to a user-inputted voice command, receiving keywords obtained from the voice command that characterize the service type of the external device; when there is a mapping relationship between the keyword and the HDMI channel identifier indicating the channel to be switched, a channel switching command can be quickly generated so that the content input by the external device is displayed on the display. This process of automatically switching signal source channels in response to user voice commands can achieve efficient resource management and task allocation, improve the processing efficiency of channel switching services, and thus improve the user experience.
[0104] For further understanding of the technical solutions of the display device, the channel switching method and how the technical solutions solve the above technical problems, the following will make a detailed description in combination with some specific embodiments and the accompanying drawings. The embodiments can be combined with each other, and the same or similar concepts or processes can not be described in some embodiments. Obviously, the described embodiments are part of the embodiments of the present application, not all.
[0105] The display device includes a display, a controller and at least one HDMI interface, the display is in communication connection with the controller, and the HDMI interface is used for connection between the display device and an external device.
[0106] Figure 7 The flow chart of a channel switching method in the display device in some embodiments of the present application is shown in FIG. 6. Figure 7 As shown in FIG. 6, the display device takes a smart TV as an example, wherein the controller is configured to perform the following steps:
[0107] S610, receiving a voice instruction input by a user.
[0108] It should be understood that the voice instruction brings great convenience to the interaction between the user and the smart TV, without manual operation, only needs to speak a specific voice instruction, and the device can quickly respond.
[0109] For example, the voice instruction input by the user can be received through the microphone in the remote controller or the microphone in the smart TV, such as far-field voice and voice monitoring.
[0110] The far-field voice allows the user to issue a voice instruction within a certain range (such as 3-5 meters, or even farther) from the smart TV, and the smart TV can effectively receive the voice instruction. At this time, the sound collector in the smart TV includes a plurality of microphones, which form a microphone array. The microphone array can enhance the sound signal from the direction where the user is located through beamforming technology, while suppressing the noise in the surrounding environment, thereby improving the accuracy of voice recognition.
[0111] The voice monitoring involves continuous monitoring of the environment voice by the smart TV, which is used to detect a wake-up word or a specific voice signal. When the wake-up word or the specific voice signal is detected, the voice assistant is triggered to start, and then the voice assistant processes the voice instruction of the user. It should be understood that the monitoring and acquisition of the voice instruction above are compliant, and the use or implementation does not involve any situation that hinders the public interest.
[0112] S620, in response to the received voice instruction, sending the voice instruction to a server.
[0113] It should be understood that the received voice instruction is sent to the server, and the server has powerful computing resources and large-scale voice recognition models trained by a large amount of voice data, which can accurately recognize various voice features.
[0114] It should be understood that the voice recognition model in the server is continuously updated and optimized by massive training data, which can provide high recognition accuracy and support recognition of multiple languages and dialects to meet the needs of different users. Therefore, voice recognition of the voice instruction by the server has the characteristics of high precision and rich resources.
[0115] In some embodiments, a plurality of slots can be preset in the server. The slot is a pre-defined information storage unit in the voice interaction of channel switching, used to collect and manage key information segments required to complete the channel switching task. In the process of interacting with the user, the user is guided to fill in the slot, so as to fully understand the user's intention.
[0116] For example, the slots include a first slot, a second slot, a third slot, and a fourth slot. The first slot is a slot for storing the name of an external device, the second slot is a slot for storing the service type of the external device, the third slot is a slot for storing the user's semantics, and the fourth slot is a slot for storing the signal source interface.
[0117] It should be understood that in order to accurately understand the meaning of the user's voice instruction, after some slots are filled with information, the user's intention can be understood, and it is not necessary to wait until all slots are filled with response information. Because the user provides some key information in the conversation process, such as keywords representing the name of an external device or keywords representing the service type of an external device, which can form a preliminary understanding of the user's demand direction, which helps to improve the conversation efficiency and makes the entire system respond more timely to meet the user's needs.
[0118] It should be understood that in the process of understanding the user's intention, the server can set a preset semantic material library corresponding to the application scenario of the embodiment of the present application. The system developer will predefine a series of intention categories related to the use of a certain type of external device, such as a game playing device. In the preset semantic material library, each intention category has corresponding keywords associated with it.
[0119] It should also be understood that when the server analyzes the voice instruction and extracts key information matching the intention category in the preset semantic material library, if it is determined that the key information meets the needs of the channel switching device, the key words obtained by the analysis will be sent to the display device, so that the display device can perform channel switching operation according to the key words.
[0120] It should be understood that the parsing process of the voice instruction can be performed on the server, and if the display device hardware support allows, the recognition of the voice instruction can also be completed on the controller and the memory in the smart television, and small voice recognition models can be set in the smart television, which can run under the limited computing resources of the smart television, and analyze and recognize the voice instruction in response to the received voice instruction.
[0121] S630, receiving the keyword sent by the server to the smart television.
[0122] The keyword is parsed from the voice instruction to represent the key element of the business type of the external device, and it should be understood that when the server sends the keyword to the smart television, it also indicates that the intention of the voice instruction from which the keyword is parsed is used for channel switching, thereby helping the smart television to understand the user's intention and providing a basis for subsequent operations.
[0123] Specifically, the server first identifies the textual representation corresponding to the voice instruction, then comprehends the text as a whole, and extracts key elements representing user intentions from it, which include keywords representing the name of the external device, and / or keywords representing the business type of the external device, and / or keywords representing the business type of the external device as a game type, etc., covering the content of the semantics corresponding to the voice instruction.
[0124] For example, for the voice instruction "I want to play PS5", the key elements include "play" and "PS5", and the corresponding keyword is "PS5" representing the name of the external device, which accurately reflects the user's semantic meaning of playing games using PS5; for the voice instruction "I want to play Switch connected by HDMI2", the key elements include "play", "HDMI2" and "Switch", and the corresponding keywords are "Switch" representing the name of the external device and "HDMI2" representing the connection interface of the external device, which accurately reflect the user's semantic meaning of playing games through Switch connected by HDMI2; for the voice instruction "I want to play game console", the key elements include "play" and "game console", and the corresponding keyword is "game console" representing the business type of the external device as a game type, which accurately reflects the user's semantic meaning of playing games through the game console; for the voice instruction "I want to use the TV box", the key element includes "TV box", and the corresponding keyword is "TV box" representing the business type of the external device as a multimedia playback type, which accurately reflects the user's semantic meaning of watching videos through the TV box.
[0125] That is, the voice instruction entered by the user is used for the switching of the signal source channel, and the keyword parsed from the voice instruction can represent the business type of the external device or represent the name of the external device, and in some embodiments, the keyword representing the business type of the external device as a game type can also be used.
[0126] In the case of resolving the keyword representing the service type of the external device, the following steps are performed:
[0127] S640, in the case of receiving the keyword representing the service type of the external device parsed by the voice instruction, determining the target HDMI channel corresponding to the keyword based on the matching relationship of the keyword and the mapping relationship.
[0128] The parsed keyword can directly represent the service type of the external device, or indirectly represent the service type of the external device.
[0129] It should be understood that the smart TV includes at least one HDMI interface, which is used for connection between the smart TV and the external device. The external device can be a game device, a Blu-ray player, a TV box, etc. Different external devices have different types. For example, the game device belongs to the game type of external device, and the Blu-ray player and the TV box belong to the multimedia playback type of external device.
[0130] The keyword directly representing the service type of the external device can be an explicit service type of the external device, such as "game console". The keyword is an explicit service type of the external device, i.e. game type. For example, "Blu-ray player", which is an explicit service type of the external device, i.e. multimedia playback type.
[0131] It should be understood that the keyword can also indirectly represent the service type of the external device, for example, "playing games", which embodies the feature of the game type of the external device service type. For example, "watching movies", which embodies the feature of the multimedia playback type of the external device service type.
[0132] It should be understood that the keyword can also be an explicit service type of the external device and information representing the service type of the external device, for example, the voice instruction is "want to use the host game console to play games". The keyword includes "host game console" representing the service type of the external device and "play games" representing the service type of the external device.
[0133] In this embodiment, the mapping relationship is a dynamically established relationship between the read device name of the external device, the preset service type corresponding to the device name, and the HDMI channel identifier. Therefore, the mapping relationship can include the HDMI channel identifier, the device name and the service type corresponding to the external device in communication connection with the smart TV. The mapping relationship can also only include the HDMI channel identifier and the service type corresponding to the external device in communication connection with the smart TV.
[0134] The external device is in communication connection with the smart television, which means that the external device is connected with the smart television through an HDMI connection line, and information interaction can exist between the external device and the smart television. That is, at this time, the smart television is in a powered-on state, and the external device is in a powered-on or standby state, so that the external device and the smart television can communicate with each other. If the external device is in a powered-off state at this time, the external device cannot communicate with the smart television.
[0135] It should be understood that the device name required to build the mapping relationship is obtained through a Consumer Electronics Control (CEC) protocol. The CEC protocol is a device-to-device control protocol implemented through an HDMI connection line, which is established on the basis of the HDMI standard and allows devices connected through an HDMI connection line to communicate and control each other. That is, the smart television can obtain the device name of the external device connected thereto through the HDMI interface through the CEC protocol.
[0136] Further, the service type corresponding to the external device can be determined according to the device name. The service type corresponding to the device name can be determined through a preset service type stored in the smart television. The preset service type can be stored in the smart television in the form of a code, a database, a mapping table, etc. The preset service type includes different device names and service types corresponding to different device names.
[0137] After determining the service type corresponding to the device name, a set of mapping relationships is dynamically determined based on the HDMI channel identifier, the device name, and the service type. It should be understood that the set of mapping relationships can be displayed in the form of a list, a matrix, a graph, etc.
[0138] It should be understood that the set of mapping relationships includes at least one set of mapping data. That is, the smart television is in communication connection with at least one external device through an HDMI interface. Each set of mapping data corresponds to an HDMI interface connected with an external device, and each set of mapping data includes an HDMI channel identifier, a device name, and a service type. Different HDMI interfaces correspond to different external devices.
[0139] Taking an information list as an example, the information list includes multiple sets of mapping data. That is, the smart television is in communication connection with multiple external devices through an HDMI interface. Each set of mapping data corresponds to an HDMI interface connected with an external device, and each set of mapping data includes an HDMI channel identifier, a device name, and a service type. For example, the smart television is in communication connection with the first television box 510, the first game device 520, and the second game device 530 through the HDMI interface. Figure 5 In the application scenario shown in FIG. 5, if the first television box 510 is an XX television box, the first game device 520 is a Switch, and the second game device 530 is a PS5 (i.e., a shortened name of PlayStation 5), the corresponding information list is as shown in Table 1.
[0140] Table 1 is Figure 5 An information list in a smart television
[0141] HDMI channel identification Device name Service type 1281 XX TV box Multimedia play type 1282 Switch Game type 1283 PS5 Game type
[0142] In the embodiments of the present application, the parsed keyword is used to represent the service type of the external device, therefore, the mapping relationship can only include the HDMI channel identifier and the service type, and the device name can not be reflected in the mapping relationship.
[0143] Taking the information list as an example, the information list includes multiple groups of mapping data, each group of mapping data corresponds to an HDMI interface connected with an external device, and each group of mapping data includes an HDMI channel identifier and a service type. For Figure 5 As shown in the application scenario, if the first television box 510 is an XX television box, the first game device 520 is a Switch, and the second game device 530 is a PS5 (i.e., the abbreviation of PlayStation 5), the corresponding information list is as shown in Table 2:
[0144] Table 2 is Figure 5 An information list in a smart television
[0145] HDMI channel identification Service type 1281 Multimedia play type 1282 Game type 1283 Game type
[0146] For the keyword representing the service type of the external device, whether the mapping relationship is the content presented in Table 1 or the content presented in Table 2, the keyword and the mapping relationship can be matched and judged, so as to determine the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship.
[0147] In some embodiments, in order to improve the association relationship between the mapping relationship and the hardware interface, the HDMI interface name is also included in the mapping relationship, and the corresponding relationship between the HDMI interface name and the HDMI channel identifier is also reflected in the mapping relationship.
[0148] Continuing to take the information list as an example, in this scenario, each group of mapping data in the information list includes an interface name, an HDMI channel identifier, a device name, and a service type, at this time, Figure 5 The information list in the smart television is as shown in Table 3:
[0149] Table 3 is Figure 5 An information list in a smart television
[0150] HDMI interface name HDMI channel identification Device name Service type HDMI1 1281 XX TV box Multimedia play type HDMI2 1282 Switch Game type HDMI3 1283 PS5 Game type
[0151] For example, if the keyword represents the external device service type as a game type, the target HDMI channel corresponding to the game type is determined from the set of mapping relationships of the HDMI channel identification of the game type; if the keyword represents the external device service type as a multimedia playing type, the target HDMI channel corresponding to the multimedia playing type is determined from the set of mapping relationships of the HDMI channel identification of the multimedia playing type.
[0152] It should be understood that the smart TV has one or more HDMI interfaces, each interface corresponding to a signal source channel, Figure 5 As shown in the smart TV, in combination with Table 1, the channel corresponding to the HDMI1 interface is identified as the signal source channel of the XX TV box, the channel corresponding to the HDMI2 interface is identified as the signal source channel of the Switch, and the channel corresponding to the HDMI3 interface is identified as the signal source channel of the PS5.
[0153] S660, switching the signal source to the target HDMI channel, and presenting the content input by the external device corresponding to the target HDMI channel on the display.
[0154] The target HDMI channel is the signal source channel corresponding to the external device in communication connection with the smart TV, and the signal source channel is the channel matched with the user voice instruction, so that the channel of the smart TV can be switched to the target HDMI channel, so that the smart TV receives the multimedia playing content of the external device corresponding to the target HDMI channel, and presents it on the display in the smart TV.
[0155] Through the above process, for the keyword representing the external device service type parsed from the voice instruction, the target HDMI channel can be quickly locked through the keyword and the generated set of mapping relationships. This automatic response to the user's voice instruction for signal source channel switching process can realize efficient resource management and task allocation, and improve the processing efficiency of channel switching service.
[0156] The scene of communication connection between the display device and the game device is increasingly diverse. In this application scenario, the game device is the main external device, which is in communication connection with the display device through the HDMI interface. In order to improve the user experience of channel switching in this scenario, these external devices can be divided into game devices and non-game devices to improve the processing speed in the process of voice switching channel.
[0157] Figure 8 A flowchart of another channel switching method in a display device in some embodiments of the application is shown. The keyword used to represent the external device service type is parsed from the voice instruction, such as Figure 8 As shown, the display device takes the smart TV as an example, wherein the controller is configured to perform the following steps:
[0158] S601, in response to a voice instruction input by a user, receiving a keyword parsed from the voice instruction; wherein the keyword is used to represent an external device service type.
[0159] S602, determining whether the keyword and the HDMI channel identifier have a mapping relationship for indicating switching of a channel.
[0160] It should be understood that the mapping relationship is a dynamic relationship established between the HDMI channel identifier and the device name of the read external device and the preset service type corresponding to the device name. That is, the mapping relationship can be as shown in Table 1, Table 2 and Table 3, that is, at least containing the HDMI channel identifier and the service type, and the service type belongs to the preset service type.
[0161] Further, through the matching relationship between the keyword and the service type in the mapping relationship, it can be determined whether there is a mapping relationship for indicating switching of a channel; if the keyword matches the service type in the mapping relationship, it is determined that there is a mapping relationship, and if the keyword does not match the service type in the mapping relationship, it is determined that there is no mapping relationship.
[0162] It should also be understood that upon detecting access of any external device, reading the HDMI channel identifier corresponding to the access of any external device, and obtaining the device name of any external device through the CEC protocol, the service type corresponding to the external device is determined according to the matching relationship between the device name and the preset service type, and then a set of mapping relationships between the HDMI channel identifier and the service type of the external device is established; or a set of mapping relationships between the HDMI channel identifier, the device name and the service type of the external device is established; wherein the any is a limit on the number, which can be one or more.
[0163] The preset service type can be stored in the smart TV in the form of code, database, mapping table, etc., and the preset service type contains different game device names.
[0164] The embodiments of the present application can efficiently match the keyword parsed from the voice instruction and the external device by increasing the set of mapping relationships, and provide strong support and convenient way for accurate correspondence between the two. Further, the user can switch the current channel of the display device through voice. This way provides a more natural interaction mode for the user. Compared with the traditional key operation, the voice instruction has obvious advantages in channel switching. It can improve the user's satisfaction, so that the user can operate the display device more conveniently and efficiently, without having to search for the control device and press the keys, but only needs to simply issue a voice instruction to easily complete the channel switching, greatly improving the user's experience.
[0165] S603, if there is a mapping relationship between the keyword and the HDMI channel identifier, a channel switching instruction is generated to make the display present the content input by the external device.
[0166] The channel switching instruction is used to instruct switching to the target HDMI channel mapped by the keyword.
[0167] If there is a mapping relationship between the keyword and the HDMI channel identifier, it indicates that there is a game device corresponding to the keyword in the external device in communication connection with the display device, and therefore, the channel switching instruction can be generated based on the HDMI channel identifier corresponding to the game device.
[0168] That is, in the case of receiving the keyword for representing the business type of the external device parsed by the voice instruction, the keyword is matched with the business type in the mapping relationship; if matched, it is determined that the keyword and the HDMI channel identifier have a mapping relationship for instructing switching channels; based on the mapping relationship, the target HDMI channel corresponding to the keyword is determined, and the channel switching instruction is generated.
[0169] The embodiments of the present application match the keyword with the business type in the mapping relationship; in the case of the existence of the business type matching the keyword in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the business type; this process of matching the keyword with the business type in the mapping relationship can accurately determine the matching external device in the mapping relationship, and further determine the corresponding signal source channel, thereby improving the processing efficiency of channel determination.
[0170] In some embodiments, the keyword representing the name of the external device is parsed from the voice instruction, in which case, Figure 9 A flowchart of another channel switching method in the smart TV in some embodiments of the present application is shown in FIG. 6, which shows the process of the channel switching method in the smart TV in some embodiments of the present application. Figure 9 As shown in FIG. 6, the display device is taken as an example of a smart TV, wherein the controller is configured to perform the following steps:
[0171] S610, receiving the voice instruction input by the user.
[0172] S620, in response to the received voice instruction, sending the voice instruction to the server.
[0173] S630, receiving the keyword sent by the server to the smart TV.
[0174] S650, in the case of parsing the keyword representing the name of the external device, determining the target HDMI channel corresponding to the keyword based on the matching relationship between the keyword and the mapping relationship.
[0175] The keyword is used to represent the name of the external device, which can be the abbreviation of the external device or the full name of the external device.
[0176] It should be understood that the full name contains the technical definition and classification information of the device, which can provide more accurate and detailed information. In the application scenarios such as technical specification description, academic research, official documents, etc., using the full name can avoid ambiguity and ensure the integrity and accuracy of the information. However, in the process of daily communication and operation, the full name is often long, and using the abbreviation can more efficiently refer to the device and quickly convey information. In addition, many devices are launched with abbreviations to make it easier for users to remember short and distinctive names.
[0177] The external device takes the game device as an example. The game device can be a host-type game device, which is an independent hardware device running game software, such as Sony's PlayStation series (such as PlayStation 5, abbreviated as PS5; PlayStation 4, abbreviated as PS4, etc.), Microsoft's Xbox series (such as Xbox Series X, abbreviated as Xbox X; Xbox Series S, abbreviated as Xbox S), etc. These game devices output game pictures and sounds through display devices such as smart TVs; the game device can also be a handheld game device, which has a display screen and can be used independently as a handheld game console, or can be connected to a smart TV for game experience, such as Nintendo's Switch.
[0178] That is, when the keyword is the abbreviation of the external device or the full name of the external device, it provides an accurate basis for subsequent voice switching of the signal source channel.
[0179] In the scenario of user voice interaction with the smart TV, the user's voice instruction is often biased towards spoken language. In spoken communication, when the user is familiar with the brand and series of the external device, the user will use shorter words than the abbreviation to express. For example, the user may use "PS" to refer to any product in the PlayStation series, and "Xbox" to refer to any product in the Xbox series. Therefore, the keyword can also be information representing the external device, such as the above "PS" and "Xbox".
[0180] It should be understood that if the keyword represents the name of the external device, the set of mapping relationships in the smart TV at this time can include the device name of the external device in communication connection with the smart TV. Among them, the external device is in communication connection with the smart TV, which means that the external device is connected with the smart TV through the HDMI connection line, and there can be information interaction between the external device and the smart TV; that is, at this time, the smart TV is in a powered-on state, and the external device is in a powered-on or standby state, so that the external device and the smart TV can communicate with each other. If the external device is in a powered-off state at this time, the external device cannot communicate with the smart TV.
[0181] It should be understood that the device name in the mapping relationship is obtained through the CEC protocol, which is a device-to-device control protocol implemented through an HDMI connection line, and is established on the basis of the HDMI standard, allowing mutual communication and control between devices connected through an HDMI connection line. That is, the smart TV can obtain the device name of the external device connected through the HDMI interface through the CEC protocol, and it should be understood that the device name here can be a short name of the external device or a full name of the external device.
[0182] In this embodiment, the mapping relationship is a relationship dynamically established between the device name of the external device read and the HDMI channel identifier, and therefore the mapping relationship can include the HDMI channel identifier and the device name corresponding to the external device connected to the smart TV.
[0183] Based on the HDMI channel identifier and the device name of the external device connected to the display device, the set of mapping relationships is dynamically determined. Taking the set of mapping relationships as an information list for example, the information list includes at least one set of mapping data, that is, the smart TV is connected to at least one external device through HDMI communication, each set of mapping data corresponds to an HDMI interface connected to the external device, and each set of mapping data includes an HDMI channel identifier and a device name; different HDMI interfaces correspond to different external devices. For Figure 5 For the application scenario shown, if the first TV box 510 is an XX TV box, the first game device 520 is a Switch, and the second game device 530 is a PlayStation 5, the corresponding information list is as shown in Table 4:
[0184] Table 4 is Figure 5 An information list in a smart TV
[0185] HDMI channel identification Device name 1281 XX TV box 1282 Switch 1283 PlayStation 5
[0186] In some embodiments, in order to improve the association relationship between the mapping relationship and the hardware interface, the mapping relationship further includes an HDMI interface name, and the corresponding relationship between the HDMI interface name and the HDMI channel identifier is embodied in the mapping relationship. At this time, each set of mapping data in the information list includes an interface name, an HDMI channel identifier, and a device name, and at this time, Figure 5 The information list in the smart TV is as shown in Table 5:
[0187] Table 5 is Figure 5 An information list in a smart TV
[0188] HDMI interface name HDMI channel identification Device name HDMI1 1281 XX TV box HDMI2 1282 Switch HDMI3 1283 PlayStation 5
[0189] It should also be understood that in the case of the keyword representing the name of the external device, the mapping relationship can also include the device name and the service type of the external device in communication connection with the smart TV, wherein the service type is determined by the device name, that is, in this embodiment, the set of mapping relationships can also be as shown in Table 1, Table 2 or Table 3.
[0190] That is, the device name in the mapping relationship can be "PS5" in Table 1, Table 2 or Table 3, which is a short name of the device name; or "PlayStation 5" in Table 4 or Table 5, which is a full name of the device name.
[0191] Therefore, based on the keyword and the mapping relationship, the target HDMI channel corresponding to the keyword is determined; specifically, the keyword is matched with the device name in the mapping relationship; in the case that there is a device name in the mapping relationship that matches the keyword, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the device name; wherein the keyword can be the name of the external device, which can be a short name or a full name; or can be information representing the external device.
[0192] It should be understood that if the keyword is a short name of the external device or a full name of the external device, the short name of the external device or the full name of the external device can be matched with the mapping relationship, and specifically, the short name of the external device or the full name of the external device can be matched with the device name in the mapping relationship by using a preset first matching algorithm.
[0193] The preset first matching algorithm can include various ways, such as key-value mapping, string processing technology, and natural language processing technology, etc.
[0194] In the smart TV, the corresponding relationship between the short name and the full name of the external device can be stored in the database or the mapping table. For example, the short name of the external device is stored as the key and the full name of the external device is stored as the value, when matching is needed, only the corresponding full name in the mapping table needs to be found according to the given short name, or vice versa, so that the short name or the full name of the external device can be matched with the device name in the mapping relationship by using a preset matching algorithm.
[0195] It should also be understood that if the keyword represents the name of the external device, the keyword can be matched with the device name in the mapping relationship by using a preset second matching algorithm during the matching process.
[0196] The preset second matching algorithm is a fuzzy matching algorithm, such as string fuzzy matching. The string fuzzy matching does not require two strings to be completely consistent, but can have differences to a certain extent. The differences can include insertion, deletion, and replacement of characters. For example, the keyword "PS" representing the name of the external device and the device name "PlayStation 5" in the mapping relationship can be considered to be related in the case of fuzzy matching, that is, "PS" and "PlayStation 5" match, that is, there is a device name matching the keyword in the mapping relationship.
[0197] For example, the keyword is "Switch", and the corresponding target HDMI channel is determined from the HDMI interface of the device name "Switch" in the mapping relationship. The keyword is "XX TV box", and the corresponding target HDMI channel is determined from the HDMI interface of the device name "XX TV box" in the mapping relationship.
[0198] It should be understood that the smart TV has one or more HDMI interfaces, and each interface can correspond to a signal source channel, Figure 5 The smart TV shown in combination with Table 3 will identify the channel corresponding to the HDMI1 interface as the signal source channel of the XX TV box, identify the channel corresponding to the HDMI2 interface as the signal source channel of the Switch, and identify the channel corresponding to the HDMI3 interface as the signal source channel of the PlayStation 5.
[0199] In some embodiments, the keyword representing the name of the external device and the keyword representing the type of service of the external device are parsed. It should be understood that the keyword at this time has high uniqueness and can refer to a specific object, and therefore the subsequent signal source channel switching process can be directly performed through the keyword.
[0200] S660, switching the signal source to the target HDMI channel, and presenting the content input by the external device corresponding to the target HDMI channel on the display.
[0201] The target HDMI channel is a signal source channel corresponding to an external device in communication connection with the smart TV, and the signal source channel is a channel matching the user voice instruction, and therefore the channel of the smart TV can be switched to the target HDMI channel, so that the smart TV receives the multimedia playing content of the external device corresponding to the target HDMI channel and presents it on the display in the smart TV.
[0202] Through the above process, the keyword representing the name of the external device is parsed from the voice instruction, and the target HDMI channel can be quickly locked through the keyword and the generated mapping relationship. The process of automatically responding to the voice instruction of the user to switch the signal source channel can realize efficient resource management and task allocation, and improve the processing efficiency of the channel switching service.
[0203] In some embodiments, Figure 7 、 Figure 9 The channel switching method in the smart TV shown in the figure can be combined to form Figure 10 the flowchart shown in the figure, Figure 10 shows a flowchart of another channel switching method in a smart TV in some embodiments of the application, as shown in Figure 10 When the keyword representing the external device service type, or the keyword representing the external device name, or the keyword representing the external device service type and the keyword representing the external device name, etc. are parsed, the corresponding channel switching can be realized through the embodiments shown in Figure 10 .
[0204] It should be understood that in the embodiments of the present application, the mapping relationship includes the HDMI communication identifier, the device name and the service type of the external device in communication connection with the smart TV; and the detailed description can refer to the detailed description of S610 to S660 above, which will not be repeated here.
[0205] In order to improve the channel switching after voice parsing, the judgment on the connection state of the external device can also be added in the channel switching method provided in the embodiments of the present application. In this kind of scenario, the channel switching method comprises the following steps:
[0206] First, in the state that the external device is in communication connection with the display device through the first HDMI interface, the voice instruction input by the user is received, and the voice instruction is parsed to obtain the identification information representing the external device.
[0207] It should be understood that the first HDMI interface is any HDMI interface in the display device.
[0208] The state that the external device is in communication connection with the display device through the first HDMI interface means that the state of the external device at this time can be standby state or power-on state, because only when the external device is in standby state or power-on state, the display device can be in communication connection state.
[0209] After parsing the voice instruction, the identification information representing the external device is obtained. The identification information can be an identification representing the name of the external device, an identification representing the service type of the external device, an identification representing the name of the external device and the service type of the external device; or an identification representing the name of the external device and / or the service type of the external device, and a signal source identification.
[0210] Secondly, based on the mapping relationship between the identification information and the first HDMI channel identification, the signal source is switched to the external device corresponding to the identification information.
[0211] It should be understood that the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device.
[0212] The mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device communicates and connects with the display device through the first HDMI interface. It should be understood that the mapping relationship may include the HDMI channel identifier and the device name of the external device, or the HDMI channel identifier and the service type of the external device; or the HDMI channel identifier, the device name of the external device, and the service type of the external device.
[0213] For a detailed description, please refer to the detailed descriptions of S610 to S660 above, which will not be repeated here.
[0214] In some embodiments, during the keyword and mapping matching process, there may be one or more matching external devices in order to accurately match the target HDMI channel corresponding to the voice command. Figure 11 A flowchart of another channel switching method in a smart TV, as shown in some embodiments of this application, is illustrated. Figure 11 As shown, Figure 7 In the S640, upon receiving keywords representing the service type of an external device obtained from voice command parsing, the controller determines the target HDMI channel corresponding to the keywords based on the matching relationship between the keywords and the mapping relationship. The controller can also be configured to perform the following steps:
[0215] S641. After parsing out the keywords that represent the service type of the external device, match the keywords with the service type in the mapping relationship.
[0216] In other words, by accurately matching keywords with business types in the mapping relationship, it is possible to accurately associate keywords with HDMI interfaces in the mapping relationship, thereby providing a basis for determining the target HDMI channel in the future.
[0217] S642. If an external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.
[0218] It should be understood that the keyword at this time represents the service type of the external device; therefore, when an external device that matches the keyword is matched in the mapping relationship, the HDMI interface corresponding to the external device is determined as the corresponding target HDMI channel.
[0219] S643、in the case of matching to M external devices in the mapping relationship, presenting a first signal source list corresponding to the M external devices on the display.
[0220] wherein M is an integer greater than 1, that is, the number of matched external devices is multiple, which can be two, three, etc.
[0221] It should be understood that if M external devices are matched in the mapping relationship, the smart TV cannot determine which signal source channel the keyword parsed in the voice instruction corresponds to, at this time, by presenting the signal source list corresponding to these external devices on the display of the smart TV, that is, the first signal source list, for interaction with the user, so as to facilitate the user to select the signal source channel from the first signal source list.
[0222] Exemplarily, for the mapping relationship shown in Table 1, if the keyword represents the external device business type as a game type, there are two external devices in Table 1 that satisfy the matching, namely Switch and PS5, at this time, the first signal source list determined by Switch and PS5 can be presented on the display, as shown in (a) in FIG. 26, in the first signal source list 261, the option corresponding to each signal source interface includes the HDMI interface name and the name of the external device connected by the interface, so as to facilitate the user to select the signal source channel from the first signal source list 261, it should be understood that the name can be the full name of the external device or the abbreviation of the external device. Figure 12
[0223] It should be understood that the signal source list can be displayed in the form of a menu or in the form of a list, and the display form of the first signal source list is not limited in the present application.
[0224] At this time, the smart TV can also prompt the user to select through voice or text, the voice prompt is, for example, "two game devices are detected, you can say: which one or say the game console name to select."
[0225] S644, in response to the first selection instruction of the user, determining the target HDMI channel based on the external device corresponding to the first selection instruction.
[0226] It should be understood that the first selection instruction can be an instruction for signal source selection and determination by the user through the remote control keys, or a voice instruction about selecting the first, external device name and / or signal source channel input by the user through voice, such as "first", "HDMI1", "PS5" or "first Switch".
[0227] It should also be understood that if the first selection instruction corresponds to an external device existing in the first signal source list, and there is only one matched signal source channel in the first signal source list, the signal source channel is the target HDMI channel.
[0228] If the first selection instruction corresponds to an external device existing in the first signal source list, and there are multiple matched signal source channels in the first signal source list, the user is prompted again to select through voice or text prompt information to determine the target HDMI channel from the multiple matched signal source channels.
[0229] For example, the names of the external devices corresponding to the two HDMI interfaces in the first signal source list are both PS5, the first selection instruction is a voice instruction, and is "PS5", that is, there are two matched signal source channels in the first signal source list, the user is prompted again to select through voice or text, such as "Detected two PS5s, you can tell me which one to select." The target HDMI channel is determined from the signal source channels corresponding to the two external devices.
[0230] It should also be understood that when the first selection instruction is a voice instruction, the information in the voice instruction may not be accurate enough, for example, the voice instruction is "PS" or "Xbox", and neither "PS" nor "Xbox" is the accurate name of the external device. At this time, when the fuzzy matching algorithm is used to determine the signal source channel matched with the voice instruction from the first signal source list, there may be one or more matched signal source channels. If there are multiple, the user is also prompted again to select through voice or text prompt information, and the prompt information at this time will guide the user to make an accurate selection, such as "Detected multiple signal source channels, you can tell me which one to select."
[0231] For example, the name of the external device corresponding to one HDMI interface in the first signal source list is Xbox X, and the name of the external device corresponding to one HDMI interface is Xbox S. The first selection instruction is a voice instruction, and is "Xbox". Through the fuzzy matching algorithm, it is known that there are two matched signal source channels in the first signal source list. The user is prompted again to select through voice or text, such as "Detected two signal source channels related to Xbox, you can tell me which one to select." Then, the target HDMI channel is determined from the signal source channels corresponding to the two external devices.
[0232] Through the above process, the keyword representing the external device service type parsed by the voice instruction can quickly lock the target HDMI channel through the keyword and the generated mapping relationship. This process of automatically responding to the user's voice instruction to switch the signal source channel can realize efficient resource management and task allocation, and improve the processing efficiency of the channel switching service.
[0233] It should also be understood that after responding to the user's first selection instruction, there can also be no external device corresponding to the first selection instruction in the first signal source list, at which time the user can be prompted that no external device matching the keyword is found, such as "no game device you want is found", or a local application corresponding to the keyword or a service area corresponding to the keyword is displayed.
[0234] In some embodiments, when multiple external devices are matched in the mapping relationship, in order to improve the accuracy and convenience of user selection, historical use data is introduced to sort the matched external devices, with the most frequently used external device of the user being placed in the front row, so that the user can quickly locate the device he needs to select, reduce the selection time, and at the same time improve the user experience. Therefore, for S640 in the above embodiment, Figure 7 In the case where the keyword representing the external device service type parsed by the voice instruction is received, the controller can be further configured to perform the following steps:
[0235] S645, in the case where M external devices are matched in the mapping relationship, historical use data of the M external devices by the user is obtained.
[0236] It should be understood that the historical use data is determined according to one or more of the connection frequency, use time, and last use time of the user to each external device.
[0237] S646, based on the historical use data, a second signal source list corresponding to the M external devices is determined, and the second signal source list is presented on the display.
[0238] According to the historical use data, the signal sources corresponding to the M matched external devices are sorted to obtain the second signal source list, for example, the external device with the highest use frequency or the longest use time of the user is placed in the front row.
[0239] Exemplarily, for the mapping relationship shown in Table 1, if the keyword represents the external device service type as a game type, there are two external devices in Table 1 that satisfy the matching, namely, Switch and PS5. At this time, a second signal source list determined by the Switch, the PS5, and the historical use data can be presented on the display, where the use time length of the Switch in the historical use data is 36 hours, and the use time length of the PS5 is 170 hours; as shown in (b) in FIG. 6, the second signal source list 262 is sorted according to the user use time length, and each signal source interface corresponds to an option including the HDMI interface name, the name of the external device corresponding to the interface of the communication connection, and the use time length of the external device. The signal source interface is sorted according to the user use time length, facilitating the user to select the signal source channel from the second signal source list 262. It should be understood that the name can be the full name of the external device or the abbreviation of the external device. Figure 12
[0240] S647, in response to the second selection instruction of the user, determining a target HDMI channel based on the external device corresponding to the second selection instruction.
[0241] For the implementation process of S645 to S647, reference can be made to the detailed description of S643 to S644 described above, which will not be repeated here.
[0242] It should be understood that in the case where the keyword represents the external device service type, in the process of matching the keyword with the service type in the mapping relationship, there can also be a case where there is no service type in the mapping relationship that matches the keyword, that is, there is no device in the external devices in communication connection with the smart television that matches the keyword. In order to improve the user experience in this case, the controller is further configured to perform the following steps:
[0243] S648, obtaining a local application program corresponding to the keyword.
[0244] It should be understood that the keyword mainly includes a game type and a multimedia playback type.
[0245] Taking a smart television with an Android operating system as an example, the user will install one or more local application programs successively during the use of the smart television. These local application programs can be video on demand, live broadcast, games, learning and education, music, fitness, browser, etc. Among them, video on demand, live broadcast, and music all belong to local application programs of the multimedia playback type.
[0246] From these applications, obtain the local applications that match the keywords. For example, if the keyword is a multimedia playback type, the corresponding local applications could be video-on-demand, live streaming, and music applications. If the keyword is a game type, the corresponding local applications could be game applications.
[0247] S649A. If the number of local applications is 0, display the business zone corresponding to the keyword.
[0248] Under the Android operating system of smart TVs, there are usually several distinctive service zones that bring users a rich and diverse user experience. These service zones include multimedia playback zones for movies, TV series, variety shows, etc., as well as game zones, education zones, fitness zones, and so on.
[0249] It should be understood that when the number of local applications is 0, it indicates that no application corresponding to the keyword is installed in the operating system. In this case, a business zone corresponding to the keyword can be presented for users to choose from.
[0250] Additionally, voice prompts such as "No game applications are currently installed on this device" can help users better understand why a business zone is displayed. Voice prompts can also guide users on how to interact with the smart TV, such as "You can say to me: I want to play games on PS5," to help users better switch signal source channels via voice.
[0251] S649B: If the number of local applications is 1, start the local application.
[0252] If the data of the local application corresponding to the keyword is 1, it means that among the local applications installed on the smart TV, only one local application corresponds to the keyword. In this case, the user will be redirected directly based on the startup information of that local application, and the local application will be displayed on the screen.
[0253] S649C. If the number of local applications is N, display the application list corresponding to each local application, and, in response to the user's third selection instruction, launch the first application based on the first application corresponding to the third selection instruction.
[0254] Where N is a positive integer greater than 1, the smart TV display shows an application list containing N local applications. It should be understood that the data for each local application in the application list includes the application name, application icon, and application launch information, for example: {"appName":"Dou Dizhu","appIcon":"display icon URL","appLaunchInfo":"application launch information"}.
[0255] In some embodiments, these local applications can be sorted based on factors such as the user's recent usage time, usage duration, and usage frequency, and the sorted local applications can be displayed in an application list. The local applications that the user frequently plays will be listed first, so that the user can quickly locate the local application they need to select, reducing the user's selection time, and providing voice prompts for further interaction, such as "You can tell me the first application to play the game".
[0256] It should be understood that the third selection command can be a command from the user to select or confirm the signal source via remote control buttons, or it can be a voice command from the user to select a specific number or the name of a local application, such as "first" or "first game A".
[0257] In response to the user's third selection instruction, the first application is determined from these local applications. It should be understood that the first application is the application corresponding to the third selection instruction.
[0258] In some embodiments, the following situation may occur: no local application matching the third selection instruction exists in the application list. In this case, this problem can be further addressed through voice interaction with the user. For example, the user can be asked if they need to search for the relevant application from the app store, or if they have any other alternative needs, thereby better meeting the user's intent and ensuring a smooth user experience.
[0259] In some embodiments, during the keyword and mapping matching process, there may be one or more matching external devices in order to accurately match the target HDMI channel corresponding to the voice command. Figure 13 A flowchart of another channel switching method in a smart TV, as shown in some embodiments of this application, is illustrated. Figure 13 As shown, Figure 9 In the S650, when the keyword represents the name of the external device, the controller determines the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship. The controller can also be configured to perform the following steps:
[0260] S651. When the keyword represents the name of an external device, match the keyword with the device name in the mapping relationship.
[0261] Furthermore, if a device name matching the keyword exists in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the device name. There may be one or more matching external devices. Therefore, further processing can be performed as follows.
[0262] S652, in the case of matching to one external device in the mapping relationship, determining the signal source channel corresponding to the external device as the target HDMI channel.
[0263] It should be understood that the keyword at this time represents the external device name, or the keyword includes the keyword and the keyword; therefore, in the case of matching to one external device matching the keyword in the mapping relationship, the HDMI interface corresponding to the external device is determined as the corresponding target HDMI channel.
[0264] S653, in the case of matching to M external devices in the mapping relationship, presenting a first signal source list corresponding to the M external devices on the display.
[0265] Wherein, M is an integer greater than 1.
[0266] S654, in response to the first selection instruction of the user, determining the target HDMI channel based on the external device corresponding to the first selection instruction.
[0267] For the implementation process of S653 to S654, please refer to the detailed description of the above S643 to S644, which will not be repeated here.
[0268] In some embodiments, in the case of matching to multiple external devices in the mapping relationship, in order to improve the accuracy and convenience of user selection, historical use data is introduced to sort the matched external devices, and the external device most frequently used by the user is placed in the front row, so that the user can quickly locate the device he needs to select, reduce the selection time, and improve the user experience. Therefore, for S650 in the above embodiment, Figure 9 In the case of the keyword representing the external device name, based on the keyword and the mapping relationship, the controller can be further configured to perform the following steps:
[0269] S655, in the case of matching to M external devices in the mapping relationship, obtaining the historical use data of the M external devices by the user.
[0270] Wherein, M is an integer greater than 1.
[0271] S656, based on the historical use data, determining a second signal source list corresponding to the M external devices, and presenting the second signal source list on the display.
[0272] It should be understood that in the above embodiments, M is used to represent the number of matched external devices, but it should be noted that the number represented by M is different in each independent example; that is, the symbol is M, but due to the difference between each embodiment, the numerical value of M will also change.
[0273] S657, in response to the second selection instruction of the user, determining the target HDMI channel based on the external device corresponding to the second selection instruction.
[0274] For the implementation process of S655 to S657, refer to the detailed description of S645 to S647 above, which will not be repeated here.
[0275] It should be understood that in the case of keyword representing the name of the external device, in the process of matching the keyword with the device name in the mapping relationship, there may also be no device name in the mapping relationship that matches the keyword, that is, there is no device that matches the keyword among the external devices that are in communication connection with the smart TV. In order to improve the user experience in this case, the controller is also configured to perform the following steps:
[0276] S658, generating a resource request instruction corresponding to the keyword, and sending the resource request instruction to the server.
[0277] For example, the keyword is "PS5", and there is no device name in the mapping relationship that matches "PS5", which means that the smart TV has not established a communication connection with "PS5". At this time, a resource request instruction corresponding to the keyword "PS5" can be generated according to the keyword "PS5", which can be used to request purchase resources related to PS5, or to request video resources related to PS5.
[0278] S659, receiving and displaying the target resource.
[0279] Among them, the target resource is the resource that the server finds after extracting the keyword from the resource request instruction after receiving the resource request instruction.
[0280] The target resource includes the purchase resource of the external device corresponding to the keyword, and / or the video resource of the external device corresponding to the keyword; it should be understood that the video resource can be a video related to the purchase of the external device, or a video related to the use of the external device, etc.
[0281] In some embodiments, the content parsed from the voice instruction can also include a signal source identifier, for example: HDMI1, HDMI2.
[0282] In the case where the keyword includes the signal source identifier and the business type of the external device, if the signal source identifier and the keyword do not completely match the channel identifier and the business type in a set of mapping data in the mapping relationship, a first alternative channel list is displayed. Among them, the first alternative channel list includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and / or at least one set of mapping data corresponding to the keyword.
[0283] and, in the case that the keyword includes the signal source identifier and the external device name, if the signal source identifier and the keyword do not completely match the HDMI channel identifier and the device name in a set of mapping data in the mapping relationship, a second alternative channel list is displayed; wherein the second alternative channel list includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and / or at least one set of mapping data corresponding to the keyword.
[0284] It should be understood that the alternative channel list includes the first alternative channel list and the second alternative channel list.
[0285] It should be understood that the first alternative channel list includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and at least one set of mapping data corresponding to the keyword, and since the signal source identifier and the keyword do not completely match the HDMI channel identifier and the device name in a set of mapping data in the mapping relationship, the data matching the signal source identifier and the data matching the keyword are summarized to form the first alternative channel list, and the signal source channel that can match the keyword is presented to the user, facilitating communication with the user and understanding their specific needs.
[0286] Among them, the data matching the signal source identifier can only have one set, and the data matching the service type can have multiple sets. For example, the data matching the "game type" in Table 6 includes three sets.
[0287] It should also be understood that the voice interaction between the user and the smart TV is a multi-round interaction, and through the multi-round interaction, the user's true intention can be understood, and then based on the user's intention, one identifier matching the user's intention can be determined from the signal source identifier and the keyword, and then based on the data matching the identifier, the first alternative channel list can be generated.
[0288] The second alternative channel list includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and at least one set of mapping data corresponding to the keyword.
[0289] It should also be understood that the signal source identifier and the keyword parsed do not completely match a set of mapping data in the mapping relationship, specifically, part of the information in the parsed content matches a set of mapping data in the mapping relationship, but another part of the information cannot correspond to the set of mapping data; that is, the parsed content and the set of mapping data in the mapping relationship are associated, and not all content completely fits.
[0290] For example, the information list in the smart TV is as follows:
[0291] Table 6 is an information list in the smart TV
[0292] HDMI interface name HDMI channel identification Device name Service type HDMI1 1281 PS5 Game type HDMI2 1282 Xbox X Game type HDMI3 1283 TV box Multimedia play type HDMI4 1284 PS5 Game type
[0293] When the voice instruction is "I want to play the Xbox of HDMI1", the voice instruction corresponds to the keyword bag "HDMI1" and "Xbox", which is matched with Table 6, and is not completely matched with the first group of mapping data "HDMI1-1281-PS5-game type" or the second group of mapping data "HDMI2-1282-Xbox X-game type". At this time, the corresponding alternative channel list includes the first group of mapping data and the second group of mapping data, as shown in the following table:
[0294] Table 7 is an alternative channel list in a smart TV
[0295] HDMI interface name HDMI channel identification Device name Service type HDMI1 1281 PS5 Game type HDMI2 1282 Xbox X Game type
[0296] In addition, as shown in (c) in the display presents the alternative channel list, as shown in (c) in the display presents the alternative channel list. Figure 12
[0297] Further, in response to the fourth selection instruction of the user, the target HDMI channel is determined based on the external device corresponding to the fourth selection instruction. For the implementation process, reference can be made to the detailed description of S644 above, which will not be repeated here.
[0298] When the parsed signal source identifier, the keyword and a group of mapping data in the mapping relationship are completely matched, the corresponding target HDMI channel can be determined. For example, when the voice instruction is "I want to play the PS5 of HDMI4", "HDMI4" and "PS5" in the voice instruction are matched with Table 6, and completely matched with the fourth group of mapping data. At this time, the target HDMI channel is determined to be the signal source channel corresponding to the HDMI4 interface.
[0299] In some embodiments, in order to improve the user's experience after switching to the target HDMI channel, the display mode of the display device is also adjusted to a preset mode, which is determined by the business type of the external device corresponding to the target HDMI channel.
[0300] Among them, the display mode includes an image mode and a sound mode. For example, if the business type of the external device corresponding to the target HDMI channel is a game type, the image mode and the sound mode are both adjusted to a game mode, and the smart TV is adjusted to the best game experience setting.
[0301] It should be clear that the external device linkage switch setting of the smart TV has important significance, which can enable the smart TV to perform a wake-up operation on the external device. In actual use scenarios, when the smart TV establishes a communication connection with the external device, these external devices are usually in a standby state.
[0302] In a common home entertainment system, the smart TV can be connected with a variety of external devices such as game consoles, Blu-ray players, etc. In daily use, these external devices are mostly in standby mode in order to save energy and quickly respond to start-up instructions. In the implementation process of the channel switching method in the embodiments of the present application, the external device linkage switch can be adjusted so that the smart TV quickly wakes up the corresponding external device through the CEC protocol.
[0303] For example, when the user wants to switch from watching TV programs to playing games, the smart TV determines the target HDMI channel of the corresponding external device through voice instructions. At this time, with the help of the external device linkage switch setting, the smart TV can send a wake-up signal to the game device in standby state, and the game device quickly starts after receiving the signal.
[0304] That is, after the above step 640 or step 650, and before the signal source is switched to the target HDMI channel in step 660, the controller is further configured to adjust the state of the external device linkage switch to Figure 7 For example, Figure 14 A flowchart of another channel switching method in the smart TV in some embodiments of the present application is shown in FIG. 7, which shows that the controller is further configured to: Figure 14
[0305] S710, acquire the state of the power-on external device linkage switch in the display device.
[0306] The power-on external device linkage switch is in the setting function of the smart TV and can be controlled by the user, and is usually turned off by default.
[0307] After acquiring the power-on external device linkage switch, it is determined whether the power-on external device linkage switch is in an open state.
[0308] If the power-on external device linkage switch is in a closed state, execute: S720, adjust the state of the power-on external device linkage switch to an open state.
[0309] It should be understood that if the state of the power-on external device linkage switch is adjusted from closed to open, the user needs to be prompted by voice or question that the power-on external device linkage switch has been automatically turned on.
[0310] If the power-on external device linkage switch is in an open state, or the power-on external device linkage switch is adjusted to an open state, the external device corresponding to the target HDMI channel can be in a sleep state, and the external device connected to the target HDMI channel can be awakened through the CEC protocol, saving the user's time.
[0311] It should be understood that the process of waking up the external device can be performed after determining the target HDMI channel for switching, at which time the process of channel switching is also in progress. If the switching has been completed but the external device has not been woken up, the display will briefly display a black screen. If the switching has been completed and the external device has been woken up, the welcome interface of the external device is displayed, and after the welcome interface ends, the main interface of the external device is displayed, and so on. For example, if the external device is a game device, the welcome interface of the game device is displayed, and after the welcome interface ends, the game interface is displayed, and the game menu is automatically popped up to facilitate the user to set different game parameters and improve the game experience.
[0312] With the continuous development of technology, the scenarios of communication connection between display devices and game devices are increasingly diverse and amazing. In the application scenario of home entertainment, more and more users gather with their families and friends together on weekends or holidays, connect game consoles with large-screen smart TVs, and experience the rich, shocking and immersive audio-visual entertainment experience brought by large-screen games.
[0313] In this application scenario, the game device is the main external device and is in communication connection with the display device through the HDMI interface. In order to improve the user experience of channel switching in this scenario, the external devices can be divided into game devices and non-game devices, that is, the business types of external devices can be divided into game types and non-game types.
[0314] Further, in the case where the keyword represents the business type of the external device as a game type, the corresponding target HDMI channel is determined based on the keyword and the mapping relationship.
[0315] In this application scenario, in order to improve the processing efficiency of voice data, the business types of external devices are divided into game types and non-game types, for example, the game type can be identified by "Game" and the non-game type can be identified by "No Game" in the internal smart TV.
[0316] In some embodiments, the display device includes a voice module, a signal source management module, a middleware module and a display module, and the software layered architecture of the display device is as shown in Figure 4 The voice module, the signal source management module and the display module belong to the modules of the application layer, and the middleware module belongs to the module of the system runtime library layer.
[0317] The voice module is configured to receive a voice instruction input by a user, and send the voice instruction to a server and receive a keyword obtained by the server analyzing the voice instruction; and analyze a matching relationship between the keyword and a mapping relationship. The signal source management module is configured to store and display each signal source in a list form which is in communication connection with the display device, and switch a target HDMI channel and start the display module when signal source channel switching is needed. The middleware module is a module which is further encapsulated for a bottom hardware driving protocol in the display device, and provides a result of an HDMI protocol to an application layer module after encapsulation. The display module displays content input from an external device after receiving a start signal.
[0318] The embodiments are described in detail below with reference to the drawings. Figure 15 Figure 15 An interaction diagram of a channel switching method in an intelligent television in some embodiments of the present application is shown in FIG. 1, which includes the following steps. Figure 15
[0319] S801, the voice module receives a voice instruction.
[0320] S802, the voice module sends the voice instruction to a server, and receives a keyword sent by the server to the display device.
[0321] It should be understood that the keyword can represent a name of an external device, or a service type of the external device, or a game type.
[0322] S803, the voice module obtains a mapping relationship from the middleware module.
[0323] It should be understood that the mapping relationship is determined by the middleware module dynamically after the display device is powered on.
[0324] The middleware module has a preset interface of an HDMI protocol encapsulation, which is configured to identify a device name of an external device in communication connection, and determine a service type corresponding to the device name based on a preset service type. In the preset interface, the service type can be determined according to the device name.
[0325] The preset interface stores and identifies the HDMI channel identification, the device name and the service type in a text form, and is easy to be parsed and generated by the display device.
[0326] Exemplarily, the preset interface can store the information of the external device in the form of a JSON (JavaScript Object Notation) string, such as: {"HDMIId":"1282","DeviceName":"Xbox X","DeviceType":"Game"}, that is, the channel identifier of the HDMI is 1282, the connected external device is Xbox X, and the type of the external device is a game device.
[0327] The middleware module acquires the information (that is, the HDMI channel identifier, the device name, and the service type) of different HDMI interfaces through the preset interface, and dynamically constructs a mapping relationship from the information. It should be understood that the information of the corresponding HDMI interface can be acquired only when the display device and the external device are in communication connection.
[0328] Further, the voice module can analyze the matching relationship between the keyword and the mapping relationship.
[0329] S804, in the case where the keyword represents the service type of the external device, the voice module determines the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship.
[0330] Further, in the case where the keyword represents the service type of the external device as a game type, the voice module determines the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship.
[0331] Alternatively, S805, in the case where the keyword represents the name of the external device, the voice module determines the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship.
[0332] S806, the voice module instructs the signal source management module to switch the signal source.
[0333] S807, after receiving the channel switching instruction, the signal source management module sends an instruction to switch the signal source to the target HDMI channel to the middleware module.
[0334] The middleware module acquires the state of the startup peripheral linkage switch, and adjusts the state of the startup peripheral linkage switch to the open state if the state of the startup peripheral linkage switch is the closed state; or maintains the open state if the state of the startup peripheral linkage switch is the open state.
[0335] In the case where the startup peripheral linkage switch is in the open state, the signal source is switched from the current channel or the operating system to the target HDMI channel.
[0336] In some embodiments, if the state of the startup peripheral linkage switch is the closed state, the signal source management module sets a preset flag bit to True, and the initial value of the preset flag bit is False. It should be understood that the preset flag bit delivers information about the opening of the startup peripheral linkage switch, so that the display module pops up or plays prompt information or prompt voice about the opening of the startup peripheral linkage switch when detecting that the preset flag bit is True.
[0337] S808, the middleware module informs the display module to present the content input by the external device corresponding to the target HDMI channel.
[0338] It should be understood that the middleware module starts the display module and carries the preset flag bit.
[0339] In some embodiments, the middleware module detects the state of the external device corresponding to the target HDMI channel, and if the external device is in the standby state, the middleware module wakes up the external device corresponding to the target HDMI channel through the CEC protocol.
[0340] In some embodiments, in order to improve the user experience after the user switches to the target HDMI channel, the display mode of the display device is also adjusted to a preset mode, which is determined by the business type of the external device corresponding to the target HDMI channel.
[0341] In some embodiments, the display mode includes an image mode and a sound mode. For example, if the business type of the external device corresponding to the target HDMI channel is a game type, both the image mode and the sound mode are adjusted to a game mode.
[0342] In some embodiments, the middleware module can also control the display module to present a menu about display settings, so that the user can adjust the display parameters according to the needs.
[0343] S809, the display module presents the content input by the external device corresponding to the target HDMI channel on the display.
[0344] It should be understood that the display module pops up or plays prompt information or prompt voice about the opening of the startup peripheral linkage switch when detecting that the preset flag bit is True.
[0345] It should also be understood that the display of the Android operating system includes two layers of interfaces (upper and lower layers), the first layer of display interface (i.e. the upper layer) displays the OSD (On-Screen Display) layer, that is, the interface displayed by the application program, the operating system, etc.; the second layer of display interface (i.e. the lower layer) is the Video layer, that is, the interface displayed by the external device, so when presenting the content input by the external device corresponding to the target HDMI channel, the OSD layer needs to be set to a transparent interface, and the content input by the external device of the Video layer is displayed.
[0346] In some embodiments, in the process of matching the keyword with the mapping relationship, there can be one matched external device or multiple matched external devices, in order to accurately match the target HDMI channel corresponding to the voice instruction; Figure 16 An interaction diagram of another channel switching method in a smart TV in some embodiments of the present application is shown in FIG. 8. Figure 16 As shown in FIG. 8, the signal source management module further includes a signal source submodule and a transition submodule, and the method includes:
[0347] S801, the voice module receives a voice instruction.
[0348] S802, the voice module sends the voice instruction to the server and receives a keyword sent by the server to the display device.
[0349] S803, the voice module obtains a mapping relationship from the middleware module.
[0350] Further, the voice module can analyze the matching of the keyword and the mapping relationship, including matching the keyword with the device name in the mapping relationship in the case that the keyword represents the external device name; or matching the keyword with the service type in the mapping relationship in the case that the keyword represents the external device service type.
[0351] S841, the voice module matches one external device in the mapping relationship, and determines the signal source channel corresponding to the external device as the target HDMI channel.
[0352] S842, the voice module instructs the transition submodule to switch the signal source.
[0353] And S851, the voice module matches M external devices in the mapping relationship, and determines a signal source list corresponding to the M external devices.
[0354] It should be understood that M is an integer greater than 1. And the signal source list can be a first signal source list or a second signal source list, wherein the first signal source list is a list determined according to the order of the HDMI interfaces corresponding to the M external devices, and the second signal source list is a list determined according to the historical use data of the M external devices.
[0355] S852, the voice module sends the signal source list to the display module.
[0356] S853, the display module presents the signal source list corresponding to the M external devices.
[0357] S854, the signal source submodule determines the target HDMI channel based on a first selection instruction. It should be understood that the first selection instruction is a corresponding instruction determined by the user through voice or manually based on the signal source list.
[0358] S855, the signal source sub-module instructs the transition sub-module to switch the signal source.
[0359] S871, the transition sub-module sends the instruction of switching the signal source to the target HDMI channel to the middleware module after receiving the channel switching instruction.
[0360] S808, the middleware module informs the display module to present the content input by the external device corresponding to the target HDMI channel.
[0361] S809, the display module presents the content input by the external device corresponding to the target HDMI channel on the display.
[0362] It should be understood that there is also a case where there is no matching information between the keyword and the mapping relationship, that is, there is no device matching the keyword in the external device in communication connection with the display device, and therefore, for the content shown in Figure 15 or Figure 16 Figure 17 shows an interaction diagram of another channel switching method in the smart TV in some embodiments of the present application, as shown in Figure 17 The method comprises:
[0363] If the external device corresponding to the keyword is not matched in the mapping relationship, the following process is performed:
[0364] S811, the voice module generates a resource request instruction corresponding to the keyword in the mapping relationship.
[0365] S812, the resource request instruction is sent to the server.
[0366] S813, the target resource sent by the server to the display device is received and displayed.
[0367] If the external device corresponding to the keyword is not matched in the mapping relationship, the following process is performed:
[0368] S821, the voice module does not match the external device in the mapping relationship.
[0369] S822, the local application program corresponding to the keyword is obtained from the operating system.
[0370] S822, if the number of local application programs is 0, the business area resource corresponding to the keyword is obtained from the server of the operating system and displayed.
[0371] S823, if the number of local application programs is 1, the operating system is controlled to start the local application program.
[0372] S824. If the number of local applications is N, display the application list corresponding to each local application, and, in response to the user's third selection instruction, launch the first application based on the first application corresponding to the third selection instruction.
[0373] It should be understood that the sequence numbers of the processes in the above embodiments do not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention. The various embodiments described herein can be independent solutions or combinations based on internal logic, and all such solutions fall within the protection scope of this application.
[0374] It should also be understood that the execution order of the steps in the flowcharts of the above embodiments is not strictly limited, and these steps can be executed in other orders. Moreover, at least some steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.
[0375] This application embodiment can divide the display device into functional modules based on the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware or as software functional modules. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, other feasible division methods may exist. The following description uses the division of functional modules according to each function as an example.
[0376] The above text combined Figure 5 to Figure 17 The channel switching method of the embodiments of this application is described in detail below. Figure 18 This document describes in detail the device embodiments of this application. It should be understood that the channel switching device in the embodiments of this application can execute the various channel switching methods described in the foregoing embodiments of this application. That is, the specific working processes of the various products described below can be referred to the corresponding processes in the foregoing method embodiments.
[0377] Figure 18 This is a schematic diagram of the channel switching device provided in an embodiment of this application. It should be understood that the channel switching device can perform... Figure 5 to Figure 17 The channel switching method shown; the channel switching device 900 includes a voice unit 910, a signal source management unit 920, and a display unit 930, wherein:
[0378] The voice unit 910 is configured to receive a keyword obtained by the server after analyzing a voice instruction input by a user in response to the voice instruction.
[0379] The voice unit 910 is configured to determine a target HDMI channel corresponding to the keyword based on the keyword and a mapping relationship in a case where the keyword represents a service type of the external device, the mapping relationship including an HDMI channel identifier and a service type of the external device.
[0380] The signal source management unit 920 is configured to switch a signal source channel to the target HDMI channel.
[0381] The display unit 930 is configured to present content input by the external device corresponding to the target HDMI channel on a display.
[0382] The units of the channel switching apparatus can respectively perform the corresponding steps in the above method embodiments, and thus the units will not be described in detail, and the details can be referred to the descriptions of the corresponding steps above.
[0383] It should be noted that the channel switching apparatus is in the form of functional units. The term "unit" herein can be implemented in the form of software and / or hardware, and is not limited specifically.
[0384] For example, the "unit" can be a software program, a hardware circuit, or a combination of both, which implements the above functions. The hardware circuit can include an application specific integrated circuit (ASIC), an electronic circuit, a processor (such as a shared processor, a dedicated processor, or a group processor) and a memory for executing one or more software or firmware programs, and other suitable components for supporting the described functions.
[0385] Therefore, the units of each example described in the embodiments of the present application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0386] As shown in Figure 1 , Figure 2 , the display device 200 can be used to implement the channel switching method described in the above method embodiments.
[0387] One or more memories can be included in the display device 200, and programs can be stored on the memories, which can be run by the controller 250 to generate instructions, so that the controller 250 executes the channel switching method described in the above method embodiments according to the instructions.
[0388] Optionally, data can also be stored in the memory. Optionally, the controller 250 can also read the data stored in the memory, which can be stored in the same storage address as the program or in a different storage address.
[0389] The controller 250 and the memory can be separately arranged or integrated together, for example, integrated on a system on chip (SOC) of the terminal device.
[0390] The application also provides a computer program product, which, when executed by the controller 250, implements the channel switching method of any of the method embodiments.
[0391] The computer program product can be stored in the memory, for example, a program, which is finally converted into an executable object file capable of being executed by the controller 250 through preprocessing, compiling, assembling, linking and other processing processes.
[0392] The application also provides a computer readable storage medium, which stores a computer program, which, when executed by a computer, implements the channel switching method of any of the method embodiments. The computer program can be a high-level language program or an executable target program.
[0393] The computer readable storage medium is, for example, a memory. The memory can be a volatile memory or a non-volatile memory, or the memory can include both volatile and non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM).
[0394] In this application, "at least one" means one or more, and "multiple" means two or more. "At least one of the following" or the like means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean a, b, c, a-b, a-c, b-c, or a-b-c, where a, b, and c can be single or multiple.
[0395] It should be understood that the size of the sequence number of the above-mentioned processes in various embodiments of the present application does not mean the order of execution, and the execution order of the processes should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0396] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0397] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.
[0398] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic; for example, the division of units is only a logical function division, and actual implementation can have another division manner; for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed each other can be indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.
[0399] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A display device, characterized in that, include: monitor; At least one HDMI port; The controller is configured as follows: If any number of external devices are detected, obtain the HDMI channel identifier corresponding to the connection of any number of external devices; The device names of any number of external devices are obtained based on the CEC protocol, and the service type corresponding to the external device is determined based on the matching relationship between the device names and the preset service types. Establish a set of mapping relationships between the device name of any external device, the service type corresponding to the external device, and its corresponding HDMI channel identifier; In response to a user-inputted voice command, the system receives keywords obtained by semantic parsing the voice command and matching them with a preset semantic material library. These keywords are used to characterize the service type of the external device. Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword.
2. The display device according to claim 1, characterized in that, The controller determines whether a mapping relationship exists between the keyword and the HDMI channel identifier for indicating channel switching. If a mapping relationship exists between the keyword and the HDMI channel identifier, a channel switching instruction is generated and configured as follows: Upon receiving a keyword representing the service type of an external device, obtained by parsing the voice command, the keyword is matched with the service type in the mapping relationship; If the keyword matches the service type in the mapping relationship, then it is determined that the keyword has a mapping relationship with the HDMI channel identifier for indicating channel switching; Based on the mapping relationship, the target HDMI channel corresponding to the keyword is determined, and the channel switching instruction is generated.
3. The display device according to claim 2, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If an external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.
4. The display device according to claim 2, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If M external devices are matched in the mapping relationship, a first signal source list corresponding to the M external devices is displayed on the display, where M > 1; In response to the user's first selection command, the target HDMI channel is determined based on the external device corresponding to the first selection command.
5. The display device according to claim 2, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If M external devices are matched in the mapping relationship, the user's historical usage data for the M external devices is obtained, where M > 1; Based on the historical usage data, a second signal source list corresponding to M external devices is determined, and the second signal source list is displayed on the display. In response to the user's second selection command, the target HDMI channel is determined based on the external device corresponding to the second selection command.
6. The display device according to claim 2, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; If the number of local applications is 0, the business zone corresponding to the keyword will be displayed.
7. The display device according to claim 2, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; If the number of local applications is 1, then the local application is started.
8. The display device according to claim 2, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; If the number of local applications is N, display the application list corresponding to each local application, where N > 1; In response to a user's third selection instruction, the first application is launched based on the first application corresponding to the third selection instruction, wherein the local application includes the first application.
9. The display device according to claim 1, characterized in that, After executing the channel switching command, the controller is further configured to: Obtain the status of the power-on peripheral linkage switch in the display device; Adjust the status of the power-on peripheral linkage switch to the on state.
10. The display device according to claim 1, characterized in that, The controller, in response to a user-inputted voice command, is further configured to: Receive keywords and signal source identifiers used to characterize the service type of external devices, obtained by parsing the voice commands; The signal source identifier, the keyword, and a set of mapping data in the mapping relationship are matched. If the signal source identifier, the keyword, and a set of mapping data in the mapping relationship match completely, the target HDMI channel corresponding to the signal source identifier and the keyword is determined, and the channel switching instruction is generated.
11. The display device according to claim 1, characterized in that, The controller, in response to a user-inputted voice command, is further configured to: Receive keywords and signal source identifiers used to characterize the service type of external devices, obtained by parsing the voice commands; The signal source identifier, the keyword, and a set of mapping data in the mapping relationship are matched. If the signal source identifier, the keyword, and a set of mapping data in the mapping relationship do not match completely, a list of alternative channels is displayed. The list of alternative channels includes a set of mapping data in the mapping relationship that corresponds to the signal source identifier, and / or at least a set of mapping data that corresponds to the keyword. In response to the user's fourth selection command, the target HDMI channel is determined based on the external device corresponding to the fourth selection command.
12. The display device according to claim 1, characterized in that, The external device service types include game type and non-game type; the controller is also configured to: If the keyword represents the external device service type as game type, determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction.
13. The display device according to claim 1, characterized in that, The display device includes a voice module, a signal source management module, a middleware module, and a display module, and the controller is configured to: The voice module receives the voice command, sends the voice command to the server, and receives keywords sent by the server to the display device to characterize the service type of the external device; When the voice module determines that there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching, it generates the channel switching command. Upon receiving the channel switching instruction, the signal source management module switches the signal source to the target HDMI channel. It also notifies the display module to display the content input from the external device corresponding to the target HDMI channel on the display.
14. A display device, characterized in that, include monitor; At least one HDMI port; The controller is configured as follows: If any number of external devices are detected, obtain the HDMI channel identifier corresponding to the connection of any number of external devices; The device names of any number of external devices are obtained based on the CEC protocol, and the service type corresponding to the external device is determined based on the matching relationship between the device names and the preset service types. Establish a set of mapping relationships between the device name of any external device, the service type corresponding to the external device, and its corresponding HDMI channel identifier; When an external device is connected to the display device via a first HDMI interface, a voice command recorded by the user is received, and the voice command is parsed to obtain identification information representing the external device. When the identification information is an identifier representing the service type of an external device, the signal source is switched to the external device corresponding to the identification information according to the mapping relationship between the identification information and the first HDMI channel identifier, wherein the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device.
15. A channel switching method, characterized in that, Applied to the display device according to any one of claims 1 to 13, the method comprises: If any number of external devices are detected, obtain the HDMI channel identifier corresponding to the connection of any number of external devices; The device names of any number of external devices are obtained based on the CEC protocol, and the service type corresponding to the external device is determined based on the matching relationship between the device names and the preset service types. Establish a set of mapping relationships between the service types of any number of external devices and their corresponding HDMI channel identifiers; In response to a user-inputted voice command, the system receives keywords obtained by semantic parsing the voice command and matching them with a preset semantic material library. These keywords are used to characterize the service type of the external device. Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword.
Citation Information
Patent Citations
Display device, television receiver and display method
JP2019193134A