Display device and channel switching method

Abstract

The present application relates to the field of display, and discloses a display device and a channel switching method. The display device comprises a display, a controller, and at least one HDMI interface. The controller is configured to: in response to a voice instruction entered by a user, receive a keyword obtained by parsing the voice instruction and used for representing a service type of an external device; and when there is a mapping relationship, used for indicating channel switching, between the keyword and an HDMI channel identifier, quickly generate a channel switching instruction, so that the display presents content inputted by the external device. Such a process of automatically responding to the voice instruction of the user to implement signal source channel switching can achieve efficient resource management and task allocation, improve processing efficiency of channel switching services, and thus improve user experience.

Description

Display device and channel switching method

[0001] This application claims priority to Chinese Patent Application No. 202411751705.7, filed with the State Intellectual Property Office of China on November 30, 2024, entitled "Display Device and Channel Switching Method", and also claims priority to Chinese Patent Application No. 202411752630.4, filed with the State Intellectual Property Office of China on November 30, 2024, entitled "Display Device and Channel Switching Method", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of display, and more particularly to a display device and a channel switching method. Background Technology

[0003] As display devices continue to advance in image processing, display presentation, and audio effects, users are increasingly keen to connect other external devices to display devices to obtain a richer, more immersive, and more impactful audiovisual entertainment experience.

[0004] Taking smart TVs as an example, users typically connect various external devices such as gaming devices, Blu-ray players, and TV boxes to their smart TVs via the HDMI interface during daily use. Whenever a user wants to use a specific external device, they need to use the remote control or the operation buttons on the smart TV to perform the corresponding control operation to switch channels. For example, when a user wants to switch to a game console A connected via the HDMI2 interface to play games, they can use the operation buttons to access the list interface corresponding to the external device interface on the smart TV, switch the signal source from the current channel to the HDMI2 channel corresponding to game console A, so that the smart TV can receive the video and audio signals output by game console A.

[0005] However, the control operation that needs to be performed every time the external device is switched is somewhat cumbersome for users and affects their experience. Summary of the Invention

[0006] This application provides a display device and a channel switching method that can quickly switch to the signal source channel required by the user based on the user's voice.

[0007] Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword.

[0008] In a first aspect, a display device is provided, including a display, a controller, and at least one HDMI interface; the controller is configured to: in response to a voice command input by a user, receive keywords obtained by parsing the voice command, the keywords being used to characterize the service type of an external device; further, determine whether there is a mapping relationship between the keywords and an HDMI channel identifier for indicating channel switching; if there is a mapping relationship between the keywords and the HDMI channel identifier, generate a channel switching command so that content input by an external device can be displayed on the display.

[0009] It should be understood that the channel switching command is used to indicate switching to the target HDMI channel mapped by the keyword.

[0010] It should also be understood that the mapping relationship is a dynamically established relationship based on reading the device name of any external device, the preset service type corresponding to the device name, and the HDMI channel identifier corresponding to its HDMI transmission channel.

[0011] This application embodiment displays a mapping relationship in the display device. This mapping relationship is dynamically established through the device name of the external device, the preset service type corresponding to the device name, and the HDMI channel identifier. Then, in response to the user's voice command, the device receives keywords that represent the service type of the external device, which are parsed from the voice command. When there is a mapping relationship between the keyword and the HDMI channel identifier that indicates channel switching, a channel switching command is generated so that the content input by the external device is displayed on the screen. This process of automatically switching the signal source channel in response to the user's voice command improves the processing efficiency of the channel switching service, thereby enhancing the user experience.

[0012] In one possible implementation, before executing a voice command in response to user input and receiving keywords derived from the parsed voice command that characterize the service type of the external device, the controller is further configured to: detect the access of the external device and read the HDMI channel identifier corresponding to the access of the external device; obtain the device name of the external device based on the CEC protocol; determine the service type corresponding to the external device based on the matching relationship between the device name and the preset service type; and establish a mapping relationship between the HDMI channel identifier and the service type of the external device.

[0013] This application, by adding a mapping relationship, can efficiently match keywords parsed from voice commands with external devices, providing strong support and a convenient way for accurate correspondence between the two. Furthermore, users can switch the current channel of the display device via voice. This provides users with a more natural interaction method. Compared with traditional button operation, voice command-based channel switching has significant advantages. It can improve user satisfaction, making it more convenient and efficient for users to operate the display device. Users no longer need to painstakingly search for control devices or press buttons; they can easily complete channel switching simply by issuing voice commands, greatly improving the user experience.

[0014] In one possible implementation, the controller determines whether a mapping relationship exists between the keyword and the HDMI channel identifier to indicate channel switching. If a mapping relationship exists, a channel switching instruction is generated. The controller is configured to: upon receiving a keyword representing the service type of an external device obtained from parsing a voice command, match the keyword with the service type in the mapping relationship; if a match is found, determine that a mapping relationship exists between the keyword and the HDMI channel identifier to indicate channel switching; based on the mapping relationship, determine the target HDMI channel corresponding to the keyword and generate a channel switching instruction.

[0015] This application matches keywords with service types in the mapping relationship; when a service type that matches the keyword exists in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the service type; this process of matching keywords with service types in the mapping relationship can accurately determine the matching external device in the mapping relationship, and then determine the corresponding signal source channel, thereby improving the processing efficiency of channel determination.

[0016] In one possible implementation, the controller performs a mapping-based determination of the target HDMI channel corresponding to a keyword, configured to: if an external device is matched in the mapping, determine the signal source channel corresponding to the external device as the target HDMI channel.

[0017] Several scenarios may occur during the keyword-mapping process. One scenario is that only one external device is matched in the mapping. In this case, to accurately match the target HDMI channel corresponding to the voice command, the signal source channel corresponding to this uniquely matched external device can be directly identified as the target HDMI channel. This improves processing efficiency in this situation, avoids complex filtering and judgment processes, and allows the system to quickly respond and switch to the correct signal source channel, providing users with a smoother and more efficient user experience.

[0018] In one possible implementation, the controller performs a mapping-based determination of the target HDMI channel corresponding to a keyword, configured to: if M external devices are matched in the mapping, display a first signal source list corresponding to the M external devices on the display, where M > 1; and in response to a user's first selection command, determine the target HDMI channel based on the external device corresponding to the first selection command.

[0019] Several scenarios may arise during the keyword-mapping process. One such scenario involves matching multiple external devices in the mapping. To accurately match the target HDMI channel corresponding to the voice command, a detailed analysis of each case is necessary. Since multiple options exist, further interaction with the user is crucial. By communicating with the user, their specific needs can be understood, such as asking, "Which device do you want to connect to?" or providing prompts based on specific scenarios. Once the user's explicit interaction is obtained, the desired external device can be identified from the matched devices, thus determining the corresponding target HDMI channel. This approach ensures accurate fulfillment of user needs even in complex situations with multiple matching devices, improving system intelligence and user experience.

[0020] In one possible implementation, the controller performs a mapping-based determination of the target HDMI channel corresponding to a keyword, configured to: if M external devices are matched in the mapping, acquire historical usage data of the user for the M external devices, where M > 1; based on the historical usage data, determine a second signal source list corresponding to the M external devices, and display the second signal source list on the display; and in response to the user's second selection command, determine the target HDMI channel based on the external device corresponding to the second selection command.

[0021] Several scenarios may arise during the keyword-mapping process. One scenario involves matching multiple external devices in the mapping relationship. These devices can then be ranked based on the user's historical usage data. This historical data contains rich information, recording the frequency, duration, and usage scenarios of each external device. For example, if a particular external device has appeared frequently in the user's recent usage, it can be ranked higher, indicating that it is more likely the target of the current voice command. This ranking method based on historical usage data can more accurately infer the user's intent from multiple possible external devices, providing a strong basis for further determining the target HDMI channel and optimizing the user experience of operating devices via voice commands.

[0022] In one possible implementation, after the controller matches the keyword with the device name in the mapping relationship, it is further configured to: if no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; if the number of local applications is 0, display the business zone corresponding to the keyword.

[0023] Several situations may arise during the matching process between keywords and mapping relationships. One such situation is when there is no business type matching the keyword in the mapping relationship, and no local application exists on the display device. In this case, system resources related to the user's needs can be recommended, guiding the user to better utilize the system's resources to achieve their goals.

[0024] In one possible implementation, after the controller matches the keyword with the device name in the mapping relationship, it is further configured to: if no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; if the number of local applications is 1, start the local application.

[0025] If there is no matching business type in the mapping relationship, and there is only one matching local application on the display device, then this unique matching local application can be launched directly. This improves processing efficiency in such cases.

[0026] In one possible implementation, after the controller matches the keyword with the device name in the mapping relationship, it is further configured to: if no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; if the number of local applications is N, display the application list corresponding to each local application, where N > 1; in response to the user's third selection instruction, start the first application based on the first application corresponding to the third selection instruction, wherein the local application includes the first application.

[0027] If there is no business type matching the keyword in the mapping relationship, and only multiple matching local applications are displayed on the device, a detailed analysis is needed on a case-by-case basis. Since multiple possible options exist, further interaction with the user is possible. Through communication with the user, their specific needs can be understood. After obtaining explicit user interaction, the application the user wishes to launch can be determined from these local applications. This approach ensures that the user's needs are accurately met even in complex situations with multiple matching applications.

[0028] In one possible implementation, after executing the generation channel switching instruction, the controller is also configured to: obtain the status of the power-on peripheral linkage switch in the display device; and adjust the status of the power-on peripheral linkage switch to the on state.

[0029] To save energy and respond quickly to startup commands, most external devices that communicate with the display device are in standby mode. By adjusting the peripheral linkage switch, the display device can quickly wake up the corresponding external device via the CEC protocol. To achieve fast channel switching and improve the user experience after switching, the status of the power-on peripheral linkage switch in the display device is monitored to enhance the user experience.

[0030] In one possible implementation, after responding to a user-inputted voice command, the controller is further configured to: receive keywords and signal source identifiers used to characterize the service type of the external device obtained by parsing the voice command; match the signal source identifier, keywords, and a set of mapping data in the mapping relationship; if the signal source identifier, keywords, and a set of mapping data in the mapping relationship match completely, determine the target HDMI channel corresponding to the signal source identifier and keywords, and generate a channel switching command.

[0031] The keywords may contain other information, such as the signal source identifier. In this scenario, there may be a situation where the signal source identifier and the keyword completely match a set of mapping data in the mapping relationship, which can directly determine the target HDMI channel that the user wants to switch to.

[0032] In one possible implementation, after responding to a user-inputted voice command, the controller is further configured to: receive keywords and a signal source identifier, which are used to characterize the service type of the external device, obtained by parsing the voice command; match the signal source identifier, keywords, and a set of mapping data in the mapping relationship; if the signal source identifier, keywords, and a set of mapping data in the mapping relationship do not completely match, display a list of alternative channels; wherein the list of alternative channels includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and / or at least a set of mapping data corresponding to the keywords; and, in response to a user's fourth selection command, determine the target HDMI channel based on the external device corresponding to the fourth selection command.

[0033] Keywords may contain other information, such as signal source identifiers. In this scenario, there might be a situation where the signal source identifier and the mapping data in the keyword-to-mapping relationship do not perfectly match. In this case, more refined matching is needed to improve the intelligent analysis of the display device, presenting the signal source channels that may match the keyword or signal source identifier to the user, facilitating communication with the user and understanding their specific needs. After obtaining explicit user interaction, the target HDMI channel that the user wishes to switch to can be determined from these signal source channels.

[0034] In one possible implementation, the external device service type includes game type and non-game type; the controller is also configured to: when the keyword represents the external device service type as game type, determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching; if there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction.

[0035] The scenarios for communication connections between display devices and gaming devices are becoming increasingly diverse. In this application scenario, the gaming device, as the primary external device, communicates with the display device via an HDMI interface. To improve the user experience when switching channels in this scenario, these external devices can be categorized into gaming devices and non-gaming devices, thereby increasing the processing speed during voice channel switching.

[0036] Furthermore, in this embodiment of the application, when a voice command is received, and the keywords in the voice command indicate that the external device service type is game type, the signal source is switched; it should be understood that the keywords characterizing the external device service type as game type are a broad linguistic expression, and this embodiment of the application can achieve accurate channel switching by combining the mapping relationship determined by the external device with limited communication connection with the display device.

[0037] In one possible implementation, the display device includes a voice module, a signal source management module, a middleware module, and a display module. The controller is configured to: the voice module receive voice commands, send the voice commands to a server, and receive keywords sent by the server to the display device to characterize the service type of the external device; when the voice module determines that there is a mapping relationship between the keywords and the HDMI channel identifier to indicate channel switching, it generates a channel switching command; after receiving the channel switching command, the signal source management module switches the signal source to the target HDMI channel; and notifies the display module to display the content input from the external device corresponding to the target HDMI channel on the display.

[0038] The software architecture of the display device includes a voice module, a signal source management module, a middleware module, and a display module. The middleware module dynamically constructs mapping relationships related to external devices that communicate with the display device, enabling the matching of keywords corresponding to voice commands with the mapping relationships. This allows for the rapid identification of the target HDMI channel corresponding to the keyword. Subsequently, the display device's signal source is switched to the target HDMI channel, and the content input from the external device via the target HDMI channel is displayed on the monitor. This automatic response to user voice commands to switch signal source channels improves the processing efficiency of channel switching services, thereby enhancing the user experience.

[0039] Secondly, a display device is provided, including a display, a controller, and at least one HDMI interface; the controller is configured to: when an external device is communicatively connected to the display device via a first HDMI interface, receive a voice command recorded by a user, and parse the voice command to obtain identification information representing the external device; according to the mapping relationship between the identification information and a first HDMI channel identifier, switch the signal source to the external device corresponding to the identification information, wherein the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device; wherein the mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device is connected to the first HDMI interface.

[0040] Thirdly, a display device is provided, including a display, a controller, and at least one HDMI interface. The controller is configured to: in response to a voice command input by a user, receive a keyword obtained by parsing the voice command to represent the name of an external device; determine whether there is a mapping relationship between the keyword and an HDMI channel identifier for indicating channel switching; if a mapping relationship exists, generate a channel switching command so that content input by an external device can be displayed on the display.

[0041] It should be understood that the channel switching command is used to indicate switching to the target HDMI channel mapped by the keyword;

[0042] It should also be understood that the mapping relationship is a dynamic relationship established between the device name of any external device read through the CEC protocol and the corresponding HDMI channel identifier of its HDMI transmission channel.

[0043] The parsing process for voice commands can be performed on the server, or, if the display device hardware supports it, it can be completed within the display device itself.

[0044] The embodiments of this application display a mapping relationship in the display device. This mapping relationship is dynamically established through the device name of the external device and the HDMI channel identifier. In response to the user's voice command, the device receives keywords that represent the name of the external device, which are obtained by parsing the voice command. When there is a mapping relationship between the keyword and the HDMI channel identifier that indicates channel switching, a channel switching command can be quickly generated so that the content input by the external device is displayed on the screen. This process of automatically switching the signal source channel in response to the user's voice command improves the processing efficiency of the channel switching service, thereby enhancing the user experience.

[0045] Furthermore, in this embodiment of the application, when a voice command is received and the keyword in the voice command indicates the name of an external device, the keyword is used to switch the signal source. It should be understood that the keyword representing the name of the external device is a relatively accurate and specific linguistic expression. This embodiment of the application can also achieve accurate channel switching by combining the limited mapping relationship of external devices of the display device.

[0046] In one possible implementation, before executing a voice command in response to user input and receiving keywords derived from the voice command to represent the names of external devices, the controller is further configured to: detect the access of any number of external devices, read the HDMI channel identifiers corresponding to the access of any number of external devices; obtain the device names of any number of external devices based on the CEC protocol; and establish a set of mapping relationships between any number of device names and their corresponding HDMI channel identifiers.

[0047] This application, by adding mapping relationships, can efficiently match keywords parsed from voice commands with external devices, providing strong support and a convenient way for accurate correspondence between the two. This method offers users a more natural interaction experience. Compared with traditional button operations, voice command-based channel switching has significant advantages. It can improve user satisfaction, making it more convenient and efficient for users to operate display devices. Users no longer need to painstakingly search for control devices or press buttons; they can easily complete channel switching simply by issuing voice commands, greatly improving the user experience.

[0048] In one possible implementation, the controller determines whether a mapping relationship exists between keywords and HDMI channel identifiers to indicate channel switching. If a mapping relationship exists, a channel switching instruction is generated. The controller is configured to: upon receiving a keyword representing an external device name obtained from a voice command parsing, match the keyword with the device name in the mapping relationship; if a match is found, determine that a mapping relationship exists between the keyword and the HDMI channel identifier to indicate channel switching; based on the mapping relationship, determine the target HDMI channel corresponding to the keyword and generate a channel switching instruction.

[0049] This application matches keywords with device names in the mapping relationship; if a device name matching the keyword exists in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the device name; this process of matching keywords with device names in the mapping relationship can accurately determine the matching external device in the mapping relationship, and then determine the corresponding signal source channel, thereby improving the processing efficiency of channel determination.

[0050] In one possible implementation, the controller performs a mapping-based determination of the target HDMI channel corresponding to a keyword, configured to: if an external device is matched in the mapping, determine the signal source channel corresponding to the external device as the target HDMI channel.

[0051] In the process of matching keywords with mapping relationships in this application embodiment, several situations may occur. One situation is that only one external device is matched in the mapping relationship. When this happens, in order to accurately match the target HDMI channel corresponding to the voice command, the signal source channel corresponding to this uniquely matched external device can be directly determined as the target HDMI channel. This can improve the processing efficiency in this case, avoid complex filtering and judgment processes, and enable the system to quickly respond and switch to the correct signal source channel, providing users with a smoother and more efficient user experience.

[0052] In one possible implementation, the controller performs a mapping-based determination of the target HDMI channel corresponding to a keyword, configured to: if M external devices are matched in the mapping, display a first signal source list corresponding to the M external devices on the display, where M > 1; and in response to a user's first selection command, determine the target HDMI channel based on the external device corresponding to the first selection command.

[0053] Several scenarios may arise during the keyword-mapping process. One such scenario involves matching multiple external devices in the mapping. To accurately match the target HDMI channel corresponding to the voice command, a detailed analysis of each case is necessary. Since multiple options exist, further interaction with the user is crucial. By communicating with the user, their specific needs can be understood, such as asking, "Which device do you want to connect to?" or providing prompts based on specific scenarios. Once the user's explicit interaction is obtained, the desired external device can be identified from the matched devices, thus determining the corresponding target HDMI channel. This approach ensures accurate fulfillment of user needs even in complex situations with multiple matching devices, improving system intelligence and user experience.

[0054] In one possible implementation, the controller performs a mapping-based determination of the target HDMI channel corresponding to a keyword, configured to: if M external devices are matched in the mapping, acquire historical usage data of the user for the M external devices, where M > 1; based on the historical usage data, determine a second signal source list corresponding to the M external devices, and display the second signal source list on the display; and in response to the user's second selection command, determine the target HDMI channel based on the external device corresponding to the second selection command.

[0055] Several scenarios may arise during the keyword-mapping process. One scenario involves matching multiple external devices in the mapping relationship. These devices can then be ranked based on the user's historical usage data. This historical data contains rich information, recording the frequency, duration, and usage scenarios of each external device. For example, if a particular external device has appeared frequently in the user's recent usage, it can be ranked higher, indicating that it is more likely the target of the current voice command. This ranking method based on historical usage data can more accurately infer the user's intent from multiple possible external devices, providing a strong basis for further determining the target HDMI channel and optimizing the user experience of operating devices via voice commands.

[0056] In one possible implementation, after the controller matches the keyword with the device name in the mapping relationship, it is further configured to: if no device name corresponding to the keyword is matched in the mapping relationship, generate a resource request instruction corresponding to the keyword and send the resource request instruction to the server; receive the target resource, wherein the target resource is the resource that the server finds to match the keyword after extracting the keyword from the resource request instruction, and the target resource includes the purchase resource of the external device corresponding to the keyword, and / or the video resource of the external device corresponding to the keyword; and display the target resource.

[0057] Several scenarios may occur during the matching process between keywords and mapping relationships. One such scenario is that no device name matches the keyword in the mapping relationship. In this case, media resources related to the keyword can be obtained from the server. These resources are diverse in type, including those related to purchasing the device corresponding to the keyword and those related to the use of the device. These resources can then be used to provide corresponding services to users.

[0058] In one possible implementation, after executing the generation channel switching instruction, the controller is also configured to: obtain the status of the power-on peripheral linkage switch in the display device; and adjust the status of the power-on peripheral linkage switch to the on state.

[0059] To save energy and respond quickly to startup commands, most external devices that communicate with the display device are in standby mode. By adjusting the peripheral linkage switch, the display device can quickly wake up the corresponding external device via the CEC protocol. To achieve fast channel switching and improve the user experience after switching, the status of the power-on peripheral linkage switch in the display device is monitored to enhance the user experience.

[0060] In one possible implementation, after responding to a user-inputted voice command, the controller is further configured to: receive keywords and a signal source identifier used to represent the name of an external device, obtained by parsing the voice command; match the signal source identifier, keywords, and a set of mapping data in the mapping relationship; if a complete match is found, determine the target HDMI channel corresponding to the signal source identifier and keywords, and generate a channel switching command.

[0061] The keywords may contain other information, such as the signal source identifier. In this scenario, there may be a situation where the signal source identifier and the keyword correspond perfectly to a set of mapping data in the mapping relationship, which can directly determine the target HDMI channel that the user wants to switch to.

[0062] In one possible implementation, after responding to a user-inputted voice command, the controller is further configured to: receive keywords and a signal source identifier used to represent the name of an external device, obtained by parsing the voice command; match the signal source identifier, keywords, and a set of mapping data in a mapping relationship; if no complete match is found, display a list of alternative channels; wherein the list of alternative channels includes a set of mapping data corresponding to the signal source identifier and / or at least one set of mapping data corresponding to the keywords; and, in response to a user's fourth selection command, determine the target HDMI channel based on the external device corresponding to the fourth selection command.

[0063] Voice command parsing can also extract other information, such as signal source identifiers. In this scenario, there might be a situation where the signal source identifier and the mapping data in the keyword-to-dataset relationship do not completely correspond. In this case, more refined matching is needed to improve the intelligent analysis of the display device, presenting the signal source channel that matches the keyword or signal source identifier to the user, facilitating communication with the user and understanding their specific needs. After obtaining the user's explicit interaction, the target HDMI channel that the user wishes to switch to can be determined from these signal source channels.

[0064] In one possible implementation, keywords include the abbreviation of the external device, the full name of the external device, or information representing the name of the external device.

[0065] In scenarios where users interact with display devices via voice, the voice commands they issue typically exhibit spoken language characteristics. In spoken communication, users may use abbreviations, full names, or shorter phrases to describe external devices. Therefore, the keywords parsed from voice commands must cover a variety of application scenarios to enhance the understanding of user needs and thus better facilitate channel switching for users.

[0066] In one possible implementation, the external device includes a gaming device, and the display device is connected to the gaming device via an HDMI interface. The controller is also configured to: upon receiving a first keyword representing the name of the gaming device, obtained through parsing a voice command, determine the target HDMI channel corresponding to the first keyword based on the first keyword and a mapping relationship; wherein the keyword includes the first keyword.

[0067] The scenarios for communication connections between display devices and gaming devices are becoming increasingly diverse. In this application scenario, the external device refers to the gaming device, which communicates with the display device via an HDMI interface. To improve the user experience of channel switching in this scenario, when the keywords include a first keyword representing the name of the gaming device, the target HDMI channel corresponding to the first keyword can be determined based on the first keyword and the mapping relationship.

[0068] In one possible implementation, the display device includes a voice module, a signal source management module, a middleware module, and a display module. The controller is configured such that: the voice module receives voice commands, sends the voice commands to a server, and receives keywords sent by the server to the display device to represent the name of an external device; when the voice module determines that there is a mapping relationship between the keywords and the HDMI channel identifier to indicate channel switching, it generates a channel switching command; after receiving the channel switching command, the signal source management module switches the signal source to the target HDMI channel; and notifies the display module to display the content input from the external device corresponding to the target HDMI channel on the display.

[0069] The software architecture of the display device includes a voice module, a signal source management module, a middleware module, and a display module. The middleware module constructs a mapping relationship between external devices, enabling the matching of keywords corresponding to voice commands with the mapping relationship. This allows for the rapid identification of the target HDMI channel corresponding to the keyword. Subsequently, the signal source of the display device is switched to the target HDMI channel, and the content input from the external device corresponding to the target HDMI channel is displayed on the screen. This automatic response to user voice commands to switch signal source channels improves the processing efficiency of channel switching services, thereby enhancing the user experience.

[0070] Fourthly, a display device is provided, including a display, a controller, and at least one HDMI interface. The controller is configured to: receive a voice command recorded by a user when an external device is communicatively connected to the display device via a first HDMI interface; parse the voice command to obtain identification information representing the external device; and switch the signal source to the external device corresponding to the identification information according to the mapping relationship between the identification information and a first HDMI channel identifier, wherein the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device; and wherein the mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device is connected to the first HDMI interface.

[0071] Fifthly, a channel switching method is provided, applied to the display device of the first aspect. The method includes: responding to a voice command input by a user, receiving a keyword obtained by parsing the voice command, the keyword being used to characterize the service type of an external device; determining whether there is a mapping relationship between the keyword and an HDMI channel identifier for indicating channel switching; if there is a mapping relationship between the keyword and the HDMI channel identifier, generating a channel switching command so that content input by the external device can be displayed on the display, wherein the channel switching command is used to indicate switching to the target HDMI channel mapped by the keyword; wherein the mapping relationship is a dynamically established relationship based on the device name of any external device read, the preset service type corresponding to the device name, and the HDMI channel identifier corresponding to its HDMI transmission channel.

[0072] A sixth aspect provides a channel switching method applied to a display device of the third aspect. The method includes: responding to a voice command input by a user, receiving a keyword representing the name of an external device obtained by parsing the voice command; determining whether there is a mapping relationship between the keyword and an HDMI channel identifier for indicating channel switching; if a mapping relationship exists, generating a channel switching command so that content input by the external device can be displayed on the display, wherein the channel switching command is used to indicate switching to the target HDMI channel mapped by the keyword; wherein the mapping relationship is a dynamically established relationship between the device name of any external device read through the CEC protocol and the HDMI channel identifier corresponding to its HDMI transmission channel.

[0073] In a seventh aspect, a channel switching apparatus is provided, including a unit for performing the channel switching method of the fifth or sixth aspect. This apparatus may be a terminal device or a chip within the terminal device.

[0074] Eighthly, a computer-readable storage medium is provided, which stores a computer program that, when executed by a channel switching device, causes the channel switching device to perform the channel switching method of the fifth or sixth aspect.

[0075] Ninth aspect, a computer program product is provided, the computer program product comprising: a computer program, which, when run by a channel switching device, causes the channel switching device to perform the channel switching method of the fifth aspect or the sixth aspect.

[0076] It is understood that the beneficial effects of aspects five through nine above can be found in the relevant descriptions in aspects one or three above, and will not be repeated here. Attached Figure Description

[0077] Figure 1 shows a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of this application;

[0078] Figure 2 illustrates an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment;

[0079] Figure 3 illustrates a configuration block diagram of a display device 200 according to an exemplary embodiment;

[0080] Figure 4 illustrates a system block diagram in a display device 200 according to an exemplary embodiment;

[0081] Figure 5 illustrates a schematic diagram of a smart TV connecting to an external device.

[0082] Figure 6 illustrates a schematic diagram of the channel list menu display in a smart TV;

[0083] Figure 7 shows a flowchart of a channel switching method in a display device in some embodiments of this application;

[0084] Figure 8 shows a flowchart of another channel switching method in a display device in some embodiments of this application;

[0085] Figure 9 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application;

[0086] Figure 10 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application;

[0087] Figure 11 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application;

[0088] Figure 12 illustrates a schematic diagram of a smart TV displaying a list of signal sources;

[0089] Figure 13 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application;

[0090] Figure 14 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application;

[0091] Figure 15 shows an interaction diagram of a channel switching method in a smart TV in some embodiments of this application;

[0092] Figure 16 shows an interaction diagram of another channel switching method in a smart TV in some embodiments of this application;

[0093] Figure 17 shows an interaction diagram of another channel switching method in a smart TV in some embodiments of this application;

[0094] Figure 18 is a schematic diagram of the channel switching device provided in an embodiment of this application. Detailed Implementation

[0095] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0096] Hereinafter, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first," "second," or "third" may explicitly or implicitly include one or more of that feature.

[0097] Specific details, such as particular system architectures and techniques, are set forth for illustrative purposes and not for limitation, to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application can be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods are omitted to avoid unnecessary detail that could obscure the description of this application.

[0098] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, etc. Figures 1 and 2 show a specific implementation of the display device of this application.

[0099] Figure 1 is a schematic diagram of the operation scenario between the display device and the control device according to the embodiment. As shown in Figure 1, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0100] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0101] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0102] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0103] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0104] Figure 2 illustrates an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in Figure 2, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive operation commands input by the user and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0105] The user input / output interface 140 includes buttons, a microphone, etc. The buttons are used for traditional operation input, such as switching channels, switching signal source channels, adjusting volume, etc. The microphone is used to enable the control device 100 to receive user voice. The microphone can be controlled by the buttons or the user's voice commands can be received directly through the microphone, providing users with a convenient interaction method.

[0106] As shown in Figure 3, the display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0107] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.

[0108] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0109] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0110] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0111] The user interface can be used to receive control signals from the control device 100 (such as an infrared remote control).

[0112] Detector 230 is used to collect signals from the external environment or to interact with the outside world. For example, detector 230 may include a sound collector, such as a microphone, for receiving external sounds.

[0113] The microphone is used to receive the sound signals emitted by the user and convert them into electrical signals, thereby providing raw data for subsequent voice processing. When the user does not use the control device 100, they can use the microphone in the display device 200 to perform voice control, such as switching channels, adjusting volume, and searching for programs.

[0114] The external device interface 240 includes at least one High Definition Multimedia Interface (HDMI), and may also include, but is not limited to, the following: analog or data high-definition component input interface (component), composite video input interface (CVBS), RGB port, or any one or more of the following interfaces, display interface (DisplayPort, DP), and USB interface (such as USB Type-C). It may also be a composite input / output interface formed by multiple of the above interfaces.

[0115] HDMI is a digital video / audio interface that can transmit audio and video signals simultaneously without the need for additional audio cables, simplifying installation and ensuring high-quality audio and video signal transmission. Furthermore, with the development of HDMI technology, its width has continuously increased, providing higher transmission bandwidth and supporting high-definition, ultra-high-definition, and even higher resolution video transmission, meeting the growing demand for high-definition video.

[0116] It should be understood that HDMI allows various external devices such as game consoles, Blu-ray players, and TV boxes to be connected to the display device 200, enabling users to enjoy a richer and more immersive audio-visual entertainment experience.

[0117] It should also be understood that, in order to facilitate the differentiation and management of HDMI interfaces, display devices and their systems label the HDMI interfaces, forming interface names. Different HDMI interfaces can be represented by numbers, letters, or specific symbols, such as HDMI1, HDMI2, or HDMIA, HDMIB, etc. These labels are displayed to users to help them distinguish between different HDMI interfaces.

[0118] In the system of a display device, each HDMI interface has its own unique HDMI channel identifier for its HDMI transmission channel. The HDMI channel identifier can be identified by a numerical code and there is a corresponding relationship between it and the label of the HDMI interface. For example, the HDMI channel identifier corresponding to HDMI1 is 1281, and the HDMI channel identifier corresponding to HDMI2 is 1282.

[0119] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0120] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external TV box.

[0121] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0122] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), random access memory (RAM), read-only memory (ROM), a first to an nth interface for input / output, a communication bus, etc.

[0123] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0124] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of a display device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0125] As shown in Figure 4, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Library Layer"), and the kernel layer.

[0126] In some embodiments, at least one application runs in the application layer. These applications may be Windows programs, system settings programs, or clock programs that come with the operating system; they may also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0127] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0128] As shown in Figure 4, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: Activity Manager, used to interact with all activities running in the system; Interaction Manager, used to handle voice input and voice output; Location Manager, used to provide system services or applications with access to system location services; Notification Manager, used to control the display and clearing of notification messages; and Window Manager, used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0129] In some embodiments, the kernel layer is a layer between hardware and software. As shown in Figure 4, the kernel layer includes at least one of the following drivers: audio driver, display driver, WIFI driver, USB driver, HDMI driver, and power driver, etc.

[0130] Display devices continue to advance in image processing, display presentation, and audio effects. As a result, users are increasingly eager to connect other external devices to their displays to obtain a richer and more immersive audiovisual entertainment experience. Taking smart TVs as an example, users typically connect various external devices such as gaming devices, Blu-ray players, and TV boxes to their smart TVs via HDMI interfaces. Whenever a user wants to use a specific external device, they need to use the remote control or the operation buttons on the smart TV to perform corresponding control operations. This includes using the operation buttons to display a list of all compatible external device interfaces, selecting the signal source corresponding to the specific external device, and confirming the switch to that signal source to achieve channel switching.

[0131] Both smart TVs and external devices have HDMI ports. Users typically use HDMI cables to connect external devices to smart TVs. Taking gaming devices as an example, the gaming device acts as the transmitter, and the smart TV acts as the receiver. Audio and video signals are transmitted through the HDMI cable, allowing users to enjoy a smooth, high-quality, and fluid visual experience with stunning sound effects on a large screen.

[0132] For example, the smart TV connects to external devices via its HDMI interface and HDMI cable. Figure 5 illustrates a schematic diagram of the connection between the smart TV and the external device. As shown in Figure 5, the smart TV has three HDMI interfaces on the back, namely HDMI1, HDMI2 and HDMI3. The smart TV is connected to the first TV box 510 via HDMI1, to the first game device 520 via HDMI2, and to the second game device 530 via HDMI3.

[0133] Currently, the display interface of a smart TV display system allows users to switch to playing games using a first gaming device connected via the HDMI2 interface. This is achieved through operation via the remote control or the operation buttons on the smart TV: First, the operation buttons display a list of all external device interfaces matched with the smart TV, as shown in Figure 6(a). The first option is selected by default in the channel list menu. Then, the HDMI2 channel is selected via the remote control or the operation buttons on the smart TV, and the switch to the HDMI2 channel is confirmed by pressing the OK button, as shown in Figure 6(b). This switches the signal source from the system to the HDMI2 channel corresponding to the first gaming device, thus achieving channel switching.

[0134] It should be understood that if the first gaming device is powered on, the smart TV displays the interface output by the first gaming device; if the first gaming device is in sleep or powered off state, the smart TV displays an interface with no signal input, such as a black screen.

[0135] It should also be understood that, as shown in Figure 6(a), the channel list menu only displays the names of each channel, such as HDMI1, HDMI2, and USB, and does not display the corresponding device information, such as the device name. During channel switching, users may not know which channel their gaming device is connected to, or that the smart TV may be connected to multiple gaming devices through multiple channels. This increases the user's workload when operating the smart TV and reduces the user experience.

[0136] In view of this, embodiments of this application provide a display device and a channel switching method. The display device includes a display, a controller, and at least one HDMI interface. The controller is configured to execute the following channel switching method: in response to a user-inputted voice command, receiving keywords obtained from the voice command that characterize the service type of the external device; when there is a mapping relationship between the keyword and the HDMI channel identifier indicating the channel to be switched, a channel switching command can be quickly generated so that the content input by the external device is displayed on the display. This process of automatically switching signal source channels in response to user voice commands can achieve efficient resource management and task allocation, improve the processing efficiency of channel switching services, and thus improve the user experience.

[0137] To facilitate a further understanding of the technical solutions in some embodiments of this application, the technical solutions of the display device and channel switching method, and how these solutions solve the aforementioned technical problems, are described in detail below with reference to specific embodiments and accompanying drawings. The embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. Obviously, the described embodiments are only some, not all, of the embodiments of this application.

[0138] The display device includes a monitor, a controller, and at least one HDMI interface. The monitor and the controller are communicatively connected, and the HDMI interface is used to connect the display device to external devices.

[0139] Figure 7 shows a flowchart of a channel switching method in a display device in some embodiments of this application. As shown in Figure 7, the display device is a smart TV as an example, wherein the controller is configured to perform the following steps:

[0140] S610 receives voice commands input by the user.

[0141] It should be understood that voice commands bring great convenience to the interaction between users and smart TVs. No manual operation is required; users only need to speak specific voice commands, and the device can respond quickly.

[0142] For example, the microphone in the remote control or the microphone in the smart TV can be used to receive voice commands recorded by the user, such as far-field voice and voice monitoring.

[0143] Among them, far-field voice allows users to issue voice commands within a certain range (such as 3-5 meters, or even further) from the smart TV. The smart TV can effectively receive these voice commands. At this time, the sound acquisition device in the smart TV includes multiple microphones, which form a microphone array. It can enhance the sound signal from the user's direction through beamforming and other technologies, while suppressing ambient noise and improving the accuracy of voice recognition.

[0144] Voice monitoring involves the smart TV continuously monitoring ambient voice signals to detect wake words or specific voice signals. Upon detection of a wake word or specific voice signal, the voice assistant is activated, and then it processes the user's voice commands. It should be understood that the monitoring and acquisition of these voice commands are compliant with regulations, and their use or implementation does not involve any actions that harm the public interest.

[0145] S620: In response to the received voice command, the voice command is sent to the server.

[0146] It should be understood that the received voice commands are sent to the server, which has powerful computing resources and large-scale speech recognition models. These speech recognition models are trained with a large amount of speech data and are able to accurately recognize various speech features.

[0147] Here, the server can be one server or multiple servers. It is important to understand that the speech recognition model in the server is constantly updated and optimized through massive amounts of training data, which can provide high recognition accuracy and support the recognition of multiple languages ​​and dialects to meet the needs of different users. Therefore, speech recognition of voice commands through the server has the characteristics of high accuracy and abundant resources.

[0148] In some embodiments, multiple slots can be preset in the server. These slots are predefined information storage units in voice interactions related to channel switching, used to collect and manage key information fragments required to complete the channel switching task. During the interaction with the user, the user is guided to fill in the slots, thereby enabling a comprehensive understanding of the user's intent.

[0149] For example, the slot includes a first slot, a second slot, a third slot, and a fourth slot. The first slot is used to store the name of the external device, the second slot is used to store the service type of the external device, the third slot is used to store user semantics, and the fourth slot is used to store the signal source interface.

[0150] It should be understood that in order to accurately understand the meaning of user voice commands, it is possible to gain insight into the user's intent after some slots have been filled with information, without having to wait until all slots have been filled with response information. This is because some key information provided by the user during the dialogue, such as keywords representing the name of the external device or keywords representing the service type of the external device, is sufficient to form a preliminary understanding of the user's needs, which helps to improve dialogue efficiency and enables the entire system to respond more promptly to meet the user's needs.

[0151] It should be understood that, in the process of understanding user intent, the server may set up a preset semantic material library corresponding to the application scenario of this application embodiment. The system developer will predefine a series of intent categories related to the use of a certain type of external device, such as gaming devices. In the preset semantic material library, each intent category has corresponding keywords associated with it.

[0152] It should also be understood that when the server parses the voice command and extracts key information that matches the intent category in the preset semantic material library, if it determines that the key information meets the needs of the channel switching device, it will send the parsed keywords to the display device, so that the display device can perform channel switching operations based on these keywords.

[0153] It should be understood that the parsing process of voice commands can be performed on a server. If the display device hardware supports it, the recognition of voice commands can also be completed on the controller and memory in the smart TV. Small voice recognition models can be set up in the smart TV. These models can run under the limited computing resources of the smart TV and analyze and recognize the voice commands in response to the received voice commands.

[0154] S630 receives keywords sent to the smart TV by the server.

[0155] Keywords are key elements extracted from voice commands to characterize the service type of external devices. At the same time, it should be understood that when the server sends keywords to the smart TV, it also indicates that the intent of the voice command corresponding to the extracted keywords is for channel switching. This helps the smart TV understand the user's intent and provides a basis for subsequent operations.

[0156] Specifically, the server first identifies the textual description corresponding to the voice command, then understands the text as a whole, and extracts key elements that represent the user's intent. These key elements include keywords that represent the name of the external device, and / or keywords that represent the business type of the external device, and / or keywords that represent the business type of the external device as a game, etc., covering the semantic content corresponding to the voice command.

[0157] For example, the voice command "I want to play PS5" contains the key elements "play" and "PS5," with the corresponding keyword "PS5" representing the external device name, accurately reflecting the user's desire to play games on a PS5. Similarly, the voice command "I want to play on a Switch connected via HDMI2" contains the key elements "play," "HDMI2," and "Switch," with the corresponding keywords "Switch" representing the external device name and "HDMI2" representing the external device connection interface, accurately reflecting the user's desire to play games on a Switch connected via HDMI2. Likewise, the voice command "I want to play on a game console" contains the key elements "play" and "game console," with the corresponding keyword indicating that the external device's service type is gaming, accurately reflecting the user's desire to play games on a game console. Finally, the voice command "I want to use a TV box" contains the key element "TV box," with the corresponding keyword indicating that the external device's service type is multimedia playback, accurately reflecting the user's desire to watch videos on a TV box.

[0158] In other words, the voice commands entered by the user are used to switch the signal source channel. The keywords parsed from the voice commands can represent the service type of the external device or the name of the external device. In some embodiments, the keyword can also be the game type, which represents the service type of the external device.

[0159] If keywords representing the service type of an external device are parsed, perform the following steps:

[0160] S640. Upon receiving a keyword representing the service type of an external device obtained from the parsing of a voice command, determine the target HDMI channel corresponding to the keyword based on the matching relationship between the keyword and the mapping relationship.

[0161] The extracted keywords can be either those that directly represent the type of external device services or those that briefly represent the type of external device services.

[0162] It should be understood that a smart TV includes at least one HDMI interface, which is used to connect the smart TV to external devices. These external devices can be gaming devices, Blu-ray players, TV boxes, etc. Different external devices have different types. For example, gaming devices are gaming-type external devices, while Blu-ray players and TV boxes are multimedia playback-type external devices.

[0163] Keywords that directly characterize the service type of an external device can be specific to that external device, such as "game console," which is a specific type of external device, i.e., a game type, or "Blu-ray player," which is a specific type of external device, i.e., a multimedia playback type.

[0164] It should be understood that keywords can also indirectly characterize the type of external device service. For example, "playing games" implies the characteristic of the external device service type of game, and "watching movies" implies the characteristic of the external device service type of multimedia playback.

[0165] It should be understood that keywords can also be a specific type of external device service and information that represents that type of external device service. For example, a voice command might be "I want to play games on a console game console," where the keywords include "console game console" that represents the type of external device service and "play games" that represents the type of external device service.

[0166] In this embodiment, the mapping relationship is dynamically established based on the read device name of the external device and the preset service type corresponding to the device name, and the HDMI channel identifier. Therefore, the mapping relationship may include the HDMI channel identifier, device name, and service type corresponding to the external device that communicates with the smart TV; the mapping relationship may also include only the HDMI channel identifier and service type corresponding to the external device that communicates with the smart TV.

[0167] The communication connection between the external device and the smart TV refers to the external device being connected to the smart TV via an HDMI cable, and the external device and the smart TV being able to exchange information. In other words, at this time, the smart TV is turned on, and the external device is turned on or in standby mode, so that the external device and the smart TV can communicate. If the external device is turned off, the external device cannot communicate with the smart TV.

[0168] It should be understood that the device names required to establish the mapping relationship are obtained through the Consumer Electronics Control (CEC) protocol. CEC is a device-to-device control protocol implemented via HDMI cables, built on top of the HDMI standard, allowing devices connected via HDMI cables to communicate and control each other. In other words, a smart TV can obtain the device names of external devices connected to it via HDMI interfaces through the CEC protocol.

[0169] Furthermore, the service type corresponding to an external device can be determined based on the device name. Specifically, the service type corresponding to a device name can be determined by the preset service types stored in the smart TV. These preset service types can be stored in the smart TV in the form of code, database, mapping table, etc. The preset service types include different device names and the service types corresponding to different device names.

[0170] After determining the service type corresponding to the device name, the set of mapping relationships is dynamically determined based on the HDMI channel identifier, device name, and service type of the HDMI interface. It should be understood that the set of mapping relationships can be displayed in the form of lists, matrices, graphs, etc.

[0171] It should be understood that the set of mapping relationships includes at least one set of mapping data. That is, the smart TV is connected to at least one external device via HDMI communication. Each set of mapping data corresponds to an HDMI interface connected to an external device, and each set of mapping data includes the HDMI channel identifier, device name, and service type. Different HDMI interfaces correspond to different external devices.

[0172] Taking an information list as an example, the set of mapping relationships includes multiple sets of mapping data. This means that the smart TV is connected to multiple external devices via HDMI communication. Each set of mapping data corresponds to an HDMI interface connected to an external device, and each set includes the HDMI channel identifier, device name, and service type. For the application scenario shown in Figure 5, if the first TV box 510 is an XX TV box, the first gaming device 520 is a Switch, and the second gaming device 530 is a PS5 (short for PlayStation 5), then the corresponding information list is as follows: Table 1:

[0173] Table 1 shows an information list from the smart TV shown in Figure 5.

[0174] In this embodiment of the application, the parsed keywords are used to characterize the service type of the external device. Therefore, the mapping relationship may only include the HDMI channel identifier and the service type, and the device name may not be reflected in the mapping relationship.

[0175] Taking the information list as an example, the information list includes multiple sets of mapping data. Each set of mapping data corresponds to an HDMI interface connected to an external device, and each set of mapping data includes the HDMI channel identifier and service type. For the application scenario shown in Figure 5, if the first TV box 510 is an XX TV box, the first game device 520 is a Switch, and the second game device 530 is a PS5 (short for PlayStation 5), then the corresponding information list is as follows:

[0176] Table 2 shows an information list from the smart TV shown in Figure 5.

[0177] For keywords that characterize the service type of external devices, regardless of whether the mapping relationship is presented in Table 1 or Table 2, the matching judgment between keywords and mapping relationships can be realized, thereby determining the target HDMI channel corresponding to the keyword based on the keyword and mapping relationship.

[0178] In some embodiments, to improve the association between the mapping relationship and the hardware interface, the mapping relationship also includes the HDMI interface name, and the correspondence between the HDMI interface name and the HDMI channel identifier is also reflected in the mapping relationship.

[0179] Continuing with the information list as an example, in this scenario, each set of mapping data in the information list includes the interface name, HDMI channel identifier, device name, and service type. The information list in the smart TV shown in Figure 5 is as follows: (Table 3)

[0180] Table 3 shows an information list from the smart TV shown in Figure 5.

[0181] For example, if the keyword represents the external device service type as game type, then the target HDMI channel corresponding to the game type is determined from the HDMI channel identifiers of the game type in the set of mapping relationships; if the keyword represents the external device service type as multimedia playback type, then the target HDMI channel corresponding to the multimedia playback type is determined from the HDMI channel identifiers of the multimedia playback type in the set of mapping relationships.

[0182] It should be understood that a smart TV has one or more HDMI ports, each port corresponding to a signal source channel. As shown in Figure 5, the smart TV, in conjunction with Table 1, will identify the channel corresponding to the HDMI1 port as the signal source channel of the XX TV box, the channel corresponding to the HDMI2 port as the signal source channel of the Switch, and the channel corresponding to the HDMI3 port as the signal source channel of the PS5.

[0183] The S660 switches the signal source to the target HDMI channel and displays the content input from the external device corresponding to the target HDMI channel on the display.

[0184] The target HDMI channel is the signal source channel corresponding to an external device that is connected to the smart TV. This signal source channel is matched with the user's voice commands. Therefore, by switching the smart TV's channel to the target HDMI channel, the smart TV can receive the multimedia playback content of the external device corresponding to the target HDMI channel and display it on the smart TV's screen.

[0185] Through the above process, the keywords parsed from the voice commands represent the service type of the external device. By using the set of keywords and the generated mapping relationships, the target HDMI channel can be quickly located. This process of automatically responding to the user's voice commands to switch the signal source channel can achieve efficient resource management and task allocation, and improve the processing efficiency of channel switching services.

[0186] The scenarios for communication connections between display devices and gaming devices are becoming increasingly diverse. In this application scenario, the gaming device serves as the primary external device, communicating with the display device via an HDMI interface. To improve the user experience when switching channels in this scenario, these external devices can be categorized as gaming devices and non-gaming devices, thereby increasing the processing speed during voice channel switching.

[0187] Figure 8 shows a flowchart of another channel switching method in a display device in some embodiments of this application, in which keywords representing the service type of an external device are parsed from voice commands. As shown in Figure 8, the display device is a smart TV as an example, wherein the controller is configured to perform the following steps:

[0188] S601, in response to a user-inputted voice command, receives keywords obtained from the parsing of the voice command; wherein, the keywords are used to characterize the service type of the external device.

[0189] S602. Determine whether there is a mapping relationship between the keywords and the HDMI channel identifier to indicate channel switching.

[0190] It should be understood that the mapping relationship is dynamically established based on the device name of the external device read, the corresponding preset service type, and the HDMI channel identifier. In other words, the mapping relationship can be as shown in Tables 1, 2, and 3, which at least includes the HDMI channel identifier and the service type, where the service type belongs to the preset service type.

[0191] Furthermore, by matching keywords with business types in the mapping relationship, it can be determined whether a mapping relationship exists to indicate the switching channel; if the keywords match the business types in the mapping relationship, it is determined that a mapping relationship exists; if the keywords do not match the business types in the mapping relationship, it is determined that no mapping relationship exists.

[0192] It should also be understood that when any number of external devices are detected, the HDMI channel identifier corresponding to any number of external devices is read, and the device name of any number of external devices is obtained through the CEC protocol. Then, based on the matching relationship between the device name and the preset service type, the service type corresponding to the external device is determined, and a set of mapping relationships between HDMI channel identifiers and service types of external devices is established; or a set of mapping relationships between HDMI channel identifiers, device names, and service types of external devices is established. Here, "any number" is a limitation on the quantity, and can be one or more.

[0193] Pre-set service types can be stored on smart TVs in the form of code, database, mapping table, etc., and include different game device names.

[0194] This application embodiment, by increasing the set of mapping relationships, can efficiently match keywords parsed from voice commands with external devices, providing strong support and a convenient way for accurate correspondence between the two. Furthermore, users can switch the current channel of the display device via voice. This provides users with a more natural interaction method. Compared with traditional button operations, voice command-based channel switching has significant advantages. It can improve user satisfaction, making it more convenient and efficient for users to operate the display device. Users no longer need to painstakingly search for control devices or press buttons; they can easily complete channel switching simply by issuing voice commands, greatly improving the user experience.

[0195] S603. If there is a mapping relationship between the keyword and the HDMI channel identifier, a channel switching instruction is generated so that the content input by the external device is displayed on the monitor.

[0196] The channel switching command is used to indicate switching to the target HDMI channel mapped by the keyword.

[0197] If there is a mapping relationship between the keyword and the HDMI channel identifier, it indicates that there is a game device corresponding to the keyword among the external devices that communicate with the display device. Therefore, a channel switching instruction can be generated based on the HDMI channel identifier corresponding to the game device.

[0198] In other words, upon receiving a keyword representing the service type of an external device obtained from the parsing of a voice command, the keyword is matched with the service type in the mapping relationship; if a match is found, it is determined that there is a mapping relationship between the keyword and the HDMI channel identifier to indicate channel switching; based on the mapping relationship, the target HDMI channel corresponding to the keyword is determined, and a channel switching command is generated.

[0199] In this embodiment, keywords are matched with service types in the mapping relationship. If a service type that matches the keyword exists in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the service type. This process of matching keywords with service types in the mapping relationship can accurately determine the matching external device in the mapping relationship, and then determine the corresponding signal source channel, thereby improving the processing efficiency of channel determination.

[0200] In some embodiments, keywords representing the name of an external device are parsed from voice commands. In this scenario, Figure 9 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application. As shown in Figure 9, the display device is a smart TV, where the controller is configured to perform the following steps:

[0201] S610 receives voice commands input by the user.

[0202] S620: In response to the received voice command, the voice command is sent to the server.

[0203] S630 receives keywords sent to the smart TV by the server.

[0204] S650: When a keyword representing the name of an external device is parsed, the target HDMI channel corresponding to the keyword is determined based on the matching relationship between the keyword and the mapping relationship.

[0205] Among them, keywords are used to represent the name of external devices, which can be either the abbreviation or the full name of the external device.

[0206] It should be understood that the full name contains the technical definition and classification information of the equipment, providing more accurate and detailed information. In application scenarios such as technical specifications, academic research, and official documents, using the full name can avoid ambiguity and ensure the completeness and accuracy of the information. However, in daily communication and operation, the full name is often quite long, and using an abbreviation can more efficiently refer to the equipment and quickly convey information; furthermore, many devices offer abbreviations to make it easier for users to remember short and distinctive names.

[0207] Taking gaming devices as an example, external devices can be console gaming devices, which are independent hardware devices that run game software, such as Sony's PlayStation series (e.g., PlayStation 5, PS5; PlayStation 4, PS4, etc.) and Microsoft's Xbox series (e.g., Xbox Series X, Xbox X; Xbox Series S, Xbox S, etc.). These gaming devices output game images and sound through display devices such as smart TVs. Gaming devices can also be handheld gaming devices, which have their own display screen and can be used independently as handheld game consoles or connected to smart TVs for gaming experiences, such as Nintendo's Switch.

[0208] In other words, when the keyword is the abbreviation or full name of the external device, it provides an accurate basis for subsequent voice-based switching of signal source channels.

[0209] In scenarios where users interact with smart TVs via voice, the voice commands they issue tend to be conversational. In spoken communication, when users are familiar with the brand and series of external devices, they will use shorter terms than abbreviations; for example, a user might use "PS" to refer to any product in the PlayStation series, and "Xbox" to refer to any product in the Xbox series. Therefore, keywords can also be information that represents external devices, such as "PS" and "Xbox" mentioned above.

[0210] It should be understood that if the keyword represents the name of an external device, then the set of mapping relationships in the smart TV can include the device names of the external devices that are communicatively connected to the smart TV. Here, "communicating connection between the external device and the smart TV" means that the external device is connected to the smart TV via an HDMI cable, and that information exchange is possible between the external device and the smart TV; that is, the smart TV is powered on, and the external device is either powered on or in standby mode, so that communication between the external device and the smart TV is possible. If the external device is powered off, then the external device cannot communicate with the smart TV.

[0211] It should be understood that the device names in the mapping relationship are obtained through the CEC protocol. The CEC protocol is a device-to-device control protocol implemented via HDMI cables. It is built on the HDMI standard and allows devices connected via HDMI cables to communicate and control each other. In other words, a smart TV can obtain the device name of an external device connected via the HDMI interface through the CEC protocol. It should be understood that the device name here can be either the abbreviation or the full name of the external device.

[0212] In this embodiment, the mapping relationship is dynamically established between the device name of the external device and the HDMI channel identifier. Therefore, the mapping relationship may include the HDMI channel identifier and device name corresponding to the external device that is connected to the smart TV.

[0213] Based on the HDMI channel identifier and device name of the external device communicating with the display device, a set of mapping relationships is dynamically determined. Taking the set of mapping relationships as an information list as an example, the information list includes at least one set of mapping data. That is, the smart TV is connected to at least one external device via HDMI communication. Each set of mapping data corresponds to an HDMI interface connected to an external device, and each set of mapping data includes an HDMI channel identifier and a device name; different HDMI interfaces correspond to different external devices. For the application scenario shown in Figure 5, if the first TV box 510 is an XX TV box, the first game device 520 is a Switch, and the second game device 530 is a PlayStation 5, then the corresponding information list is shown in Table 4 below:

[0214] Table 4 shows an information list from the smart TV shown in Figure 5.

[0215] In some embodiments, to improve the association between the mapping relationship and the hardware interface, the mapping relationship also includes the HDMI interface name, reflecting the correspondence between the HDMI interface name and the HDMI channel identifier. In this case, each set of mapping data in the information list includes the interface name, the HDMI channel identifier, and the device name. The information list in the smart TV shown in Figure 5 is as follows:

[0216] Table 5 shows an information list from the smart TV shown in Figure 5.

[0217] It should also be understood that, in the case where the keyword represents the name of the external device, the mapping relationship may also include the device name and service type of the external device that communicates with the smart TV, wherein the service type is determined by the device name. That is, in this embodiment, the set of mapping relationships may also be as shown in Table 1, Table 2 or Table 3.

[0218] In other words, the device name in the mapping relationship can be "PS5" as shown in Table 1, Table 2 or Table 3, which is the abbreviation of the device name; or it can be "PlayStation 5" as shown in Table 4 or Table 5, which is the full name of the device name.

[0219] Therefore, based on keywords and mapping relationships, the target HDMI channel corresponding to the keywords is determined; specifically, the keywords are matched with the device names in the mapping relationships; if a device name matching the keyword exists in the mapping relationships, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the device name; wherein, the keywords can be the name of an external device, which can be an abbreviation or a full name; or it can be information representing the external device.

[0220] It should be understood that if the keyword is the abbreviation or full name of an external device, the abbreviation or full name of the external device can be matched with the mapping relationship. Specifically, the abbreviation or full name of the external device can be matched with the device name in the mapping relationship through the preset first matching algorithm.

[0221] The preset first matching algorithm can cover a variety of methods, such as key-value pair mapping, string processing techniques, and natural language processing techniques.

[0222] In smart TVs, the mapping between abbreviations and full names of external devices can be stored in a database or mapping table. For example, the abbreviation of the external device can be stored as the key and the full name as the value. When a match is needed, it is only necessary to look up the corresponding full name in the mapping table based on the given abbreviation, or vice versa. In this way, a preset matching algorithm can be used to match the abbreviation or full name of the external device with the device name in the mapping relationship.

[0223] It should also be understood that if the keyword represents the name of an external device, in the process of matching with the mapping relationship, a preset second matching algorithm can be used to match the keyword with the device name in the mapping relationship.

[0224] The second preset matching algorithm is a fuzzy matching algorithm, such as string fuzzy matching. String fuzzy matching does not require two strings to be completely identical, but rather allows for differences to a certain extent. These differences can include character insertion, deletion, and substitution. For example, the keyword "PS" representing the name of an external device and the device name "PlayStation 5" in the mapping relationship can be considered related in the case of fuzzy matching; that is, "PS" and "PlayStation 5" match, meaning that there is a device name in the mapping relationship that matches the keyword.

[0225] For example, if the keyword is "Switch", the target HDMI channel will be determined from the HDMI interface with the device name "Switch" in the mapping relationship; if the keyword is "XX TV box", the target HDMI channel will be determined from the HDMI interface with the device name "XX TV box" in the mapping relationship.

[0226] It should be understood that a smart TV has one or more HDMI ports, each of which can correspond to a signal source channel. As shown in Figure 5, the smart TV, in conjunction with Table 3, will identify the channel corresponding to the HDMI1 port as the signal source channel of the XX TV box, the channel corresponding to the HDMI2 port as the signal source channel of the Switch, and the channel corresponding to the HDMI3 port as the signal source channel of the PlayStation 5.

[0227] In some embodiments, keywords representing the name of the external device and the service type of the external device are parsed out. It should be understood that the keywords at this time have high uniqueness and can refer to a specific object. Therefore, the subsequent signal source channel switching process can be carried out directly through the keywords.

[0228] The S660 switches the signal source to the target HDMI channel and displays the content input from the external device corresponding to the target HDMI channel on the display.

[0229] The target HDMI channel is the signal source channel corresponding to an external device that is connected to the smart TV. This signal source channel is matched with the user's voice commands. Therefore, by switching the smart TV's channel to the target HDMI channel, the smart TV can receive the multimedia playback content of the external device corresponding to the target HDMI channel and display it on the smart TV's screen.

[0230] Through the above process, keywords representing the names of external devices are parsed from voice commands. The target HDMI channel can be quickly located through the keywords and the generated mapping relationship. This process of automatically switching signal source channels in response to user voice commands can achieve efficient resource management and task allocation, and improve the processing efficiency of channel switching services.

[0231] In some embodiments, the channel switching methods in the smart TV shown in Figures 7 and 9 can be combined to form the flowchart shown in Figure 10. Figure 10 shows a flowchart of another channel switching method in the smart TV in some embodiments of this application. As shown in Figure 10, in cases where keywords representing the service type of external devices, or keywords representing the name of external devices, or keywords representing both the service type and the name of external devices are parsed, the corresponding channel switching can be achieved through the embodiments shown in Figure 10.

[0232] It should be understood that in the embodiments of this application, the mapping relationship includes the HDMI communication identifier, device name and service type of the external device that is connected to the smart TV; and, for a detailed description, please refer to the detailed description of S610 to S660 above, which will not be repeated here.

[0233] To improve channel switching after voice parsing, the channel switching method provided in this application embodiment can also include a judgment on the connection status of external devices. In this scenario, the channel switching method includes the following steps:

[0234] First, when the external device is connected to the display device via the first HDMI interface, it receives voice commands recorded by the user, and the voice commands are parsed to obtain identification information representing the external device.

[0235] It should be understood that the first HDMI port is any HDMI port on the display device.

[0236] The state of an external device communicating with a display device through the first HDMI interface means that the external device can be in standby or power-on state at this time. This is because the external device can only communicate with the display device when it is in standby or power-on state.

[0237] After parsing the voice command, identification information representing the external device is obtained. The identification information can be an identifier representing the name of the external device, an identifier representing the service type of the external device, an identifier representing both the name of the external device and the service type, or an identifier representing the name of the external device and / or the service type, as well as a signal source identifier.

[0238] Secondly, based on the mapping relationship between the identification information and the first HDMI channel identification, the signal source is switched to the external device corresponding to the identification information.

[0239] It should be understood that the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device.

[0240] The mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device communicates and connects with the display device through the first HDMI interface. It should be understood that the mapping relationship may include the HDMI channel identifier and the device name of the external device, or the HDMI channel identifier and the service type of the external device; or the HDMI channel identifier, the device name of the external device, and the service type of the external device.

[0241] For a detailed description, please refer to the detailed descriptions of S610 to S660 above, which will not be repeated here.

[0242] In some embodiments, during the keyword and mapping matching process, there may be one or more matching external devices. In order to accurately match the target HDMI channel corresponding to the voice command, Figure 11 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application. As shown in Figure 11, in S640 of Figure 7, when a keyword representing the service type of an external device is received by parsing the voice command, the target HDMI channel corresponding to the keyword is determined based on the matching relationship between the keyword and the mapping relationship. The controller can also be configured to perform the following steps:

[0243] S641. After parsing out the keywords that represent the service type of the external device, match the keywords with the service type in the mapping relationship.

[0244] In other words, by accurately matching keywords with business types in the mapping relationship, it is possible to accurately associate keywords with HDMI interfaces in the mapping relationship, thereby providing a basis for determining the target HDMI channel in the future.

[0245] S642. If an external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.

[0246] It should be understood that the keyword at this time represents the service type of the external device; therefore, when an external device that matches the keyword is matched in the mapping relationship, the HDMI interface corresponding to the external device is determined as the corresponding target HDMI channel.

[0247] S643. If M external devices are matched in the mapping relationship, display the list of first signal sources corresponding to the M external devices on the display.

[0248] Where M is an integer greater than 1, meaning that the number of matched external devices is multiple, such as two, three, etc.

[0249] It should be understood that if M external devices are matched in the mapping relationship, the smart TV cannot determine which signal source channel corresponds to the keyword parsed in the voice command. At this time, the smart TV displays a list of signal sources corresponding to these external devices, namely the first signal source list, for interaction with the user, so that the user can select the signal source channel from the first signal source list.

[0250] For example, for the mapping relationship shown in Table 1, if the keyword represents the external device service type as game type, then there are two external devices in Table 1 that meet the matching, namely Switch and PS5. At this time, the first signal source list determined by Switch and PS5 can be displayed on the monitor, as shown in Figure 12(a). In the first signal source list 261, the options corresponding to each signal source interface include the HDMI interface name and the name of the external device corresponding to the communication connection of the interface, so that the user can select the signal source channel from the first signal source list 261. It should be understood that the name can be the full name of the external device or the abbreviation of the external device.

[0251] It should be understood that the signal source list can be displayed in the form of a menu or a list. This application embodiment does not limit the display form of the first signal source list.

[0252] At this time, the smart TV can also prompt the user to make a selection via voice or text. For example, a voice prompt could be, "Two gaming devices have been detected. You can tell me the number or the name of the gaming device to select."

[0253] S644: In response to the user's first selection command, determine the target HDMI channel based on the external device corresponding to the first selection command.

[0254] It should be understood that the first selection command can be a command from the user to select and confirm the signal source via the remote control buttons, or it can be a voice command from the user to select the number, the name of the external device and / or the signal source channel, such as "first", "HDMI1", "PS5" or "first Switch".

[0255] It should also be understood that if the external device corresponding to the first selection instruction exists in the first signal source list, and there is only one matching signal source channel in the first signal source list, then the signal source channel is the target HDMI channel.

[0256] If the external device corresponding to the first selection instruction exists in the first signal source list, and there are multiple matching signal source channels in the first signal source list, then the user is guided to make another selection through voice or text prompts to determine the target HDMI channel from the multiple matching signal source channels.

[0257] For example, if the first signal source list includes two external devices with the name PS5 corresponding to HDMI interfaces, and the first selection command is a voice command and is "PS5", it means that there are two matching signal source channels in the first signal source list. Then, the user is prompted to select again through voice or text, such as "Two PS5s have been detected. You can tell me: which PS5 to select." The target HDMI channel is determined from the signal source channels corresponding to the two external devices.

[0258] It should also be understood that when the first selection command is a voice command, the information in the voice command may not be accurate enough. For example, the voice command may be "PS" or "Xbox," but "PS" and "Xbox" are not accurate names of external devices. In this case, when it is necessary to determine the signal source channel that matches the voice command from the first signal source list using a fuzzy matching algorithm, there may be one or more matching signal source channels. If there are multiple matching signal source channels, it is also necessary to guide the user to make a selection again through voice or text prompts. At this time, the prompts will guide the user to make an accurate selection, such as "Multiple signal source channels have been detected. You can tell me which one to select."

[0259] For example, the first signal source list includes an external device named Xbox X corresponding to one HDMI interface and an external device named Xbox S corresponding to one HDMI interface. When the first selection command is a voice command and is "Xbox", the fuzzy matching algorithm determines that there are two matching signal source channels in the first signal source list. The user is then prompted to select again via voice or text, such as "Two signal source channels related to Xbox have been detected. Can you tell me which one to select?" Then, the target HDMI channel is determined from the signal source channels corresponding to the two external devices.

[0260] Through the above process, the keywords parsed from the voice commands represent the service type of the external device. The target HDMI channel can be quickly located through the keywords and the generated mapping relationship. This process of automatically responding to the user's voice commands to switch the signal source channel can achieve efficient resource management and task allocation, and improve the processing efficiency of channel switching services.

[0261] It should also be understood that after responding to the user's first selection command, there may be cases where the external device corresponding to the first selection command does not exist in the first signal source list. In this case, the user can be prompted that no external device matching the keyword was found, such as "No game device you want was found", or the local application corresponding to the keyword or the business zone corresponding to the keyword can be displayed.

[0262] In some embodiments, when multiple external devices are matched in the mapping relationship, historical usage data is introduced to improve the accuracy and convenience of user selection. The matched external devices are then sorted, with the most frequently used devices listed first. This allows users to quickly locate the device they need, reducing selection time and improving user experience. Therefore, for S640 in Figure 7, upon receiving keywords representing the service type of the external device obtained from voice command parsing, the target HDMI channel corresponding to the keyword is determined based on the matching relationship between the keyword and the mapping relationship. The controller can also be configured to perform the following steps:

[0263] S645. If M external devices are matched in the mapping relationship, obtain the user's historical usage data for the M external devices.

[0264] It should be understood that historical usage data is determined based on one or more of the following information: the user's past connection frequency to various external devices, usage duration, and last usage time.

[0265] S646. Based on historical usage data, determine a list of second signal sources corresponding to M external devices, and display the list of second signal sources on the display.

[0266] Based on historical usage data, the signal sources corresponding to the matched M external devices are sorted to obtain a second signal source list. For example, the external devices that the user uses most frequently or for the longest time are ranked first.

[0267] For example, for the mapping relationship shown in Table 1, if the keyword represents the external device service type as game type, then there are two external devices in Table 1 that match, namely Switch and PS5. At this time, a second signal source list determined by Switch, PS5 and historical usage data can be displayed on the screen. In the historical usage data, the usage time of Switch is 36 hours and the usage time of PS5 is 170 hours. As shown in Figure 12(b), the second signal source list 262 is sorted according to the user's usage time, and the options corresponding to each signal source interface include the HDMI interface name, the name of the external device connected to the interface, and the usage time of the external device. The signal source interfaces are sorted according to the user's usage time, so that the user can select the signal source channel from the second signal source list 262. It should be understood that the name can be the full name of the external device or the abbreviation of the external device.

[0268] S647. In response to the user's second selection command, determine the target HDMI channel based on the external device corresponding to the second selection command.

[0269] For details on the implementation process of S645 to S647, please refer to the detailed description of S643 to S644 above, which will not be repeated here.

[0270] It should be understood that when keywords represent the service type of external devices, during the process of matching keywords with service types in the mapping relationship, there may be cases where no service type matches the keyword in the mapping relationship. In other words, among the external devices communicating with the smart TV, there may be no device that matches the keyword. To improve the user experience in this situation, the controller is also configured to perform the following steps:

[0271] S648. Obtain the local application corresponding to the keyword.

[0272] It should be understood that the keywords mainly include game type and multimedia playback type.

[0273] Taking a smart TV with an Android operating system as an example, users will install one or more local applications as needed while using the smart TV. These local applications can be of various types, such as video-on-demand, live streaming, games, educational apps, music, fitness apps, and browsers. Among them, video-on-demand, live streaming, and music apps are all multimedia playback type local applications.

[0274] From these applications, obtain the local applications that match the keywords. For example, if the keyword is a multimedia playback type, the corresponding local applications could be video-on-demand, live streaming, and music applications. If the keyword is a game type, the corresponding local applications could be game applications.

[0275] S649A. If the number of local applications is 0, display the business zone corresponding to the keyword.

[0276] Under the Android operating system of smart TVs, there are usually several distinctive service zones that bring users a rich and diverse user experience. These service zones include multimedia playback zones for movies, TV series, variety shows, etc., as well as game zones, education zones, fitness zones, and so on.

[0277] It should be understood that when the number of local applications is 0, it indicates that no application corresponding to the keyword is installed in the operating system. In this case, a business zone corresponding to the keyword can be presented for users to choose from.

[0278] Additionally, voice prompts such as "No game applications are currently installed on this device" can help users better understand why a business zone is displayed. Voice prompts can also guide users on how to interact with the smart TV, such as "You can say to me: I want to play games on PS5," to help users better switch signal source channels via voice.

[0279] S649B: If the number of local applications is 1, start the local application.

[0280] If the data of the local application corresponding to the keyword is 1, it means that among the local applications installed on the smart TV, only one local application corresponds to the keyword. In this case, the user will be redirected directly based on the startup information of that local application, and the local application will be displayed on the screen.

[0281] S649C. If the number of local applications is N, display the application list corresponding to each local application, and, in response to the user's third selection instruction, launch the first application based on the first application corresponding to the third selection instruction.

[0282] Where N is a positive integer greater than 1, the smart TV display shows an application list containing N local applications. It should be understood that the data for each local application in the application list includes the application name, application icon, and application launch information, for example: {"appName":"Dou Dizhu","appIcon":"display icon URL","appLaunchInfo":"application launch information"}.

[0283] In some embodiments, these local applications can be sorted based on factors such as the user's recent usage time, usage duration, and usage frequency, and the sorted local applications can be displayed in an application list. The local applications that the user frequently plays will be listed first, so that the user can quickly locate the local application they need to select, reducing the user's selection time, and providing voice prompts for further interaction, such as "You can tell me the first application to play the game".

[0284] It should be understood that the third selection command can be a command from the user to select or confirm the signal source via remote control buttons, or it can be a voice command from the user to select a specific number or the name of a local application, such as "first" or "first game A".

[0285] In response to the user's third selection instruction, the first application is determined from these local applications. It should be understood that the first application is the application corresponding to the third selection instruction.

[0286] In some embodiments, the following situation may occur: no local application matching the third selection instruction exists in the application list. In this case, this problem can be further addressed through voice interaction with the user. For example, the user can be asked if they need to search for the relevant application from the app store, or if they have any other alternative needs, thereby better meeting the user's intent and ensuring a smooth user experience.

[0287] In some embodiments, during the keyword-mapping process, there may be one or more matching external devices. In order to accurately match the target HDMI channel corresponding to the voice command, Figure 13 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application. As shown in Figure 13, in S650 of Figure 9, when the keyword represents the name of the external device, the target HDMI channel corresponding to the keyword is determined based on the keyword and the mapping relationship. The controller can also be configured to perform the following steps:

[0288] S651. When the keyword represents the name of an external device, match the keyword with the device name in the mapping relationship.

[0289] Furthermore, if a device name matching the keyword exists in the mapping relationship, the target HDMI channel corresponding to the keyword is determined based on the signal source channel corresponding to the device name. There may be one or more matching external devices. Therefore, further processing can be performed as follows.

[0290] S652. If an external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.

[0291] It should be understood that the keyword at this time represents the name of the external device, or the keyword includes both keywords; therefore, when an external device that matches the keyword is matched in the mapping relationship, the HDMI interface corresponding to the external device is determined as the corresponding target HDMI channel.

[0292] S653. If M external devices are matched in the mapping relationship, display the list of first signal sources corresponding to the M external devices on the display.

[0293] Where M is an integer greater than 1.

[0294] S654. In response to the user's first selection command, determine the target HDMI channel based on the external device corresponding to the first selection command.

[0295] For details on the implementation process of S653 to S654, please refer to the detailed description of S643 to S644 above, which will not be repeated here.

[0296] In some embodiments, when multiple external devices are matched in the mapping relationship, historical usage data is introduced to improve the accuracy and convenience of user selection. The matched external devices are then sorted, with the most frequently used devices listed first. This allows users to quickly locate the device they need, reducing selection time and improving user experience. Therefore, for S650 in Figure 9, when the keyword represents the external device name, the controller can be configured to perform the following steps to determine the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship:

[0297] S655. If M external devices are matched in the mapping relationship, obtain the user's historical usage data for the M external devices.

[0298] Where M is an integer greater than 1.

[0299] S656. Based on historical usage data, determine a list of second signal sources corresponding to M external devices, and display the list of second signal sources on the display.

[0300] It should be understood that in all the above embodiments, M is used to represent the number of matched external devices. However, it should be noted that the number referred to by M is not the same in each independent example; that is, the symbol is M, but the numerical meaning of M will change due to the differences in the embodiments.

[0301] S657. In response to the user's second selection command, determine the target HDMI channel based on the external device corresponding to the second selection command.

[0302] For details on the implementation process of S655 to S657, please refer to the detailed description of S645 to S647 above, which will not be repeated here.

[0303] It should be understood that when a keyword represents an external device name, during the process of matching the keyword with the device names in the mapping relationship, there may be a situation where no device name matches the keyword in the mapping relationship. In other words, among the external devices communicating with the smart TV, there is no device that matches the keyword. To improve the user experience in this situation, the controller is also configured to perform the following steps:

[0304] S658. Generate the resource request instruction corresponding to the keyword and send the resource request instruction to the server.

[0305] For example, if the keyword is "PS5" but there is no matching device name in the mapping, it means that the smart TV has not established a communication connection with "PS5". In this case, a resource request command can be generated based on the keyword "PS5". This command can be used to request purchase resources related to PS5, or to request video resources related to PS5.

[0306] S659. Receive and display the target resource.

[0307] The target resource is the resource that the server finds after extracting keywords from the resource request instruction and then searching for resources that match those keywords.

[0308] The target resources include purchase resources for external devices corresponding to the keywords, and / or video resources for external devices corresponding to the keywords; it should be understood that the video resources may be videos related to the purchase of the external device, or videos related to the use of the external device, etc.

[0309] In some embodiments, the content parsed from the voice command may also include signal source identifiers, such as HDMI1 and HDMI2.

[0310] If the keywords include a signal source identifier and an external device service type, and the signal source identifier and keywords do not completely match the channel identifier and service type in a set of mapping data in the mapping relationship, a first alternative channel list is displayed. The first alternative channel list includes a set of mapping data corresponding to the signal source identifier and / or at least one set of mapping data corresponding to the keywords.

[0311] In addition, if the keywords include the signal source identifier and the external device name, and the signal source identifier and the keywords do not completely match the HDMI channel identifier and the device name in a set of mapping data in the mapping relationship, a second alternative channel list is displayed; wherein, the second alternative channel list includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and / or at least a set of mapping data corresponding to the keywords.

[0312] It should be understood that the alternative channel list includes a first alternative channel list and a second alternative channel list.

[0313] It should be understood that the first alternative channel list includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and at least one set of mapping data corresponding to the keyword. Since the signal source identifier and keyword do not completely match the HDMI channel identifier and device name in a set of mapping data in the mapping relationship, the data that matches the signal source identifier and the data that matches the keyword are summarized to form the first alternative channel list. The signal source channels that may match the keyword are presented to the user to facilitate communication with the user and understand their specific needs.

[0314] There may be only one set of data matching the signal source identifier, while there may be multiple sets of data matching the service type. For example, the data matching "game type" in Table 6 includes three sets.

[0315] It should also be understood that the voice interaction between the user and the smart TV is a multi-round interaction. Through multiple rounds of interaction, the true intention of the user can be understood. Then, based on the user's intention, an identifier that matches the user's intention can be determined from the signal source identifier and keywords. Based on the data matched by this identifier, a first list of alternative channels can be generated.

[0316] The second alternative channel list includes a set of mapping data corresponding to the signal source identifier and at least one set of mapping data corresponding to the keyword.

[0317] It should also be understood that the parsed signal source identifiers, keywords and a set of mapping data in the mapping relationship are not completely matched. Specifically, it means that some information in the parsed content matches a certain set of mapping data in the mapping relationship, but other information does not correspond to that set of mapping data. In other words, there is a correlation between the parsed content and this set of mapping data in the mapping relationship, but not all content is completely consistent.

[0318] For example, the information list in a smart TV is as follows:

[0319] Table 6 is an information list for smart TVs.

[0320] When the voice command is "I want to play Xbox on HDMI1", the corresponding keyword packets "HDMI1" and "Xbox" are matched against Table 6. Neither the first set of mapping data "HDMI1-1281-PS5-Game Type" nor the second set of mapping data "HDMI2-1282-Xbox X-Game Type" is a complete match. In this case, the alternative channel list includes both the first and second sets of mapping data, as shown in the table below:

[0321] Table 7 lists one of the alternative channels in smart TVs.

[0322] Additionally, a list of alternative channels is displayed on the monitor, as shown in (c) of Figure 12.

[0323] Furthermore, in response to the user's fourth selection command, the target HDMI channel is determined based on the external device corresponding to the fourth selection command. The implementation process can be found in the detailed description of S644 above, and will not be repeated here.

[0324] When the parsed signal source identifier, keywords, and a set of mapping data in the mapping relationship completely match, the corresponding target HDMI channel can be determined. For example, when the voice command is "I want to play PS5 with HDMI4", the "HDMI4" and "PS5" in the voice command are matched with Table 6 and completely match the fourth set of mapping data. At this time, the target HDMI channel is determined to be the signal source channel corresponding to the HDMI4 interface.

[0325] In some embodiments, in order to improve the user experience after switching to the target HDMI channel, the display mode of the display device is also adjusted to a preset mode, which is determined by the service type of the external device corresponding to the target HDMI channel.

[0326] The display mode includes image mode and sound mode. For example, if the target HDMI channel corresponds to a gaming service on an external device, both the image mode and sound mode will be adjusted to gaming mode, and the smart TV will be set to the optimal gaming experience.

[0327] It's important to clarify that the peripheral device linkage switch feature on smart TVs is crucial, as it enables the smart TV to wake up external devices. In practical use cases, when a smart TV establishes a communication connection with external devices, these devices are typically in standby mode.

[0328] In common home entertainment systems, smart TVs may be connected to various external devices such as game consoles and Blu-ray players. When not in use, these external devices are mostly in standby mode to save energy and ensure quick response to startup commands. However, in the implementation of the channel switching method in this embodiment, the peripheral linkage switch can be adjusted to allow the smart TV to quickly wake up the corresponding external device via the CEC protocol.

[0329] For example, when a user wants to switch from watching a TV program to playing a game, the smart TV determines the target HDMI channel of the corresponding external device through voice command. At this time, with the help of the peripheral linkage switch setting, the smart TV can send a wake-up signal to the game device in standby mode, and the game device will start up quickly after receiving the signal.

[0330] In other words, after step 640 or 650 above, and before switching the signal source to the target HDMI channel in step 660, the controller is also configured to adjust the state of the peripheral linkage switch. Taking Figure 7 as an example, Figure 14 shows a flowchart of another channel switching method in a smart TV in some embodiments of this application. As shown in Figure 14, the controller is also configured to:

[0331] S710: Obtain the status of the power-on peripheral linkage switch in the display device.

[0332] The smart TV has a power-on switch for this peripheral device linkage function in its settings, which can be controlled by the user and is usually off by default.

[0333] After obtaining the power-on peripheral linkage switch, determine whether the power-on peripheral linkage switch is in the on state.

[0334] If the power-on peripheral linkage switch is in the off state, execute: S720, adjust the state of the power-on peripheral linkage switch to the on state.

[0335] It should be understood that if the status of the power-on peripheral linkage switch is changed from off to on, the user should be prompted with "The power-on peripheral linkage switch has been automatically turned on" via voice or question.

[0336] If the power-on peripheral linkage switch is in the on state, or the power-on peripheral linkage switch is adjusted to the on state, the external device connected to the target HDMI channel can be woken up through the CED protocol while the external device corresponding to the target HDMI channel is in sleep state, saving users time.

[0337] It should be understood that waking up an external device can occur during the signal source channel switching process after the target HDMI channel has been determined. At this time, the channel switching process is also in progress. If the switching is completed but the external device has not yet been woken up, the monitor will briefly display a black screen. If the switching is completed and the external device is woken up, the external device's welcome screen will be displayed. After the welcome screen ends, the external device's main interface will be displayed. For example, if the external device is a gaming device, the gaming device's welcome screen will be displayed. After the welcome screen ends, the game interface will be displayed, and the game menu will automatically pop up, allowing users to set different game parameters and improve the gaming experience.

[0338] With the continuous development of technology, the scenarios for communication and connection between display devices and gaming devices are becoming increasingly diverse and amazing. In home entertainment applications, more and more users are gathering with family and friends on weekends or holidays, connecting their game consoles to large-screen smart TVs to experience the rich, immersive, and stunning audio-visual entertainment brought by large-screen gaming.

[0339] In this application scenario, the gaming device serves as the primary external device, communicating with the display device via an HDMI interface. To improve the user experience when switching channels in this scenario, these external devices can be categorized into gaming devices and non-gaming devices; that is, the service types of external devices can be divided into gaming types and non-gaming types.

[0340] Furthermore, when the keyword characterizes the external device service type as game type, the corresponding target HDMI channel is determined based on the keyword and mapping relationship.

[0341] In this application scenario, in order to improve the processing efficiency of voice data, the service type of external devices can be divided into game type or non-game type. For example, in a smart TV, "Game" can be used to identify game type and "No Game" can be used to identify non-game type.

[0342] In some embodiments, the display device includes a voice module, a signal source management module, a middleware module, and a display module. The software layered architecture of the display device is shown in Figure 4, wherein the voice module, the signal source management module, and the display module belong to the application layer, and the middleware module belongs to the system runtime library layer.

[0343] The voice module receives user-inputted voice commands and sends them to the server, as well as receives keywords from the server's parsing of the voice commands and analyzes the matching between keywords and mapping relationships. The signal source management module stores and displays each signal source connected to the display device in a list format, and switches the target HDMI channel and starts the display module when signal source channel switching is required. The middleware module is a module in the display device that further encapsulates the underlying hardware driver protocol. After encapsulation, it provides the HDMI protocol results to the application layer module. After receiving the start signal, the display module displays the content input from the external device.

[0344] The following detailed description is provided using the embodiment shown in Figure 15. Figure 15 illustrates an interaction diagram of a channel switching method in a smart TV according to some embodiments of this application. As shown in Figure 15, the method includes:

[0345] S801, the voice module receives voice commands.

[0346] S802, the voice module sends voice commands to the server and receives keywords sent by the server to the display device.

[0347] It should be understood that keywords can represent the name of an external device, the type of business of an external device, or the type of business of an external device such as a game.

[0348] S803, the voice module obtains the mapping relationship from the middleware module.

[0349] It should be understood that the mapping relationship is dynamically obtained and determined by the middleware module after the display device is powered on.

[0350] The middleware module has a preset interface encapsulated with the HDMI protocol. This preset interface is used to identify the device name of the external device with which the communication is connected, and to determine the service type corresponding to the device name based on the preset service type. In this preset interface, the service type can be determined according to the device name.

[0351] The default interface stores and identifies the HDMI channel identifier, device name, and service type in text format, which is easy for display devices to parse and generate.

[0352] For example, the default interface can store the information of the external device in the form of a JSON (JavaScript Object Notation) string, such as: {"HDMIId":"1282","DeviceName":"Xbox X","DeviceType":"Game"}, that is, the HDMI channel identifier is 1282, the connected external device is Xbox X, and the type of the external device is a game device.

[0353] The middleware module obtains information about different HDMI interfaces (i.e., HDMI channel identifier, device name, and service type) through a preset interface, and dynamically constructs a mapping relationship based on this information. It should be understood that the information of the corresponding HDMI interface can only be obtained when the display device and the external device are communicating.

[0354] Furthermore, the voice module can analyze the matching relationship between keywords and mapping relationships:

[0355] S804. When keywords represent the service type of external devices, the voice module determines the target HDMI channel corresponding to the keywords based on the keywords and mapping relationships.

[0356] It's acceptable. When the keyword represents the external device's service type as game, the voice module determines the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship.

[0357] Alternatively, in the case where the keyword represents the name of an external device, the voice module determines the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship.

[0358] S806, the voice module indicates that the signal source management module is switching the signal source.

[0359] S807: After receiving the channel switching instruction, the signal source management module sends the instruction to switch the signal source to the target HDMI channel to the middleware module.

[0360] The middleware module will obtain the status of the power-on peripheral linkage switch. If the power-on peripheral linkage switch is in the off state, it will adjust the status of the power-on peripheral linkage switch to the on state; if the power-on peripheral linkage switch is in the on state, it will maintain the on state.

[0361] With the power-on peripheral linkage switch on, switch the signal source from the current channel or operating system to the target HDMI channel.

[0362] In some embodiments, if the power-on peripheral linkage switch is in the off state, the signal source management module sets a preset flag to True, which is initially set to False. It should be understood that the preset flag transmits information about the power-on peripheral linkage switch being on, so that when the display module detects that the preset flag is True, it will display or play a prompt message or voice indicating that the power-on peripheral linkage switch is on.

[0363] S808, the middleware module notification display module displays the content input from the external device corresponding to the target HDMI channel.

[0364] It should be understood that the middleware module starts the display module and carries a preset flag.

[0365] The middleware module detects the status of the external device corresponding to the target HDMI channel. If the external device is in standby mode, the middleware module wakes up the external device corresponding to the target HDMI channel through the CEC protocol.

[0366] In some embodiments, in order to improve the user experience after switching to the target HDMI channel, the display mode of the display device is also adjusted to a preset mode, which is determined by the service type of the external device corresponding to the target HDMI channel.

[0367] The display mode includes image mode and sound mode. For example, if the service type of the external device corresponding to the target HDMI channel is game, then both the image mode and sound mode will be adjusted to game mode.

[0368] In some embodiments, the middleware module can also control the display module to present a menu about display settings, allowing users to adjust display parameters as needed.

[0369] S809 The display module displays the content input from the external device corresponding to the target HDMI channel on the monitor.

[0370] It should be understood that when the display module detects that the preset flag is True, it will pop up or play a prompt message or voice message indicating that the power-on peripheral linkage switch is turned on.

[0371] It should also be understood that the Android operating system's display consists of two layers (upper and lower). The first layer (upper layer) is the OSD (On-Screen Display) layer, which is the interface displayed by applications, the operating system, etc. The second layer (lower layer) is the Video layer, which is the interface displayed by external devices. Therefore, when displaying the content input from the external device corresponding to the target HDMI channel, the OSD layer needs to be set to a transparent interface to display the content input from the external device in the Video layer.

[0372] In some embodiments, during the keyword and mapping matching process, there may be one or more matching external devices to accurately match the target HDMI channel corresponding to the voice command; Figure 16 shows an interaction diagram of another channel switching method in a smart TV in some embodiments of this application. As shown in Figure 16, the signal source management module further includes a signal source submodule and a transition submodule. The method includes:

[0373] S801, the voice module receives voice commands.

[0374] S802, the voice module sends voice commands to the server and receives keywords sent by the server to the display device.

[0375] S803, the voice module obtains the mapping relationship from the middleware module.

[0376] Furthermore, the voice module can analyze the matching of keywords and mapping relationships, including matching keywords with device names in the mapping relationship when the keywords represent external device names; or matching keywords with service types in the mapping relationship when the keywords represent external device service types.

[0377] S841, the voice module matches an external device in the mapping relationship and determines the signal source channel corresponding to the external device as the target HDMI channel.

[0378] S842, the voice module indicates the transition submodule to switch signal sources.

[0379] Additionally, S851 and the voice module match M external devices in the mapping relationship and determine the list of signal sources corresponding to the M external devices.

[0380] It should be understood that M is an integer greater than 1. The signal source list can be a first signal source list or a second signal source list, wherein the first signal source list is determined according to the order of the HDMI interfaces corresponding to the M external devices, and the second signal source list is determined according to the historical usage data of the M external devices.

[0381] S852, the voice module sends the list of signal sources to the display module.

[0382] S853, The display module presents a list of signal sources corresponding to M external devices.

[0383] S854, the signal source submodule determines the target HDMI channel based on the first selection command. It should be understood that the first selection command is a command determined by the user based on the signal source list, either through voice or manual input.

[0384] S855, the signal source submodule indicates the transition submodule to switch the signal source.

[0385] After receiving the channel switching command, the S871 transition submodule sends the command to switch the signal source to the target HDMI channel to the middleware module.

[0386] S808, the middleware module notification display module displays the content input from the external device corresponding to the target HDMI channel.

[0387] S809 The display module displays the content input from the external device corresponding to the target HDMI channel on the monitor.

[0388] It should be understood that there are also cases where there is no matching information between the keywords and the mapping relationship. That is, among the external devices communicating with the display device, there is no device that matches the keyword. Therefore, for the content shown in Figure 15 or Figure 16, Figure 17 shows an interaction diagram of another channel switching method in a smart TV in some embodiments of this application. As shown in Figure 17, the method includes:

[0389] If no external device corresponding to the keyword is matched in the mapping relationship, the following process is executed:

[0390] S811: If the voice module does not match an external device in the mapping relationship, it generates a resource request command corresponding to the keyword.

[0391] S812, Send the resource request command to the server.

[0392] S813: Receive the target resource sent by the server to the display device and display it.

[0393] If no external device corresponding to the keyword is matched in the mapping relationship, the following process is executed:

[0394] S821, The voice module was not matched with an external device in the mapping relationship.

[0395] S822: Obtain the local application corresponding to the keyword from the operating system.

[0396] S823. If the number of local applications is 0, retrieve the business zone resources corresponding to the keywords from the operating system's server and display them.

[0397] S824. If the number of local applications is 1, control the operating system to start the local application.

[0398] S825. If the number of local applications is N, display the application list corresponding to each local application, and, in response to the user's third selection instruction, launch the first application based on the first application corresponding to the third selection instruction.

[0399] It should be understood that the sequence numbers of the processes in the above embodiments do not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention. The various embodiments described herein can be independent solutions or combinations based on internal logic, and all such solutions fall within the protection scope of this application.

[0400] It should also be understood that the execution order of the steps in the flowcharts of the above embodiments is not strictly limited, and these steps can be executed in other orders. Moreover, at least some steps in the flowchart may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0401] This application embodiment can divide the display device into functional modules based on the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware or as software functional modules. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, other feasible division methods may exist. The following description uses the division of functional modules according to each function as an example.

[0402] The channel switching method of the present application embodiments has been described in detail above with reference to Figures 5 to 17. The device embodiment of the present application will be described in detail below with reference to Figure 18. It should be understood that the channel switching device in the embodiments of the present application can execute the various channel switching methods of the aforementioned embodiments of the present application. That is, the specific working processes of the various products below can be referred to the corresponding processes in the aforementioned method embodiments.

[0403] Figure 18 is a schematic diagram of a channel switching device provided in an embodiment of this application. It should be understood that the channel switching device can execute the channel switching methods shown in Figures 5 to 17; the channel switching device 900 includes a voice unit 910, a signal source management unit 920, and a display unit 930, wherein:

[0404] The voice unit 910 is used to respond to voice commands entered by the user and to receive keywords obtained by the server after parsing the voice commands.

[0405] When the keyword represents the service type of the external device, the voice unit 910 is used to determine the target HDMI channel corresponding to the keyword based on the keyword and the mapping relationship, which includes the HDMI channel identifier and the service category of the external device.

[0406] The signal source management unit 920 is used to switch the signal source channel to the target HDMI channel.

[0407] Display unit 930 is used to display on the display the content input from the external device corresponding to the target HDMI channel.

[0408] Each unit module of the channel switching device can execute the corresponding steps in the above method embodiment, so the details of each unit module will not be elaborated here. Please refer to the description of the corresponding steps above for details.

[0409] It should be noted that the aforementioned channel switching device is embodied in the form of a functional unit. The term "unit" here can be implemented in software and / or hardware, without specific limitations.

[0410] For example, a "unit" can be a software program, hardware circuitry, or a combination of both that implements the above-described functions. Hardware circuitry may include application-specific integrated circuits (ASICs), electronic circuitry, a processor (e.g., a shared processor, a proprietary processor, or a group processor) and memory for executing one or more software or firmware programs, integrated logic circuitry, and / or other suitable components that support the described functions.

[0411] Therefore, the units of the various examples described in the embodiments of this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0412] As shown in Figures 1 and 2, the display device 200 can be used to implement the channel switching method described in the above method embodiments.

[0413] The display device 200 may include one or more memories storing programs that can be run by the controller 250 to generate instructions, causing the controller 250 to execute the channel switching method described in the above method embodiments according to the instructions.

[0414] Optionally, the memory may also store data. Optionally, the controller 250 may also read data stored in the memory, which may be stored at the same memory address as the program, or the data may be stored at a different memory address than the program.

[0415] The controller 250 and the memory can be configured separately or integrated together; for example, integrated on the system-on-chip (SOC) of the terminal device.

[0416] This application also provides a computer program product that, when executed by the controller 250, implements the channel switching method of any method embodiment in this application.

[0417] The computer program product can be stored in memory, for example, as a program. The program is eventually converted into an executable object file that can be executed by the controller 250 after processes such as preprocessing, compilation, assembly and linking.

[0418] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the channel switching method of any method embodiment in this application. The computer program may be a high-level language program or an executable object program.

[0419] The computer-readable storage medium is, for example, memory. Memory can be volatile or non-volatile, or it can include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0420] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0421] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0422] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0423] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0424] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for example, the division of units is merely a logical functional division, and there may be other division methods in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0425] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display device, characterized in that, include: monitor; At least one HDMI port; The controller is configured as follows: In response to a user-inputted voice command, the system receives keywords obtained by parsing the voice command, the keywords being used to characterize the service type of the external device; Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword. The mapping relationship is dynamically established based on the device name of any external device read, the preset service type corresponding to the device name, and the HDMI channel identifier corresponding to its HDMI transmission channel.

2. The display device according to claim 1, characterized in that, Before executing a voice command input by the user and receiving keywords derived from the parsed voice command that characterize the service type of the external device, the controller is further configured to: If any number of external devices are detected, the HDMI channel identifier corresponding to the connection of any number of external devices is read. Obtain the device names of any number of external devices based on the CEC protocol; Based on the matching relationship between the device name and the preset service type, the service type corresponding to the external device is determined; Establish a set of mapping relationships between the service types of any of the external devices and their corresponding HDMI channel identifiers.

3. The display device according to claim 1, characterized in that, The controller determines whether a mapping relationship exists between the keyword and the HDMI channel identifier for indicating channel switching. If a mapping relationship exists between the keyword and the HDMI channel identifier, a channel switching instruction is generated and configured as follows: Upon receiving a keyword representing the service type of an external device, obtained by parsing the voice command, the keyword is matched with the service type in the mapping relationship; If the keyword matches the service type in the mapping relationship, then it is determined that the keyword has a mapping relationship with the HDMI channel identifier for indicating channel switching; Based on the mapping relationship, the target HDMI channel corresponding to the keyword is determined, and the channel switching instruction is generated.

4. The display device according to claim 3, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If an external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.

5. The display device according to claim 3, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If M external devices are matched in the mapping relationship, a first signal source list corresponding to the M external devices is displayed on the display, where M > 1; In response to the user's first selection command, the target HDMI channel is determined based on the external device corresponding to the first selection command.

6. The display device according to claim 3, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If M external devices are matched in the mapping relationship, the user's historical usage data for the M external devices is obtained, where M > 1; Based on the historical usage data, a second signal source list corresponding to M external devices is determined, and the second signal source list is displayed on the display. In response to the user's second selection command, the target HDMI channel is determined based on the external device corresponding to the second selection command.

7. The display device according to claim 3, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; If the number of local applications is 0, the business zone corresponding to the keyword will be displayed.

8. The display device according to claim 3, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; If the number of local applications is 1, then the local application is started.

9. The display device according to claim 3, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no business type corresponding to the keyword is matched in the mapping relationship, obtain the local application corresponding to the keyword; If the number of local applications is N, display the application list corresponding to each local application, where N > 1; In response to a user's third selection instruction, the first application is launched based on the first application corresponding to the third selection instruction, wherein the local application includes the first application.

10. The display device according to claim 1, characterized in that, After executing the channel switching command, the controller is further configured to: Obtain the status of the power-on peripheral linkage switch in the display device; Adjust the status of the power-on peripheral linkage switch to the on state.

11. The display device according to claim 1, characterized in that, The controller, in response to a user-inputted voice command, is further configured to: Receive keywords and signal source identifiers used to characterize the service type of external devices, obtained by parsing the voice commands; The signal source identifier, the keyword, and a set of mapping data in the mapping relationship are matched. If the signal source identifier, the keyword, and a set of mapping data in the mapping relationship match completely, the target HDMI channel corresponding to the signal source identifier and the keyword is determined, and the channel switching instruction is generated.

12. The display device according to claim 1, characterized in that, The controller, in response to a user-inputted voice command, is further configured to: Receive keywords and signal source identifiers used to characterize the service type of external devices, obtained by parsing the voice commands; The signal source identifier, the keyword, and a set of mapping data in the mapping relationship are matched. If the signal source identifier, the keyword, and a set of mapping data in the mapping relationship do not match completely, a list of alternative channels is displayed. The list of alternative channels includes a set of mapping data in the mapping relationship that corresponds to the signal source identifier, and / or at least a set of mapping data that corresponds to the keyword. In response to the user's fourth selection command, the target HDMI channel is determined based on the external device corresponding to the fourth selection command.

13. The display device according to claim 1, characterized in that, The external device service types include game type and non-game type; the controller is also configured to: If the keyword represents the external device service type as game type, determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction.

14. The display device according to claim 1, characterized in that, The display device includes a voice module, a signal source management module, a middleware module, and a display module, and the controller is configured to: The voice module receives the voice command, sends the voice command to the server, and receives keywords sent by the server to the display device to characterize the service type of the external device; When the voice module determines that there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching, it generates the channel switching command. Upon receiving the channel switching instruction, the signal source management module switches the signal source to the target HDMI channel. It also notifies the display module to display the content input from the external device corresponding to the target HDMI channel on the display.

15. A display device, characterized in that, include monitor; At least one HDMI port; The controller is configured as follows: When an external device is connected to the display device via a first HDMI interface, a voice command recorded by the user is received, and the voice command is parsed to obtain identification information representing the external device. Based on the mapping relationship between the identification information and the first HDMI channel identifier, the signal source is switched to the external device corresponding to the identification information, wherein the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device; The mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device is connected to the first HDMI interface.

16. A display device, characterized in that, include: monitor; At least one HDMI port; The controller is configured as follows: In response to a user-inputted voice command, the system receives keywords used to represent the name of an external device, which are parsed from the voice command. Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If a mapping relationship exists, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword. The mapping relationship is a dynamic relationship established between the device name of any external device read through the CEC protocol and the HDMI channel identifier corresponding to its HDMI transmission channel.

17. The display device according to claim 16, characterized in that, Before executing a voice command input by the user and receiving keywords representing the name of an external device obtained by parsing the voice command, the controller is further configured to: If any number of external devices are detected, the HDMI channel identifier corresponding to the connection of any number of external devices is read. Obtain the device names of any number of external devices based on the CEC protocol; Establish a set of mapping relationships between any number of device names and their corresponding HDMI channel identifiers.

18. The display device according to claim 16, characterized in that, The controller determines whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If a mapping relationship exists, a channel switching command is generated and configured as follows: Upon receiving a keyword representing the name of an external device obtained from the parsing of the voice command, the keyword is matched with the device name in the mapping relationship; If the keyword matches the device name in the mapping relationship, it is determined that the keyword has a mapping relationship with the HDMI channel identifier for indicating channel switching; Based on the mapping relationship, the target HDMI channel corresponding to the keyword is determined, and the channel switching instruction is generated.

19. The display device according to claim 18, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If an external device is matched in the mapping relationship, the signal source channel corresponding to the external device is determined as the target HDMI channel.

20. The display device according to claim 18, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If M external devices are matched in the mapping relationship, a first signal source list corresponding to the M external devices is displayed on the display, where M > 1; In response to the user's first selection command, the target HDMI channel is determined based on the external device corresponding to the first selection command.

21. The display device according to claim 18, characterized in that, The controller, based on the mapping relationship, determines the target HDMI channel corresponding to the keyword and is configured as follows: If M external devices are matched in the mapping relationship, the user's historical usage data for the M external devices is obtained, where M > 1; Based on the historical usage data, a second signal source list corresponding to M external devices is determined, and the second signal source list is displayed on the display. In response to the user's second selection command, the target HDMI channel is determined based on the external device corresponding to the second selection command.

22. The display device according to claim 18, characterized in that, After matching the keyword with the device name in the mapping relationship, the controller is further configured to: If no device name corresponding to the keyword is matched in the mapping relationship, a resource request instruction corresponding to the keyword is generated and sent to the server; Receive target resources, wherein the target resources are resources that the server finds matching the keywords after extracting the keywords from the resource request instruction, and the target resources include purchase resources for external devices corresponding to the keywords, and / or video resources for external devices corresponding to the keywords; Display the target resource.

23. The display device according to claim 16, characterized in that, After executing the channel switching command, the controller is further configured to: Obtain the status of the power-on peripheral linkage switch in the display device; Adjust the status of the power-on peripheral linkage switch to the on state.

24. The display device according to claim 16, characterized in that, The controller, in response to a user-inputted voice command, is further configured to: Receive keywords and signal source identifiers used to represent the name of external devices, obtained by parsing the voice commands; Match the signal source identifier, the keyword, and a set of mapping data in the mapping relationship; If a match is found, the target HDMI channel corresponding to the signal source identifier and the keyword is determined, and the channel switching instruction is generated.

25. The display device according to claim 16, characterized in that, The controller, in response to a user-inputted voice command, is further configured to: Receive keywords and signal source identifiers used to represent the name of external devices, obtained by parsing the voice commands; Match the signal source identifier, the keyword, and a set of mapping data in the mapping relationship; If no complete match is found, a list of alternative channels is displayed; wherein, the list of alternative channels includes a set of mapping data corresponding to the signal source identifier in the mapping relationship, and / or at least a set of mapping data corresponding to the keyword; In response to the user's fourth selection command, the target HDMI channel is determined based on the external device corresponding to the fourth selection command.

26. The display device according to any one of claims 16 to 25, characterized in that, The keywords include the abbreviation of the external device, the full name of the external device, or information that represents the name of the external device.

27. The display device according to any one of claims 16 to 25, characterized in that, The external device includes a gaming device, and the display device is connected to the gaming device via the HDMI interface.

28. The display device according to claim 27, characterized in that, The controller is also configured to: Upon receiving a first keyword representing the name of a game device, obtained by parsing the voice command, the target HDMI channel corresponding to the first keyword is determined based on the first keyword and the mapping relationship; wherein, the keyword includes the first keyword.

29. The display device according to claim 16, characterized in that, The display device includes a voice module, a signal source management module, a middleware module, and a display module, and the controller is configured to: The voice module receives the voice command, sends the voice command to the server, and receives keywords sent by the server to the display device to represent the name of the external device; When the voice module determines that there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching, it generates the channel switching command. Upon receiving the channel switching instruction, the signal source management module switches the signal source to the target HDMI channel. It also notifies the display module to display the content input from the external device corresponding to the target HDMI channel on the display.

30. A display device, characterized in that, include monitor; At least one HDMI port; The controller is configured as follows: When an external device is connected to the display device via a first HDMI interface, a voice command recorded by the user is received, and the voice command is parsed to obtain identification information representing the external device. Based on the mapping relationship between the identification information and the first HDMI channel identifier, the signal source is switched to the external device corresponding to the identification information, wherein the first HDMI channel identifier is the channel identifier corresponding to the first HDMI interface in the display device; The mapping relationship between the identification information and the first HDMI channel identifier is dynamically established after the external device is connected to the first HDMI interface.

31. A channel switching method, characterized in that, Applied to the display device according to any one of claims 1 to 14, the channel switching method includes: In response to a user-inputted voice command, the system receives keywords obtained by parsing the voice command, the keywords being used to characterize the service type of the external device; Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If there is a mapping relationship between the keyword and the HDMI channel identifier, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword. The mapping relationship is dynamically established based on the device name of any external device read, the preset service type corresponding to the device name, and the HDMI channel identifier corresponding to its HDMI transmission channel.

32. A channel switching method, characterized in that, Applied to the display device according to any one of claims 16 to 29, the channel switching method includes: In response to a user-inputted voice command, the system receives keywords used to represent the name of an external device, which are parsed from the voice command. Determine whether there is a mapping relationship between the keyword and the HDMI channel identifier for indicating channel switching. If a mapping relationship exists, generate a channel switching instruction so that the content input by the external device can be displayed on the display. The channel switching instruction is used to indicate switching to the target HDMI channel mapped by the keyword. The mapping relationship is a dynamic relationship established between the device name of any external device read through the CEC protocol and the HDMI channel identifier corresponding to its HDMI transmission channel.

Images