Display control method and apparatus

Abstract

The present disclosure relates to a display control method and device. The method comprises: presenting target content; if it is determined that an information input condition is met during the presentation of the target content, sending a control instruction to a terminal connected to the smart display device, so that the terminal presents a corresponding input prompt in response to the control instruction and returns input information based on a detected input operation; and performing presentation control of the target content in response to the received input information. After the terminal is connected to the smart display device, the terminal can not only replace the traditional remote controller to realize remote control of the smart display device, but also enable users to input some complex information of the smart display device through the terminal, thereby simplifying the operation of the users, realizing linkage between the small screen of the terminal and the large screen of the smart display device, facilitating user operation, and enriching the user experience.

Description

Technical Field

[0001] This disclosure relates to the field of display control, and more particularly to a display control method and apparatus. Background Technology

[0002] With the continuous development of smart TVs, users' viewing needs are also gradually increasing. Currently, users need a remote control to control the smart TV when watching videos and other content. However, as the content available on smart TVs becomes more diverse and the control operations more complex, simply using a remote control is no longer sufficient to meet the diverse control needs of today's users. Optimizing smart TV control is a pressing technical problem that needs to be solved. Summary of the Invention

[0003] In view of this, the present disclosure provides a display control method and apparatus.

[0004] According to one aspect of this disclosure, a display control method is provided, applied to an intelligent display device, the method comprising:

[0005] Display target content, and if the information input conditions are met during the display of the target content, send a control command to the terminal connected to the smart display device, so that the terminal responds to the control command to display the corresponding input prompt, and returns input information to the smart display device based on the detected input operation;

[0006] In response to the received input information, the display control of the target content is performed.

[0007] In one possible implementation, the target content includes a search control, and the method further includes:

[0008] If it is determined that the search control has been triggered based on the user operation detected from the terminal, the search interface will be displayed as new target content, and the search input conditions in the information input conditions will be determined to be met; the control instruction includes a search input instruction corresponding to the search input conditions, the input prompt includes a search input prompt corresponding to the search input instruction, and the input information includes search keywords;

[0009] Specifically, in response to the received input information, the display control of the target content includes: in response to the search keyword, displaying the search results corresponding to the search keyword as new target content.

[0010] In one possible implementation, the target content includes a mode selection prompt, which reminds the user to select a target viewing mode from multiple available viewing modes. The method further includes:

[0011] If the selected target viewing mode is determined based on the user operation detected from the terminal, the target content is displayed according to the target viewing mode, and the mode input condition in the information input condition is determined to be satisfied; the control instruction includes a mode input instruction corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input instruction, and the input information includes mode association information corresponding to the target viewing mode that needs to be input;

[0012] The method of controlling the display of the target content in response to the received input information includes: displaying the target content in accordance with the mode association information in response to the mode association information.

[0013] In one possible implementation, the information input conditions further include question-and-answer input conditions, which include the time point at which the display of the target content reaches the point where a question and answer is required;

[0014] The control instructions include question-and-answer instructions corresponding to the question-and-answer input conditions, the input prompts include question-and-answer input prompts corresponding to the question-and-answer instructions, and the input information includes response information; the response information is the answer to the question displayed in the question-and-answer input prompts.

[0015] In one possible implementation, the method further includes:

[0016] During the playback of a video as the target content, if a bullet screen trigger command is received from the terminal, the playback of the video is paused. The bullet screen trigger command is generated by the terminal in response to a trigger operation on the displayed bullet screen input control.

[0017] In response to user comments from the terminal, continue playing the video and display the user comments;

[0018] The user's bullet comments are determined by the terminal based on the detected input operation after detecting the bullet comment trigger operation.

[0019] This disclosure also provides a display control device for use in a smart display device, the device comprising:

[0020] The content display module is used to display target content, and when it is determined that the information input conditions are met during the display of the target content, it sends a control command to the terminal connected to the smart display device, so that the terminal responds to the control command to display the corresponding input prompt, and returns input information to the smart display device based on the detected input operation;

[0021] The content display control module is used to control the display of the target content in response to the received input information.

[0022] In one possible implementation, the target content includes a search control, and the device further includes:

[0023] The search response module is used to display the search interface as new target content if the search control is triggered based on the user operation detected from the terminal, and to determine that the search input conditions in the information input conditions are met; the control instructions include search input instructions corresponding to the search input conditions, the input prompts include search input prompts corresponding to the search input instructions, and the input information includes search keywords;

[0024] Specifically, in response to the received input information, the display control of the target content includes: in response to the search keyword, displaying the search results corresponding to the search keyword as new target content.

[0025] In one possible implementation, the target content includes a mode selection prompt, which prompts the user to select a target viewing mode from multiple available viewing modes. The device further includes:

[0026] The mode selection module is used to display the target content according to the target viewing mode if the target viewing mode is selected based on the user operation detected from the terminal, and to determine the mode input condition in the information input condition; the control instruction includes a mode input instruction corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input instruction, and the input information includes mode association information that needs to be input corresponding to the target viewing mode;

[0027] The method of controlling the display of the target content in response to the received input information includes: displaying the target content in accordance with the mode association information in response to the mode association information.

[0028] In one possible implementation, the information input conditions further include question-and-answer input conditions, which include the time point at which the display of the target content reaches the point where a question and answer is required;

[0029] The control instructions include question-and-answer instructions corresponding to the question-and-answer input conditions, the input prompts include question-and-answer input prompts corresponding to the question-and-answer instructions, and the input information includes response information; the response information is the answer to the question displayed in the question-and-answer input prompts.

[0030] In one possible implementation, the device further includes:

[0031] The bullet screen response module is used to pause the playback of the video when a bullet screen trigger command is received from the terminal during the playback of the video as the target content. The bullet screen trigger command is generated by the terminal in response to the trigger operation of the displayed bullet screen input control.

[0032] The bullet screen display module is used to respond to user bullet screens from the terminal, continue playing the video and display the user bullet screens;

[0033] The user's bullet comments are determined by the terminal based on the detected input operation after detecting the bullet comment trigger operation.

[0034] According to another aspect of this disclosure, a display control method is provided, the method being applied to a terminal, the method comprising:

[0035] The system displays a corresponding input prompt in response to a control command from a connected smart display device, wherein the control command is issued by the smart display device when it determines that the information input conditions are met during the display of target content;

[0036] The input information determined based on the detected input operation in response to the input prompt is sent to the smart display device, so that the smart display device responds to the input information to control the display of the target content.

[0037] According to another aspect of this disclosure, a display control device is provided, which is applied to a terminal, the device comprising:

[0038] An input prompt display module is used to display corresponding input prompts in response to control commands from a connected smart display device. The control commands are issued by the smart display device when it determines that the information input conditions are met during the display of target content.

[0039] An input information recognition module is used to send input information determined based on the detected input operation in response to the input prompt to the smart display device, so that the smart display device responds to the input information to control the display of the target content.

[0040] According to another aspect of this disclosure, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described method when executing instructions stored in the memory.

[0041] According to another aspect of this disclosure, a non-volatile computer-readable storage medium is provided that stores computer program instructions thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.

[0042] According to another aspect of this disclosure, a computer program product is provided, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described method.

[0043] The display control method and apparatus provided in this disclosure, after the terminal is connected to the smart display device, can not only replace the traditional remote control to remotely control the smart display device, but also allow users to input complex information about the smart display device through the terminal, simplifying user operations and realizing the linkage between the small screen of the terminal and the large screen of the smart display device, making it easier for users to operate and enriching their user experience.

[0044] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0045] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this disclosure together with the specification and serve to explain the principles of this disclosure.

[0046] Figure 1 A flowchart of a display control method according to an embodiment of the present disclosure is shown.

[0047] Figure 2 This diagram illustrates the interface changes for viewing modes in a display control method according to an embodiment of the present disclosure.

[0048] Figure 3 This diagram illustrates the interface changes for searching in a display control method according to an embodiment of the present disclosure.

[0049] Figure 4This diagram illustrates the interface changes for bullet comments in a display control method according to an embodiment of the present disclosure.

[0050] Figure 5 This diagram illustrates the interface changes for question-and-answer purposes in a display control method according to an embodiment of the present disclosure.

[0051] Figure 6 This is a block diagram illustrating a display control device 800 according to an exemplary embodiment. Detailed Implementation

[0052] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0053] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0054] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0055] In related technologies, when users watch videos and other content on smart display devices such as smart TVs, in addition to using a remote control for playback control, they can also use mobile phones and other terminals to control the smart TV instead of a remote control. However, in related technologies, mobile phones and other terminals can only replace the remote control and cannot simplify the operation.

[0056] To address the aforementioned technical problems, this disclosure provides a display control method and apparatus. After a terminal is connected to a smart display device, the terminal can not only replace a traditional remote control to remotely control the smart display device, but also allow users to input complex information about the smart display device through the terminal, simplifying user operations and enabling linkage between the small screen of the terminal and the large screen of the smart display device. This facilitates user operation and enriches the user experience.

[0057] like Figure 1 As shown, the display control method provided in this embodiment includes steps S101-102. This method is applied to a smart display device, which can be a device with a display screen that users can use to watch video and other content, such as a smart TV; this disclosure does not limit this.

[0058] In step S101, the intelligent display device can display target content, and if it determines that the information input conditions are met during the display of the target content, it determines that the user needs to input information for the target content, and sends a control command to the terminal connected to the intelligent display device, so that the terminal responds to the control command to display the corresponding input prompt, and returns the input information to the intelligent display device based on the detected input operation.

[0059] In step S102, in response to the received input information, the display control of the target content is performed.

[0060] In this embodiment, the target content can be videos such as TV series, movies, animations, short dramas, and short videos; audio such as songs and light music; or various text and image information from social media software, etc. This disclosure does not limit this. All content displayed to the user by the smart TV is target content, and for the sake of simplicity, the phrase "the content displayed by the smart TV is target content" will not be elaborated further below. Users can log in to the corresponding applications to watch this target content. During the viewing process, in some cases, the target content requires the user to input information (i.e., the user is passively required to input information, such as answering questions in the video), and in other cases, the user may need to actively input information according to their own preferences (such as sending bullet comments). The information input conditions can be set in advance based on these situations where the user needs to actively or passively input information. When the information input conditions are determined to be met, the smart display device will send a control command to the terminal connected to the smart display device, so that the terminal can respond to the control command to remind the user to input information through the terminal. Then, the smart display device will control the display of the target content based on the input information from the terminal.

[0061] In this embodiment, the connection between the smart display device and the terminal may include both being connected to the same local area network, or connecting via Bluetooth, etc. This disclosure does not limit the connection method between the smart display device and the terminal. For example, if the smart display device is a smart TV, the terminal connected to the smart TV can be a mobile phone on the same wireless network as the smart TV. The terminal connected to the smart display device can be an electronic device such as a mobile phone, tablet computer, or smartwatch, and this disclosure does not limit this.

[0062] In this embodiment, the input information can be text information that the user needs to input. However, since inputting text information via remote control is relatively complicated and inconvenient in related technologies, while the user inputs text through the terminal is simple and easy, the information input conditions can be determined when it is determined that the user needs to input text, and the user needs to input information for the target content. Then, the terminal is controlled by control commands to remind the user to input in order to obtain the user's input information.

[0063] In this embodiment, information input conditions can be preset according to the scenario where users need to input information and the type of target content, and control commands to be sent and input prompts to be displayed to users for different information input conditions can be matched and set to simplify the user's operation in the process of controlling the smart display device through the terminal and inputting information, thereby improving the user experience.

[0064] In this embodiment, the method may include: before step S101, in response to user operation, controlling the smart display device to establish a connection with the terminal, and controlling the terminal to display a corresponding control interface to the user. For example... Figures 2-5 As shown, the control interface may include the following controls: up control, down control, confirm control, left control, right control, back control (which allows the terminal to return to the previous screen when triggered), back control (which allows the terminal to return to the previous screen when triggered), etc. During the viewing of different target content, the up, down, left, and right controls can be assigned corresponding functions according to the different target content. For example, if the target content is a video, the up and down controls can be used as volume up and volume down controls respectively, and the left and right controls can be used as controls to play the previous video and the next video respectively. The type and function of the controls in the control interface corresponding to different target content display processes can be set according to the actual playback control requirements of the target content; this disclosure does not impose any restrictions on this.

[0065] To further illustrate the display control method provided in the embodiments of this disclosure, the following is combined with... Figures 2-5 The following examples illustrate the method, showing how a smart TV can be used as a smart display device and a mobile phone can be used as a terminal connected to the smart display device.

[0066] To cater to the viewing needs of users of different ages, the application allows for pre-setting different viewing modes for youth, children, and the elderly. Before a user opens the application on their smart TV and begins viewing content, the smart TV will display a preview such as… Figure 2The mode selection prompt shown reminds the user to choose a viewing mode from the available options as the target viewing mode for subsequent content viewing. Available viewing modes may include standard mode, children's mode, and senior mode. The mode selection prompt may include multiple mode controls, each corresponding to a different viewing mode; for example, the mode controls may include standard mode controls, children's mode controls, and senior mode controls. During the process of the smart TV displaying the mode selection prompt to the user, the terminal can display... Figure 2 The control interface shown allows users to perform actions related to mode selection prompts by manipulating the controls within it. For example, users can adjust the selected mode control in the mode selection prompt by manipulating the left and right controls, and then confirm the selection by triggering the confirmation control (such as...). Figure 2 The "OK" control shown identifies the selected mode control and its corresponding viewing mode as the target viewing mode. After detecting the user actions on the control interface, the terminal will synchronize these actions to the smart TV. Then, as shown... Figure 2 As shown, the smart TV can determine the selected target viewing mode based on the user operation detected from the terminal, and then display the target content according to the target viewing mode. During this process, the target content displayed to the user changes from the previously displayed mode selection prompt to the interface corresponding to the target viewing mode (that is, the homepage or other interface of the application is displayed according to the target viewing mode).

[0067] Once the smart TV determines that the user has selected a target viewing mode, it can determine that the mode input condition in the information input conditions is met, that is, it determines that the user needs to input information. It can then send a mode input instruction (i.e., a control instruction) corresponding to the mode input condition to the user. This mode input instruction is used to instruct the terminal to display a mode input prompt to remind the user to input mode-related information. In other words, the control instruction includes the aforementioned mode input instruction, the input prompt includes the aforementioned mode input prompt, and the input information includes mode-related information. In some embodiments, after receiving the mode input instruction, the terminal can... Figure 2 The image shows a user-input pattern prompt. The terminal then responds to the user's input operation in response to this prompt, determines the pattern association information entered by the user, and sends this information to the smart TV. Upon receiving the pattern association information, the smart TV can execute step S102. Step S102 regarding the pattern association information may include responding to the pattern association information, such as... Figure 2 The target content is displayed in a manner corresponding to the pattern association information.

[0068] In this embodiment, the mode association information that requires user input can be set according to different viewing modes. For example, for the children's mode, the mode association information may include information set by the user for the child user that is suitable for the child's age, eye health, and other related information. The mode association information may include: the child user's nickname (also known as a baby nickname), the child user's birthday, gender, and other basic information related to the child user. For the child user's blacklist, the user can set the types and durations of content that the child user is not allowed to view, as well as one or more specific TV series, movies, etc., that are prohibited from being viewed. For the child user's child lock, the child lock is used to prevent the child user from watching non-children's content, prevent the child user from sharing location, etc. For the child user's vision protection, the vision protection can limit the threshold for each viewing session, the daily viewing time threshold, and the weekly cumulative viewing time threshold, so that once the child user's viewing time reaches the above thresholds, content display to the child user will stop. The system targets specific time periods during which a child user is prohibited from watching content, allowing the system to prevent the child user from viewing content during those periods.

[0069] In some embodiments, modal input prompts may also include, for example: Figure 2 The report includes a child's growth report, which analyzes the child's viewing habits to summarize their preferences and viewing behaviors. This allows users to understand the child's viewing situation based on the report and further set and modify pattern association information for the child.

[0070] It is understandable that corresponding mode association information can also be set for standard mode and senior mode. For example, the mode association information for standard mode and senior mode can also include user basic information, blacklist, mode lock (similar to the above-mentioned child lock), vision protection, prohibited viewing time period, etc. This disclosure does not impose any restrictions on this.

[0071] In this way, users can input the mode association information for different viewing modes through the terminal, which simplifies the user operation, improves the ease of use of smart TVs, and realizes the linkage between smart TVs and terminals such as mobile phones, giving users a better interactive experience.

[0072] Correspondingly, users can also make other content-related settings, such as setting the video playback speed, video and audio playback volume, smart TV brightness, account login, first-time account login settings, setting account avatar, etc. The method may further include: if it is determined that the user needs to make settings based on user operations detected from the terminal, then the settings interface corresponding to the user operation is displayed as the target content, and it is determined that the settings input conditions in the information input conditions are met, thereby determining that the user needs to input information for the target content; the control command includes a settings input command corresponding to the settings input conditions, the input prompt includes a settings input prompt corresponding to the settings input command, and the input information includes the settings information entered by the user. Step S102 may include: in response to the settings information, displaying the settings result corresponding to the settings information in the settings interface.

[0073] When watching content on a smart TV, users sometimes need to search for content they like. The relevant technology allows users to input search keywords in the following way: by controlling the remote control... Figure 3 The text is entered using the keyboard on the smart TV shown, and then the smart TV can... Figure 3 The input box shown displays the search keywords entered by the user, and the search results corresponding to the search keywords are displayed after the user confirms the search using the remote control. However, text input via remote control is complex and inconvenient. In the display control method provided in this embodiment, the smart TV displays target content to the user that includes... Figure 3 In the case of the search control shown, since the smart TV and the terminal are already connected, the user can trigger the search control displayed on the smart TV by operating the controls in the control interface shown on the terminal. When the smart TV determines that the search control has been triggered based on the user operation detected from the terminal, as follows... Figure 3 The search interface is displayed as the target content. When the search control is triggered, the smart TV can determine if the search input conditions in the information input conditions are met, and then execute step S101 to send the search input command corresponding to the search input conditions as a control command to the terminal. After receiving the search input command, the terminal can respond to the search input command by displaying the following to the user: Figure 3 The search input suggestion shown is used to remind users to enter search keywords according to their search needs. The search input suggestion may include an input keyboard and an input box. Users can use the input keyboard on their terminal to enter search keywords corresponding to the content they want to search for (e.g., ...). Figure 3In the video shown in a), the search keyword can be the name or type of content, etc., and this disclosure does not limit this. Then, upon detecting a confirmation operation for the search keyword, the terminal can send the search keyword as input information to the smart TV. After receiving the search keyword, the smart TV executes step S102, which may include: in response to the search keyword, sending... Figure 3 The search results corresponding to the search keywords are displayed as new target content. In some embodiments, the terminal can send the search keywords to a server (such as the server of the current application), and the server will then send the search results to the smart TV. After receiving the search keywords, the smart TV will display the search results corresponding to those keywords from the server as target content to the user.

[0074] In this way, when users need to search, they can input search keywords through the terminal, view the search interface on the smart TV, and see the search results displayed, which provides convenience for users, improves the speed and efficiency of content search, and gives users a better interactive experience.

[0075] Regarding the use of smart TVs, users can actually watch videos on them, and during the viewing process, they may participate in interactive activities such as sending bullet comments. This method can also include: smart TVs such as... Figure 4 As shown, during the process of controlling the display screen to play video as the target content, the terminal can be controlled to display to the user, such as... Figure 4 The control interface shown corresponds to video playback and can display bullet screen input controls and bullet screen input boxes (such as...). Figure 4 The text shows a bullet screen input control ("Send Bullet Screen") and an input box in front of it, prompting the user to input a bullet screen comment. If the terminal detects a trigger operation on the bullet screen input control, it can generate a bullet screen trigger command and send it to the smart TV. Upon receiving the bullet screen trigger command, the smart TV will... Figure 4 The video playback is paused as shown. After detecting a trigger operation on the bullet screen input control, the terminal can then... Figure 4 The image shows a prompt for the user to input a comment, reminding the user to enter the comment they want to send.

[0076] In some embodiments, the bullet screen input prompt may include an input box, a keyboard for inputting text, selection controls for inputting emoticons, etc. During the process of displaying the bullet screen input prompt to the user, the terminal determines the user's bullet screen based on the detected input operation in response to the prompt and sends the user's bullet screen as input information to the smart TV. After receiving the user's bullet screen, the smart TV can respond to the user's bullet screen from the terminal, such as... Figure 4 The video continues to play and the user's comments are displayed (i.e., the comments determined by the terminal based on the detected input).

[0077] In some embodiments, the bullet screen input prompts can also be used to remind users of the playback progress of the video being played on the smart TV, remind users to turn the bullet screen in the video on / off, remind users to adjust the playback speed of the video, remind users to adjust the video resolution, remind users to select episodes of the video, etc. Corresponding controls can be set for these prompts so that users can make corresponding adjustments to the video being played on the smart TV by operating the corresponding controls.

[0078] The example of determining and displaying user comments for the target content described above can be executed alone, or it can be executed together with the example described in other examples of this document, which is "based on the terminal responding to the control command and displaying the corresponding input prompt, and then controlling the display of the target content according to the input information returned by the detected input operation". This disclosure does not limit this.

[0079] In this way, while watching videos on a smart TV, users can directly perform actions such as sending bullet comments on the video through the terminal, which meets various needs of users during video viewing, improves the ease of use of smart TVs, realizes the linkage between smart TVs and terminals such as mobile phones, and provides users with a better interactive experience.

[0080] In some scenarios, smart TVs may present content to users with questions that require answers. Therefore, the timing of these questions and answers can be pre-set to determine the input conditions. The smart TV, when displaying content to the user... Figure 5 During the display of target content such as videos, if it is detected that the display of the target content reaches a point where a user needs to answer a question, it can be determined that the question-and-answer input conditions in the information input conditions are met. A question-and-answer instruction corresponding to the input conditions is then sent to the terminal. This instruction may carry the target question that the user needs to answer. In some embodiments, the instruction may also carry alternative answers for the target question that the user can choose. After receiving the instruction, the terminal responds by displaying the target content such as videos to the user. Figure 5The question-and-answer input prompt shown is to remind the user to answer the target question. Based on the detected user input operation in response to the question-and-answer input prompt, the terminal determines the user's answer to the target question and sends the response information as input information to the smart TV. The answer determined by the user for the target question can be selected from the candidate answers or can be directly entered by the user; this disclosure does not impose any restrictions. After receiving the response information, the smart TV executes step S102 as described above.

[0081] The display control of the target content in response to the reply information in step S102 may include any of the following:

[0082] The subsequent content corresponding to the answer information within the target content is displayed as new target content. For example, the target content could be a quiz game, and the target questions could be questions from various levels of the game. The subsequent content corresponding to that game can be determined and displayed to the user based on whether the user's answer to the target question matches the actual correct answer. If the user's answer to the target question differs from the actual correct answer, a level failure message can be displayed as subsequent content to remind the user that they failed and need to answer the question again. If the user's answer to the target question matches the actual correct answer, a level success message can be displayed as subsequent content to remind the user that they succeeded and can continue to the next level.

[0083] During the display of the target content, a reward corresponding to the user's response to the target question is displayed. This reward can be points, gifts, etc., and this disclosure does not limit its scope. For example, the target content can be a game, and the target question can be a reward question in the game. A corresponding reward can be generated based on the user's response to the target question and then displayed in the game interface. Similarly, the target content can be a video, and the target question can be a speculative question about the video's plot. A corresponding reward can be generated based on the degree to which the user's response to the target question matches the actual development of the video's plot and then displayed during video playback.

[0084] This disclosure also provides a display control device for use in a smart display device, the device comprising:

[0085] The content display module is used to display target content, and when it is determined that the information input conditions are met during the display of the target content, it sends a control command to the terminal connected to the smart display device, so that the terminal responds to the control command to display the corresponding input prompt, and returns input information to the smart display device based on the detected input operation;

[0086] The content display control module is used to control the display of the target content in response to the received input information.

[0087] In one possible implementation, the target content includes a search control, and the device further includes:

[0088] The search response module is used to display the search interface as new target content if the search control is triggered based on the user operation detected from the terminal, and to determine that the search input conditions in the information input conditions are met; the control instructions include search input instructions corresponding to the search input conditions, the input prompts include search input prompts corresponding to the search input instructions, and the input information includes search keywords;

[0089] Specifically, in response to the received input information, the display control of the target content includes: in response to the search keyword, displaying the search results corresponding to the search keyword as new target content.

[0090] In one possible implementation, the target content includes a mode selection prompt, which prompts the user to select a target viewing mode from multiple available viewing modes. The device further includes:

[0091] The mode selection module is used to display the target content according to the target viewing mode if the target viewing mode is selected based on the user operation detected from the terminal, and to determine the mode input condition in the information input condition; the control instruction includes a mode input instruction corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input instruction, and the input information includes mode association information that needs to be input corresponding to the target viewing mode;

[0092] The method of controlling the display of the target content in response to the received input information includes: displaying the target content in accordance with the mode association information in response to the mode association information.

[0093] In one possible implementation, the information input conditions further include question-and-answer input conditions, which include the time point at which the display of the target content reaches the point where a question and answer is required;

[0094] The control instructions include question-and-answer instructions corresponding to the question-and-answer input conditions, the input prompts include question-and-answer input prompts corresponding to the question-and-answer instructions, and the input information includes response information; the response information is the answer to the question displayed in the question-and-answer input prompts.

[0095] In one possible implementation, the device further includes:

[0096] The bullet screen response module is used to pause the playback of the video when a bullet screen trigger command is received from the terminal during the playback of the video as the target content. The bullet screen trigger command is generated by the terminal in response to the trigger operation of the displayed bullet screen input control.

[0097] The bullet screen display module is used to respond to user bullet screens from the terminal, continue playing the video and display the user bullet screens;

[0098] The user's bullet comments are determined by the terminal based on the detected input operation after detecting the bullet comment trigger operation.

[0099] This disclosure also provides a display control method applied to a terminal, the method comprising:

[0100] The system displays a corresponding input prompt in response to a control command from a connected smart display device, wherein the control command is issued by the smart display device when it determines that the information input conditions are met during the display of target content;

[0101] The input information determined based on the detected input operation in response to the input prompt is sent to the smart display device, so that the smart display device responds to the input information to control the display of the target content.

[0102] This disclosure also provides a display control device applied to a terminal, the device comprising:

[0103] An input prompt display module is used to display corresponding input prompts in response to control commands from a connected smart display device. The control commands are issued by the smart display device when it determines that the information input conditions are met during the display of target content.

[0104] An input information recognition module is used to send input information determined based on the detected input operation in response to the input prompt to the smart display device, so that the smart display device responds to the input information to control the display of the target content.

[0105] It should be noted that although the above embodiments have been used as examples to illustrate the display control method and apparatus, those skilled in the art will understand that this disclosure is not limited thereto. In fact, users can flexibly set each step and module according to their personal preferences and / or actual application scenarios, as long as it conforms to the technical solution of this disclosure.

[0106] In some embodiments, the functions or modules of the apparatus provided in this disclosure can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0107] This disclosure also proposes a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the above-described method. The computer-readable storage medium can be volatile or non-volatile.

[0108] This disclosure also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0109] This disclosure also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described method.

[0110] Figure 6 This is a block diagram illustrating a display control device 800 according to an exemplary embodiment. For example, device 800 can be either the aforementioned terminal or the aforementioned smart display device, wherein the terminal can be an electronic device such as a mobile phone, computer, digital broadcasting terminal, messaging transceiver, game console, tablet device, medical device, fitness equipment, or personal digital assistant.

[0111] Reference Figure 6 The device 800 may include one or more of the following components: processing component 802, memory 804, power supply component 806, multimedia component 808, audio component 810, input / output interface 812 (I / O interface), sensor component 814, and communication component 816.

[0112] Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0113] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0114] Power supply component 806 provides power to various components of device 800. Power supply component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 800.

[0115] Multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0116] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0117] Input / output interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0118] Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or a component of device 800, the presence or absence of user contact with device 800, the orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0119] Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices. Device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0120] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0121] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions that can be executed by a processor 820 of the device 800 to perform the above-described method.

[0122] This disclosure can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this disclosure.

[0123] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0124] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0125] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0126] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0127] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0128] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0130] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A display control method, characterized in that, Applied to intelligent display devices, the method includes: Display target content, and in response to the user's operation detected by the terminal during the display of the target content, if the information input conditions are met, send a control command to the terminal connected to the smart display device, so that the terminal responds to the control command to display the corresponding input prompt, and returns the input information to the smart display device based on the detected input operation; In response to the received input information, control the display of the target content; The target content includes at least one of video, audio, and graphic information; The information input conditions are preset according to the scenario and / or type of target content that the user needs to input information, and the control commands and input prompts are matched with the information input conditions. The target content includes a mode selection prompt, which reminds the user to select a target viewing mode from multiple available viewing modes. The method further includes: If the selected target viewing mode is determined based on the user operation detected from the terminal, the target content is displayed according to the target viewing mode, and the mode input condition in the information input condition is determined to be satisfied; the control instruction includes a mode input instruction corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input instruction, and the input information includes mode association information corresponding to the target viewing mode that needs to be input; The method of controlling the display of the target content in response to the received input information includes: displaying the target content in accordance with the mode association information in response to the mode association information.

2. The method according to claim 1, characterized in that, The target content includes a search control, and the method further includes: If it is determined that the search control has been triggered based on the user operation detected from the terminal, the search interface will be displayed as new target content, and the search input conditions in the information input conditions will be determined to be met; the control instruction includes a search input instruction corresponding to the search input conditions, the input prompt includes a search input prompt corresponding to the search input instruction, and the input information includes search keywords; Specifically, in response to the received input information, the display control of the target content includes: in response to the search keyword, displaying the search results corresponding to the search keyword as new target content.

3. The method according to claim 1, characterized in that, The information input conditions also include question-and-answer input conditions, which include the time point at which the display of the target content reaches the point where a question and answer is required; The control instructions include question-and-answer instructions corresponding to the question-and-answer input conditions, the input prompts include question-and-answer input prompts corresponding to the question-and-answer instructions, and the input information includes response information; the response information is the answer to the question displayed in the question-and-answer input prompts.

4. The method according to claim 1, characterized in that, The method further includes: During the playback of a video as the target content, if a bullet screen trigger command is received from the terminal, the playback of the video is paused. The bullet screen trigger command is generated by the terminal in response to a trigger operation on the displayed bullet screen input control. In response to user comments from the terminal, continue playing the video and display the user comments; The user's bullet comments are determined by the terminal based on the detected input operation after detecting the bullet comment trigger operation.

5. A display control method, characterized in that, Applied to a terminal, the method includes: The system displays corresponding input prompts in response to control commands from the connected smart display device. These control commands are issued by the smart display device during the display of target content when the terminal detects user actions and determines that the information input conditions are met. The input information determined based on the detected input operation in response to the input prompt is sent to the smart display device, so that the smart display device responds to the input information to control the display of the target content; The target content includes at least one of video, audio, and graphic information; The information input conditions are preset according to the scenario and / or type of target content that the user needs to input information, and the control commands and input prompts are matched with the information input conditions. The target content includes a mode selection prompt, which reminds the user to select a target viewing mode from multiple available viewing modes. The method further includes: During the process of the smart display device displaying the mode selection prompt, the detected user operation for the viewing mode is sent to the smart display device, so that the smart display device determines the selected target viewing mode based on the user operation, displays the target content according to the target viewing mode, and determines that the mode input condition in the information input conditions is met; the control command includes a mode input command corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input command, and the input information includes mode association information corresponding to the target viewing mode that needs to be input; The intelligent display device controls the display of the target content in response to the input information, including: in response to the mode association information, displaying the target content in a manner corresponding to the mode association information.

6. A display control device, characterized in that, Applied to intelligent display devices, the device includes: The content display module is used to display target content, and in the process of displaying the target content, if the terminal detects the user's operation and determines that the information input conditions are met, it sends a control command to the terminal connected to the smart display device, so that the terminal responds to the control command to display the corresponding input prompt, and returns the input information to the smart display device based on the detected input operation; The content display control module is used to control the display of the target content in response to the received input information; The target content includes at least one of video, audio, and graphic information; The information input conditions are preset according to the scenario and / or type of target content that the user needs to input information, and the control commands and input prompts are matched with the information input conditions. The target content includes a mode selection prompt, which reminds the user to select a target viewing mode from multiple available viewing modes. The device also includes: The mode selection module is used to display the target content according to the target viewing mode if the target viewing mode is selected based on the user operation detected from the terminal, and to determine the mode input condition in the information input condition; the control instruction includes a mode input instruction corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input instruction, and the input information includes mode association information that needs to be input corresponding to the target viewing mode; The method of controlling the display of the target content in response to the received input information includes: displaying the target content in accordance with the mode association information in response to the mode association information.

7. A display control device, characterized in that, Applied to a terminal, the device includes: The input prompt display module is used to display corresponding input prompts in response to control commands from the connected smart display device. The control commands are issued by the smart display device in response to the user's operation detected by the terminal and the determination that the information input conditions are met during the display of target content. An input information recognition module is used to send input information determined based on the detected input operation in response to the input prompt to the smart display device, so that the smart display device responds to the input information to control the display of the target content; The target content includes at least one of video, audio, and graphic information; The information input conditions are preset according to the scenario and / or type of target content that the user needs to input information, and the control commands and input prompts are matched with the information input conditions. The target content includes a mode selection prompt, which reminds the user to select a target viewing mode from multiple available viewing modes. The device is also used to: During the process of the smart display device displaying the mode selection prompt, the detected user operation for the viewing mode is sent to the smart display device, so that the smart display device determines the selected target viewing mode based on the user operation, displays the target content according to the target viewing mode, and determines that the mode input condition in the information input conditions is met; the control command includes a mode input command corresponding to the mode input condition, the input prompt includes a mode input prompt corresponding to the mode input command, and the input information includes mode association information corresponding to the target viewing mode that needs to be input; The intelligent display device controls the display of the target content in response to the input information, including: in response to the mode association information, displaying the target content in a manner corresponding to the mode association information.

8. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method of any one of claims 1 to 5 when executing instructions stored in the memory.

9. A non-volatile computer-readable storage medium storing computer program instructions thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the method described in any one of claims 1 to 5.

10. A computer program product comprising computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, characterized in that, When the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the method according to any one of claims 1 to 5.

Images