Display device and display control method
By detecting whether the media data meets the screen projection conditions on the display device and prompting the user to adjust the resolution or frame rate, the problem of poor playback quality during screen projection is solved, and a higher playback success rate and user experience is achieved.
Patent Information
- Application Number
- CN202411979481.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-30
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2044-12-30
AI Technical Summary
In the prior art, the media content playback quality of the display device when casting the screen is poor, and there may be problems such as stuttering, screen loss or playback failure, affecting the user's viewing experience.
By implementing a control method on the display device, it detects whether the received multi-channel media data meets the screen projection conditions, and prompts the user to lower the resolution or frame rate to re-project the screen when the conditions are not met, so that each media data can be played simultaneously in the screen projection interface.
It improves the playback success rate and playback quality of multi-channel media data, improves the user's viewing experience, and avoids the user experience impact caused by the inability to play the screen projection data.
Smart Images

Figure CN119854554A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of display devices, and in particular to display devices and display control methods. Background Art
[0002] With the widespread use of smart devices, screen projection technology has gradually entered people's daily lives. Users can project images, videos, audio and other media content on one device to another device for display through Wi-Fi or Bluetooth, which can improve the flexibility and convenience of users in viewing media content.
[0003] However, as the quality of media content continues to improve and the operating conditions of display devices change, media content may experience freezes, screen distortion, or even playback failures when displayed on display devices, resulting in poor playback quality of the media content and affecting the user's viewing experience. Summary of the invention
[0004] Embodiments of the present application provide a display device, a display control method, an apparatus, and a storage medium, which are used to solve the problem of poor playback quality of media content projected by a display device in the prior art.
[0005] To achieve the above object, the embodiments of the present invention adopt the following technical solutions:
[0006] According to one aspect of an embodiment of the present application, a display device is provided, including: a display, configured to display a projection interface; a controller, coupled to the display and configured to: when playing first media data with first media parameters in a first projection window of the projection interface, in response to a second operation instruction for playing second media data in a second projection window, obtain second media parameters of the second media data; if it is determined that the second media data does not meet the projection condition, control the display to display first prompt information; the first prompt information is used to prompt the user to reduce the resolution or frame rate of the second media data to re-project, and keep playing the first media data in the first projection window; in response to the instruction for re-projecting in the second projection window, if it is determined that the re-projected third media data meets the projection condition, play the third media data in the second projection window, and continue to play the first media data in the first projection window, wherein the resolution or frame rate of the third media data is smaller than that of the second media data.
[0007] The above technical solution has the following advantages or beneficial effects: when the display device receives multiple channels of projected media data, the user is prompted to adjust the resolution of the media data according to the device performance parameters of the display device, so that each channel of media data can be played simultaneously in the projection interface. It can not only realize the playback of multiple channels of projected media data on the display device, but also prompt the user to select the projection of media data that matches the device performance parameters of the display device, avoiding the impact on user experience caused by directly disconnecting the projection when the projected media data cannot be played, and can improve the playback success rate and playback quality of multiple channels of media data, thereby enhancing the user viewing experience.
[0008] In some embodiments, the first media resource parameters include a first resolution and a first frame rate, and the second media resource parameters include a second resolution and a second frame rate; the controller is further configured to: calculate the first parameter based on a first algorithm for the first resolution and the first frame rate, and the second resolution and the second frame rate, wherein a comparison result between the first parameter and a preset second parameter determines whether the second media resource data meets the screen projection condition, and the preset second parameter is defined by a first performance parameter of the display device.
[0009] The above technical solution has the following advantages or beneficial effects: by calculating the first parameter based on the first algorithm for the first resolution and the first frame rate, the second resolution and the second frame rate, and determining whether the second media data meets the screen projection condition according to the comparison result of the first parameter and the preset second parameter, the device performance when the display device accesses the second media data can be predicted, and it can be determined whether the display device can continue to play the second media data while playing the first media data, so as to realize the device performance analysis when accessing multiple media data, and at the same time improve the accuracy of the analysis, locate the reason why the screen projection condition is not met, and provide assistance for user operation.
[0010] In some embodiments, the controller executes a calculation based on a first algorithm for the first resolution and the first frame rate, and the second resolution and the second frame rate to obtain a first parameter, and is specifically configured as: based on the first algorithm, calculating a first product of the first resolution and the first frame rate, and a second product of the second resolution and the second frame rate; based on the first product and the second product, determining the first parameter.
[0011] The above technical solution has the following advantages or beneficial effects: through the above method, the first parameter can be determined based on the product of the resolution and the frame rate, thereby improving the analyzability of determining the performance of the display device.
[0012] In some embodiments, the first media asset parameter includes the first media asset running memory occupancy, the second media asset parameter includes the second media asset running memory occupancy, and the controller is further configured to: calculate the second parameter based on the second algorithm for the first media asset running memory occupancy and the second media asset running memory occupancy, wherein the comparison result between the second parameter and a preset third parameter determines whether the second media asset data meets the screen projection condition, and the preset third parameter is defined by the second performance parameter of the display device.
[0013] The above technical solution has the following advantages or beneficial effects: by analyzing the relationship between the second parameter and the preset third parameter, it is possible to determine whether the running memory of the display device can support the playback of the second media data, that is, to determine whether the second media data meets the screen projection conditions.
[0014] In some embodiments, the controller is further configured to: if it is determined that the second media data meets the screen projection condition, continue to play the first media data in the first screen projection window, and play the second media data in the second screen projection window.
[0015] The above technical solution has the following advantages or beneficial effects: through this method, the display device can access and play multi-channel screen projection media data, providing users with a richer viewing experience.
[0016] In some embodiments, the controller executes control of the display to display a first prompt message, and is specifically configured as: when the window mode of the first projection window is the main window mode, and the window mode of the second projection window is the sub-window mode, the display is controlled to display the first prompt message to prompt the user to reduce the resolution or frame rate of the second media data to re-project, and to keep playing the first media data in the first projection window, and the window mode includes a main window mode and a sub-window mode.
[0017] The above technical solution has the following advantages or beneficial effects: by determining the window mode of the projection window and prompting the user to reduce the resolution or frame rate of the media data played in the sub-window mode and re-project the screen, it can provide users with operational guidance, improve the success rate of playing the projection media data, and avoid affecting the media data played in the projection window of the main window mode.
[0018] In some embodiments, the controller executes control of the display to display a first prompt message, and is specifically configured as: when the media transmission type of the first media data is the second transmission type, and the media transmission type of the second media data is the first transmission type, controlling the display to display the first prompt message to prompt the user to reduce the resolution or frame rate of the second media data to re-project the screen, and to keep playing the first media data in the first projection window.
[0019] The above technical solution has the following advantages or beneficial effects: by controlling the display to display the first prompt information according to the media transmission type of the media data to prompt the user to re-project the screen, operational guidance can be provided to the user to re-project the screen, thereby improving the success rate of screen projection.
[0020] In some embodiments, the controller is further configured to: send operation prompt information to the target terminal device that sends the second operation instruction, the operation prompt information including a first confirmation control and a first cancel control; the first confirmation control is used to prompt the user to confirm reducing the second media data or frame rate to re-project the screen, and the first cancel control is used to prompt the user to cancel reducing the second media data or frame rate to re-project the screen; in response to the user's selection operation on the first confirmation control, receive the re-projection instruction sent by the target terminal device.
[0021] The above technical solution has the following advantages or beneficial effects: the first confirmation control can provide users with a quick screen projection operation method, which is convenient for quickly initiating re-screen projection, so as to improve the timeliness and convenience of screen projection operations.
[0022] In some embodiments, the controller is further configured to: in response to the user's selection operation on the first cancel control, execute an operation of disconnecting the screen projection connection to stop receiving the re-screen projection instruction sent by the target terminal device.
[0023] The above technical solution has the following advantages or beneficial effects: when the user refuses to re-project the screen, the screen projection connection can be interrupted, so that resources such as the screen projection session occupied by the display device are released, while improving the operability of the screen projection.
[0024] In some embodiments, before playing the first media data with the first media parameters in the first projection window of the projection interface, the controller is further configured to: if it is determined that the first media data meets the single-channel projection condition, trigger the operation of playing the first media data with the first media parameters in the first projection window of the projection interface; if it is determined that the first media data does not meet the single-channel projection condition, control the display to display single-channel projection prompt information, and the single-channel projection prompt information is used to prompt the user to reduce the resolution or frame rate of the first media data to re-project; and, in response to the instruction for re-projecting in the first projection window, if it is determined that the fourth media data to be re-projected meets the single-channel projection condition, play the fourth media data in the first projection window, and the resolution or frame rate of the fourth media data is smaller than that of the first media data.
[0025] The above technical solution has the following advantages or beneficial effects: through this method, when the controller receives a channel of media data for screen projection, it can determine whether the display device can play the media data based on the performance parameters of the display device and the media parameters of the media data. If it cannot be played, the user is prompted to re-project new media data. Media data that meets the playback requirements of the display device can be obtained in an interactive manner, thereby ensuring the projection and playback quality of the media data.
[0026] In some embodiments, before playing the first media data with the first media parameter in the first projection window of the projection interface, the controller is further configured to: when the current projection mode of the display device is in the static split-screen mode, control the split-screen display of the projection interface, and display the first projection window and the second projection window in the split-screen display of the projection interface.
[0027] The above technical solution has the following advantages or beneficial effects: Through this method, guidance can be provided for users to select media data for screen projection, such as selecting how much media data to project, and which media data to play in which projection window.
[0028] In some embodiments, the controller is further configured to: before playing the first media data, if the current projection mode of the display device is in the dynamic split-screen mode, set the first projection window to a window displayed in full screen in the projection interface, and, based on the dynamic split-screen mode, scale the first projection window, and display the scaled first projection window and the second projection window in the projection interface, so as to continue to play the first media data in the scaled first projection window, and play the third media data in the second projection window.
[0029] The above technical solution has the following advantages or beneficial effects: through this method, when only the first media data is played, the first media data can be played in full screen mode, and when playing multiple screen-projected media data at the same time, the window can be dynamically adjusted and switched, thereby improving the flexibility of playing media data.
[0030] According to another aspect of an embodiment of the present application, a display device is provided, including: a display, configured to display a projection interface; a controller, coupled to the display and configured to: when playing first media data with first media parameters in a first projection window of the projection interface, in response to a second operation instruction for playing second media data in a second projection window, obtain second media parameters of the second media data; if it is determined that the second media data does not meet the projection condition, control the display to display second prompt information; the second prompt information is used to prompt the user to reduce the resolution or frame rate of the first media data to re-project, and play the second media data in the second projection window; in response to the instruction for re-projecting in the first projection window, if it is determined that the re-projected fifth media data meets the projection condition, play the fifth media data in the first projection window, and continue to play the second media data in the second projection window, wherein the resolution or frame rate of the fifth media data is smaller than that of the first media data.
[0031] The above technical solution has the following advantages or beneficial effects: when the display device receives multiple channels of projected media data, the user is prompted to adjust the resolution of the media data according to the device performance parameters of the display device, so that each channel of media data can be played simultaneously in the projection interface. It can not only play multiple channels of projected media data on the display device, but also prompt the user to select the media data that matches the device performance parameters of the display device, which can improve the playback success rate and playback quality of multiple channels of media data and enhance the user's viewing experience.
[0032] According to another aspect of an embodiment of the present application, a display control method is provided, which is applied to a display device, and the method includes: when playing first media data with first media parameters in a first projection window of a projection interface, in response to a second operation instruction for playing second media data in a second projection window, obtaining second media parameters of the second media data; if it is determined that the second media data does not meet the projection condition, controlling the display to display a first prompt message; the first prompt message is used to prompt the user to reduce the resolution or frame rate of the second media data to re-project, and keep playing the first media data in the first projection window; in response to an instruction for re-projecting in the second projection window, if it is determined that the re-projected third media data meets the projection condition, playing the third media data in the second projection window, and continuing to play the first media data in the first projection window, wherein the resolution or frame rate of the third media data is smaller than that of the second media data.
[0033] According to another aspect of an embodiment of the present application, a display control method is provided, which is applied to a display device, and the method includes: when playing first media data with first media parameters in a first projection window of a projection interface, in response to a second operation instruction for playing second media data in a second projection window, obtaining second media parameters of the second media data; if it is determined that the second media data does not meet the projection condition, controlling the display to display second prompt information; the second prompt information is used to prompt the user to reduce the resolution or frame rate of the first media data to re-project the screen, and play the second media data in the second projection window; in response to an instruction for re-projecting the screen in the first projection window, if it is determined that the re-projected fifth media data meets the projection condition, playing the fifth media data in the first projection window, and continuing to play the second media data in the second projection window, wherein the resolution or frame rate of the fifth media data is smaller than that of the first media data.
[0034] According to the display device and display control method provided by the embodiments of the present application, the display device can, when playing first media data with first media parameters in the first projection window of the projection interface, respond to a second operation instruction for playing second media data in the second projection window, obtain second media parameters of the second media data, and when it is determined that the second media data does not meet the projection conditions, control the display to display a first prompt message, and then respond to the user's instruction to re-project the screen in the second projection window, and when it is determined that the re-projected third media data meets the projection conditions, play the third media data in the second projection window, and continue to play the first media data in the first projection window, wherein the resolution or frame rate of the third media data is lower than that of the second media data.
[0035] By applying this solution, when the display device receives media data for multiple screen projections, the user can be prompted to adjust the resolution of the media data according to the device performance of the display device, so that each channel of media data can be played simultaneously in the screen projection interface. This not only makes it possible to play media data for multiple screen projections on the display device, but also prompts the user to select media data that matches the device performance of the display device for projection, thereby avoiding the impact on user experience caused by directly disconnecting the screen projection when the projected media data cannot be played, and can improve the playback success rate and playback quality of multiple media data, thereby enhancing the user viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0037] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;
[0038] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;
[0039] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;
[0040] Figure 4 A flow chart of a display control method provided in some embodiments of the present application;
[0041] Figure 5 A schematic diagram of device interaction provided in some embodiments of the present application;
[0042] Figure 6 A schematic diagram of a screen projection interface provided in some embodiments of the present application;
[0043] Figure 7 A schematic diagram of another screen projection interface provided in some embodiments of the present application;
[0044] Figure 8 A sub-flow chart of a display control method provided in some embodiments of the present application;
[0045] Fig. 9 A schematic diagram of another screen projection interface provided in some embodiments of the present application;
[0046] Fig.10A schematic diagram of another screen projection interface provided in some embodiments of the present application;
[0047] Fig.11 A schematic diagram of another screen projection interface provided in some embodiments of the present application;
[0048] Fig.12 A sub-flow chart of another display control method provided in some embodiments of the present application;
[0049] Fig.13 A schematic diagram of another screen projection interface provided in some embodiments of the present application;
[0050] Fig.14 A flowchart of another display control method provided in some embodiments of the present application;
[0051] Fig.15 A schematic diagram of another screen projection interface provided in some embodiments of the present application;
[0052] Fig.16 A flowchart of another display control method provided for some embodiments of the present application. DETAILED DESCRIPTION
[0053] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.
[0054] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0055] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0056] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0057] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0058] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.
[0059] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.
[0060] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.
[0061] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .
[0062] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0063] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.
[0064] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.
[0065] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.
[0066] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0067] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.
[0068] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.
[0069] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.
[0070] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.
[0071] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0072] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).
[0073] In some embodiments, the audio output interface 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.
[0074] In some embodiments, the user interface 280 may be configured to receive instructions input from a user.
[0075] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.
[0076] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.
[0077] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.
[0078] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, and screen projection applications that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.
[0079] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.
[0080] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0081] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.
[0082] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.
[0083] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0084] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.
[0085] In one aspect, an embodiment of the present invention provides a display control method. Figure 4 A flow chart of the display control method is shown, which can be applied to Figure 1 A display device 200 is shown.
[0086] The display device 200 (hereinafter referred to as the display device) may include a display 260 and a controller 250 coupled to the display 260. The display 260 may be used to display a screen projection interface. Exemplarily, the display device is a screen projection receiving device, which may be a television device, a screen projection device, a computer device, etc., which may receive an operation instruction for screen projection triggered by a user through a terminal device, and play corresponding media data on the screen projection interface according to the operation instruction. The terminal device may be a mobile phone, a tablet computer, a laptop computer, etc.
[0087] Among them, the screen projection interface is an interface used to display the media data of the projection. For example, the screen projection interface can be a video playback interface, an image display interface, etc. The user can play the projected video content through the video playback interface, or display the projected image data through the image display interface.
[0088] Depending on the type of display device, the screen projection function can be a system function of the display device or enabled through a screen projection application installed on the display device. Figure 5As shown, a screen projection application is installed on the display device. The display device can establish a screen projection connection with the terminal device through wireless network, USB, Bluetooth, etc. The user can use the terminal device to transmit screen projection data to the screen projection application based on the screen projection connection and perform screen projection interaction, etc. The screen projection application can also transmit control instructions, screen projection status and other information to the terminal device. The display device can create a player to play the media data received by the screen projection application. During the playback process, the display device can monitor its own device performance.
[0089] According to the display control method provided in the embodiment of the present application, the display device can, when playing first media data with first media parameters in the first projection window of the projection interface, respond to a second operation instruction for playing second media data in the second projection window, obtain second media parameters of the second media data, and when it is determined that the second media data does not meet the projection conditions, control the display to display a first prompt message, and then respond to the user's instruction to re-project the screen in the second projection window, and when it is determined that the re-projected third media data meets the projection conditions, play the third media data in the second projection window, and continue to play the first media data in the first projection window, wherein the resolution or frame rate of the third media data is lower than that of the second media data.
[0090] By applying this solution, when the display device receives media data for multiple screen projections, the user can be prompted to adjust the resolution of the media data according to the device performance of the display device, so that each channel of media data can be played simultaneously in the screen projection interface. This not only makes it possible to play media data for multiple screen projections on the display device, but also prompts the user to select media data that matches the device performance of the display device for projection, thereby avoiding the impact on user experience caused by directly disconnecting the screen projection when the projected media data cannot be played, and can improve the playback success rate and playback quality of multiple media data, thereby enhancing the user viewing experience.
[0091] like Figure 4 As shown, the controller 250 (hereinafter referred to as the controller) is configured to perform the following steps S410 to S430:
[0092] Step S410: When first media data having first media parameters are played in the first projection window of the projection interface, in response to a second operation instruction for playing second media data in the second projection window, second media parameters of the second media data are obtained.
[0093] Among them, the first projection window and the second projection window refer to the areas on the display of the display device that display different projection contents when performing the projection operation. Exemplarily, the window sizes of the first projection window and the second projection window can be the same or different. In some cases, in order to avoid overlap when playing media data, the first projection window and the second projection window can be set in two non-overlapping areas, such as on the left and right sides of the display in the horizontal direction.
[0094] In some cases, the first projection window and the second projection window can be divided into main and sub-windows. For example, the first projection window is the main window, which can be set in the center area of the display and can occupy a larger display area. The second projection window is the sub-window, which can be set in the surrounding area of the first projection window and can occupy a smaller display area. At this time, when the two projection windows do not overlap, the second projection window occupies a smaller display area.
[0095] In some other cases, when the first projection window and the second projection window are divided into primary and secondary windows, in order to increase the display area of the secondary window, such as the second projection window, the first projection window and the second projection window may partially overlap.
[0096] When casting the screen, the display device receives the operation instructions for casting the screen sent by the terminal device by starting the casting service or casting application. Exemplarily, according to the casting operation mode of wired casting and wireless casting, the terminal device can connect the terminal device and the display device through an HDMI cable and a corresponding adapter, and switch the input source of the display device to HDMI to send the casting operation instructions to the display device. In some examples, the terminal device can also use the wireless casting protocol to send the casting operation instructions to the display device, wherein the wireless casting protocol can include Miracast protocol, DLNA protocol, Airplay protocol, etc.
[0097] Specifically, the DLNA protocol is a multimedia device interconnection standard based on the UPnP protocol. When projecting the screen through the DLNA protocol, the terminal device can generate corresponding operation instructions based on the media data to be projected. The operation instructions include link information of the media data. Then, the terminal device sends the operation instructions to the display device. The display device obtains the media data from the media server according to the link information in the operation instructions, and plays the media data in the projection interface according to the media parameters of the media data.
[0098] Miracast protocol is a technology that projects the content displayed on the terminal device to the display device for display through Wi-Fi Direct technology. When projecting the screen through Miracast protocol, the terminal device can transmit data through the wireless connection between the terminal device and the display device without using any wired connection, send the operation instructions for projecting the screen to the display device, and when the display device feedbacks the confirmation instruction, transmit the media data displayed on the terminal device to the display device, so that the controller of the display device controls the display to play the media data in the projection interface.
[0099] The Airplay protocol is a technology that wirelessly transmits media data such as images, audio, video and other content on iOS devices such as iPhone and iPad to display devices that support AirPlay for playback via Wi-Fi.
[0100] In order to play the media data of multiple projections, the controller can control the corresponding media data to play according to the received operation instructions in turn. For example, when a first operation instruction is received to play the first media data with the first media parameter in the first projection window of the projection interface, the controller controls the display to play the first media data in the first projection window.
[0101] During the process of playing the first media data in the first projection window, the controller can continuously receive projection operation instructions. If a second operation instruction for playing the second media data in the second projection window is received, the controller can obtain the second media parameters of the second media data by parsing the second operation instruction, or can also send a request to the terminal device that initiates the projection of the second media data to obtain the second media parameters when receiving the second operation instruction.
[0102] In some embodiments, a user can project different media data through different terminal devices. For example, a user can send a first operation instruction for playing first media data to a display device through a first terminal device, and send a second operation instruction for playing second media data to the display device through a second terminal device.
[0103] In some embodiments, when the terminal device supports projecting multiple media data, the user can also project multiple different media data through the same terminal device. In this case, the terminal device used to project the first media data and the terminal device used to project the second media data can be the same terminal device.
[0104] In addition, in order to facilitate screen projection management, when the display device receives the screen projection operation instruction sent by the terminal device, the controller can record information such as the device information and screen projection protocol of each terminal device.
[0105] Step S420: If it is determined that the second media asset data does not meet the screen projection condition, the display is controlled to display the first prompt information.
[0106] The first prompt information is used to prompt the user to reduce the resolution or frame rate of the second media data and re-project the screen, and to keep playing the first media data in the first projection window. Projection conditions refer to the conditions that a display device needs to meet when accessing multiple projection media data to simultaneously play each projection media data and ensure the playback quality. For example, projection conditions may include resolution conditions, frame rate conditions, memory conditions, etc. of each projection media data.
[0107] When receiving the second operation instruction, in order to determine whether the display device can play the first media data and the second media data at the same time, and to ensure the playback quality of the first media data and the second media data, the controller determines whether the second media data meets the screen projection conditions. For example, it can determine the maximum device playback capability that the display device can support at the current moment when the first media data is already in the playback state based on the performance parameters of the display device, the first media parameters, and the second media parameters, and then determine whether the second media data meets the screen projection conditions.
[0108] When it is determined that the second media data does not meet the screen projection conditions, the controller can control the display to display a first prompt message, such as "The display device cannot support the projection of the second media data, please select a low resolution to re-project", while continuing to play the first media data in the first projection window, so that the user can select appropriate media data to re-project.
[0109] In some embodiments, if it is determined that the second media data meets the screen projection condition, the first media data continues to be played in the first screen projection window, and the second media data is played in the second screen projection window.
[0110] refer to Figure 6 As shown, when it is determined that the second media data meets the screen projection condition, two screen projection windows are displayed in the screen projection interface 600, namely, the screen projection window 610 and the screen projection window 620, wherein the screen projection window 610 is used to play the first media data, and the screen projection window 620 is used to play the second media data. At this time, the display device accesses and plays the media data of multiple screen projections, which is convenient for users to watch multiple media data at the same time, bringing rich viewing experience to users.
[0111] Step S430: In response to the instruction for re-projecting the screen in the second projection window, if it is determined that the re-projected third media data meets the projection condition, the third media data is played in the second projection window, and the first media data continues to be played in the first projection window.
[0112] The resolution or frame rate of the third media data is less than that of the second media data. In some embodiments, the third media data may be media data having the same media content as the second media data, or may be media data completely different from the second media data, such as when the second media data is TV series C with a second resolution of 1080P, the third media data may be TV series C with a third resolution of 720P, or may be documentary A with a third resolution of 720P.
[0113] After receiving the instruction for re-projecting the screen in the second projection window, the third media data for re-projecting can be obtained, and it can be determined whether the third media data meets the projection condition. For example, it can be determined whether the third media data meets the projection condition based on the performance parameters of the display device, the first media parameter of the first media data, and the third media parameter of the third media data. When it is determined that the third media data meets the projection condition, the third media data can be played in the second projection window while continuing to play the first media data in the first projection window.
[0114] Through the above steps S410 to S430, when the display device receives multiple media data for screen projection, it can be determined whether the newly connected media data meets the screen projection conditions, and when the screen projection conditions are not met, the user is prompted to project the new media data, so that various media data that are adapted to the performance of the display device can be played simultaneously in the screen projection interface. Not only can multiple media data for screen projection be played on the display device, but the playback quality and playback effect of multiple media data can also be improved, thereby enhancing the user experience.
[0115] In some embodiments, the first media asset parameter may include a first resolution and a first frame rate, and the second media asset parameter may include a second resolution and a second frame rate. The resolution can reflect the picture clarity of the media asset data, and the frame rate refers to the number of frames displayed per second in the media asset data. The higher the frame rate, the smoother and more continuous the image changes, and the smoother the visual experience.
[0116] When determining whether the second media asset data meets the screen projection condition, the controller may calculate the first parameter based on the first resolution and the first frame rate, and the second resolution and the second frame rate.
[0117] The comparison result between the first parameter and the preset second parameter determines whether the second media asset data meets the screen projection condition, and the preset second parameter is defined by the first performance parameter of the display device. The first performance parameter refers to the decoding parameter of the display device, which may include the maximum resolution and frame rate supported by the display device. Exemplarily, the preset second parameter may be determined based on the first performance parameter. For example, if the maximum resolution and frame rate supported by the display device are R and F respectively, the preset second parameter may be the value of R*F.
[0118] The first algorithm refers to a rule for calculating the resolution and frame rate of the media data connected to the display device for screen projection, which is used to determine the first parameter, which is used to evaluate the decoding resource occupancy when the display device plays multiple channels of media data.
[0119] Exemplarily, the controller can convert the first resolution and the first frame rate according to the first algorithm, and convert the second resolution and the second frame rate at the same time, and then combine the values after the two conversion processes, such as summing the values after the two conversion processes, to obtain the first parameter. Then, the first parameter is compared with the preset second parameter to determine whether the second media asset data meets the screen projection condition. Generally speaking, when the first parameter is less than or equal to the preset second parameter, it is determined that the second media asset data meets the screen projection condition. When the first parameter is greater than the preset second parameter, it indicates that the second media asset data does not meet the screen projection condition.
[0120] By calculating the first parameter based on the first algorithm for the first resolution and the first frame rate, the second resolution and the second frame rate, and determining whether the second media data meets the screen projection condition based on the comparison result of the first parameter and the preset second parameter, the device performance when the display device accesses the second media data can be predicted, and it can be determined whether the display device can continue to play the second media data while playing the first media data, thereby realizing device performance analysis when accessing multiple media data channels, and at the same time improving the accuracy of the analysis, locating the reason why the screen projection condition is not met, and providing assistance for user operations.
[0121] In some embodiments, the controller may calculate a first product of a first resolution and a first frame rate and a second product of a second resolution and a second frame rate based on a first algorithm, and then determine a first parameter based on the first product and the second product.
[0122] Exemplarily, assuming that the first resolution and the first frame rate are r1 and f1 respectively, and the second resolution and the second frame rate are r2 and f2 respectively, then the first product is r1*f1, and the second product is r2*f2. Then, the first parameter can be determined according to the first product and the second product, for example, the first product and the second product are summed to obtain the first parameter, or the first product and the second product are respectively added with corresponding weights, such as the first product*a1, the second product*a2, to obtain the weighted values of the two products, and then the weighted values of the two products are summed to obtain the first parameter. Among them, the values of a1 and a2 can be customized according to actual needs, such as a1 and a2 can be set to positive values less than 1 respectively, and a1 and a2 can be the same or different.
[0123] Taking the first resolution as 4K, the first frame rate as 60 frames, the second resolution as 4K, and the second frame rate as 120 frames as an example, the first product is 4K*60, and the second product is 4K*120. Then the first product and the second product are summed to obtain the first parameter, that is, the first parameter = 4K*60+4K*120.
[0124] Through the above method, the first parameter can be determined based on the product of the resolution and the frame rate, thereby improving the analyzability of determining the performance of the display device.
[0125] In some embodiments, when determining whether the second media data meets the screen projection conditions, the controller can also directly determine the multi-channel media resolution for simultaneously playing the first media data and the second media data based on the first resolution and the second resolution, and determine whether the second media data meets the screen projection conditions based on the multi-channel media resolution and the maximum resolution supported by the display device.
[0126] Exemplarily, when the resolution of the multi-channel media assets is less than or equal to the maximum resolution, it is determined that the second media asset data meets the screen projection condition. Conversely, when the resolution of the multi-channel media assets is greater than the maximum resolution, it is determined that the second media asset data does not meet the screen projection condition. For example, assuming that the first resolution and the second resolution are both 1920×1080, the multi-channel media resolution of the display device playing the first media asset data and the second media asset data at the same time is 3840×1080. At this time, if the maximum resolution that the display device can support is 4K, that is, the resolution is 3840×2160, it means that the second media asset data meets the multi-channel screen projection condition.
[0127] By determining whether the second media data meets the screen projection conditions based on the maximum resolution supported by the display device and the first resolution and the second resolution, it is possible to perform playback analysis of the media data for multiple screen projections and determine the reason why the media data does not meet the multiple screen projection conditions, thereby providing a basis for further user operations.
[0128] In some embodiments, the first media asset parameter includes the first media asset running memory usage, and the second media asset parameter includes the second media asset running memory usage. The media asset running memory usage refers to the memory resources occupied by the display device when playing the media asset data. For the first media asset data, since it is in a playing state, the first media asset running memory usage occupied by it can be obtained through the running data of the display device, etc. For the second media asset data, it has not been played yet, so its corresponding second media asset running memory usage can usually be estimated based on the performance parameters of the display device, the second media asset parameters, etc.
[0129] When determining whether the second media asset data meets the screen projection condition, the controller may calculate the second parameter based on the second algorithm based on the first media asset running memory occupancy and the second media asset running memory occupancy.
[0130] Among them, the comparison result of the second parameter and the preset third parameter determines whether the second media asset data meets the screen projection condition, and the preset third parameter is defined by the second performance parameter of the display device. The second performance parameter can be the running memory supported by the display device, etc. The running memory refers to the maximum memory resource allocated by the display device for playing media asset data. Exemplarily, the preset third parameter can be the amount of running memory supported by the display device, or it can also be a value slightly smaller than the amount of running memory, such as 0.9*M, where M is the amount of running memory supported by the display device.
[0131] The second algorithm refers to a rule for calculating the amount of memory used to run media data connected to the display device for projection, and is used to determine a second parameter used to evaluate memory resource usage when the display device plays multiple channels of media data.
[0132] Exemplarily, the controller can calculate the first media asset running memory usage and the second media asset running memory usage according to the second algorithm, such as directly summing the first media asset running memory usage and the second media asset running memory usage to obtain a second parameter. Then, the second parameter is compared with a preset third parameter to determine whether the second media asset data meets the screen projection condition. For example, when the second parameter is less than or equal to the preset third parameter, it is determined that the second media asset data meets the screen projection condition. When the second parameter is greater than the preset third parameter, it is determined that the third media asset data does not meet the screen projection condition.
[0133] By analyzing the relationship between the second parameter and the preset third parameter, it is possible to determine whether the running memory of the display device can support the playback of the second media asset data, that is, to determine whether the second media asset data meets the screen projection condition.
[0134] In some embodiments, when multiple projection windows are displayed on the projection interface, the window mode of each projection window can be set. For example, when multiple projection windows are displayed, the controller can control the display to display window mode prompt information, so that the user can choose whether to set these projection windows to main window mode or sub-window mode.
[0135] Among them, the main window mode means that the projection window is the main window, which can be used to play important media data, and the secondary window mode means that the projection window is mainly responsible for the playback of auxiliary media data. There is usually one projection window in the main window mode, and there may be multiple projection windows in the secondary window mode. In addition, the window sizes corresponding to the main window mode and the secondary window mode can be different or the same.
[0136] Therefore, when displaying the first prompt information, the controller can control the display to display the first prompt information when the window mode of the first projection window is the main window mode and the window mode of the second projection window is the sub-window mode, so as to prompt the user to reduce the resolution or frame rate of the second media data and re-project the screen, and keep playing the first media data in the first projection window. The window mode includes the main window mode and the sub-window mode.
[0137] Exemplary, reference Figure 7 As shown in the screen projection interface 700, the display device is playing two media data for the screen projection, that is, the media data A played by the first screen projection window and the media data B played by the second screen projection window. If the window mode of the first screen projection window is the main window mode and the window mode of the second screen projection window is the sub-window mode, the controller can control the display to display as follows: Figure 7 The first prompt information shown is, for example, "The second projection window is in secondary window mode, please lower the resolution of the second media data and project the screen again."
[0138] By determining the window mode of the projection window and prompting the user to lower the resolution or frame rate of the media data played in the secondary window mode and re-project the screen, operational guidance can be provided to the user, thereby improving the success rate of playback of the projection media data and avoiding affecting the media data played in the projection window of the main window mode.
[0139] Furthermore, by analyzing users' screen projection needs, it was found that users have different requirements for the screen playback of media data projected in different ways. For example, there are differences in the requirements for resolution and frame rate for media data sent by users through a screen projection application that supports the DLNA protocol installed on the display device and media data projected through the mirroring function of the display device. In comparison, for media data projected via the DLNA protocol, users are more concerned about content sharing and simple playback, and are more inclined to ensure that the media data can be played in a universal and stable manner, rather than emphasizing high-quality screen mirroring functions like media data projected by mirroring.
[0140] Therefore, when displaying the first prompt information, the controller can also control the display to display the first prompt information when the media transmission type of the first media data is the second transmission type and the media transmission type of the second media data is the first transmission type, so as to prompt the user to reduce the resolution or frame rate of the second media data and re-project the screen, and to keep playing the first media data in the first projection window.
[0141] Among them, the first transmission type and the second transmission type have different priorities for reducing resolution and frame rate. Exemplarily, the first transmission type has a higher priority than the second transmission type, that is, the user can preferentially select the media data of the first transmission type for resolution adjustment, which may be the media type transmitted by the DLNA protocol, and the second transmission type may be the media data transmitted by protocols such as Miracast.
[0142] Exemplarily, when the media transmission type of the first media data is the second transmission type, and the media transmission type of the second media data is the first transmission type, the controller can control the display to display the first prompt message of "Please lower the resolution of the second media data and re-project the screen", so that the user can select the media data for re-projection in a targeted manner, thereby improving the playback effect of the media data in multi-channel projection.
[0143] In some embodiments, since the screen projection methods of different media transmission types may be different, the user can set the first transmission type and the second transmission type by himself, so that when performing multi-channel screen projection, the media transmission type that reminds to reduce the resolution or frame rate is selected first.
[0144] In some cases, the display device can send information to the terminal device. In order to facilitate user operation, refer to Figure 8 As shown, the controller can execute the following methods:
[0145] Step S810: Sending operation prompt information to the target terminal device that sends the second operation instruction.
[0146] The operation prompt information includes a first confirmation control and a first cancel control. The first confirmation control is used to prompt the user to confirm reducing the second media data or frame rate to re-project the screen, and the first cancel control is used to prompt the user to cancel reducing the second media data or frame rate to re-project the screen.
[0147] Step S820: In response to the user's selection operation on the first confirmation control, receiving a re-screen projection instruction sent by the target terminal device.
[0148] When receiving the user's selection operation of selecting the first confirmation control, the target terminal device can resend the screen projection instruction to the display device. For example, the operation prompt information may include prompt information such as "The resolution of the second media resource data is too high and the display device cannot play it. Please confirm whether to reduce the resolution and re-project the screen." When the user selects the first confirmation control, the target terminal device can trigger the generation of the re-projection instruction and send it to the display device.
[0149] During this process, the first confirmation control can provide users with a quick screen projection operation method, which is convenient for quickly initiating re-screen projection, thereby improving the timeliness and convenience of screen projection operations.
[0150] In some embodiments, the controller may also execute an operation of disconnecting the screen projection connection in response to the user's selection operation of the first cancel control to stop receiving instructions for re-projecting the screen sent by the target terminal device.
[0151] Therefore, if the user refuses to re-project the screen, the screen projection connection can be interrupted, so that resources such as the screen projection session occupied by the display device are released, while the operability of the screen projection is improved.
[0152] In fact, according to the display control method provided in this embodiment, the display device can receive media data from multiple projections, and each time it receives new media data for the projection, it determines whether the device performance can support the playback of the new media data for the projection. If it cannot be played, the user is prompted to lower the resolution or frame rate of any one or more media data, thereby achieving the purpose of simultaneous playback of multiple media data.
[0153] When the user refuses to reduce the resolution or frame rate of any one or more media data channels, the controller can execute the operation of disconnecting the screen projection connection to disconnect the screen projection connection of the newly projected media data. For example, taking the display device as an example where the display device has been connected to two media data channels for projection, when disconnecting the screen projection connection of the newly connected target terminal device for projection, the controller can control the display to display the following: Fig. 9 The disconnection prompt information shown in the screen projection interface 900, namely, "the display device cannot play the second media data, and the screen projection will be disconnected", is used to allow the user to understand the screen projection status.
[0154] In some embodiments, before playing the first media data with the first media parameters in the first projection window of the projection interface, the controller can also control the split-screen display of the projection interface when the current projection mode of the display device is in the static split-screen mode, and display the first projection window and the second projection window in the split-screen display of the projection interface.
[0155] Among them, the current screen projection mode is used to indicate the screen display mode of the display device during screen projection. Exemplarily, the screen display mode may include a static split-screen mode and a dynamic split-screen mode. When the display device starts the static split-screen mode, the screen on the display always displays multiple windows after the split screen, regardless of whether there is media data being played in each window. When the display device starts the dynamic split-screen mode, the number of windows displayed on the screen can be dynamically adjusted according to the number of media data played by the screen projection. For example, when there is only one screen projection, the screen on the display displays one screen projection window, and when there are two screen projections, the screen on the display displays two screen projection windows.
[0156] When the current projection mode of the display device is in the static split-screen mode, the controller can control the split-screen display of the projection interface, and simultaneously display the first projection window and the second projection window in the split-screen display projection interface, and any one or more of the two projection windows can play the media data projected by the terminal device, or when no projected media data is received, both projection windows display the prompt message "There is no projection in the current window".
[0157] Through this method, guidance can be provided for users to select media data for projection, such as how much media data to project, and which media data to play in which projection window.
[0158] In some embodiments, the number of windows corresponding to the static split-screen mode can be set by the user, such as being set to a default of 2 windows or 4 windows.
[0159] In some embodiments, the controller may further perform the following method:
[0160] Before playing the first media asset data, if the current screen projection mode of the display device is in the dynamic split-screen mode, the first screen projection window is set as a window displayed in full screen in the screen projection interface.
[0161] Based on the dynamic split-screen mode, the first projection window is scaled, and the scaled first projection window and the second projection window are displayed in the projection interface, so as to continue to play the first media data in the scaled first projection window and play the third media data in the second projection window.
[0162] Before playing the first media data, if the current projection mode of the display device is in the dynamic split-screen mode, in order to increase the playback area of the first media data, the first projection window can be set as a window displayed in full screen in the projection interface, so that when the first media data is played, the first media data is played in full screen mode. Then, when the third media data is acquired, in order to play the first media data and the third media data at the same time, the controller can scale the first projection window when the current projection mode of the display device is in the dynamic split-screen mode, so that the scaled first projection window and the second projection window are displayed in the projection interface at the same time, and then the first media data continues to be played in the scaled first projection window, and the third media data is played in the second projection window.
[0163] Among them, the first screen projection window and the second screen projection window after scaling processing can have the same or different window sizes, and this embodiment does not make any specific limitations on this.
[0164] Through this method, when only the first media data is played, the first media data can be played in full screen mode, and when the media data of multiple screens are played at the same time, the window can be dynamically adjusted and switched, thereby improving the flexibility of playing the media data.
[0165] In this embodiment, the display device can receive media data of multiple screen projections, and prompt the user to adjust the media parameters of the media data, such as resolution, based on the device operation status of the display device, so as to simultaneously play the received media data of multiple screen projections. Figure 7 Taking the screen projection interface shown in the figure as an example, the display device is currently playing media data A and media data B. If the received third-channel screen projection media data, if media data C also meets the multi-channel projection conditions, such as Fig.10 As shown, the controller can control the display to simultaneously play media data A, media data B and media data C in the projection interface 1000.
[0166] In some embodiments, when playing media data of multiple screen projections, refer to Fig.11 As shown, the projection interface 1100 can simultaneously display the media parameters of each media data, such as resolution, media type and other parameters.
[0167] In some embodiments, before playing the first media asset data having the first media asset parameter in the first projection window of the projection interface, referring to Fig.12 As shown, the controller can also execute the following methods:
[0168] Step S1210: If it is determined that the first media asset data meets the single-channel screen projection condition, an operation of playing the first media asset data having the first media asset parameters in the first screen projection window of the screen projection interface is triggered.
[0169] Single-channel projection conditions refer to the conditions that a display device needs to meet to play media data for one channel of projection.
[0170] Exemplarily, based on the performance parameters of the display device and the first media resource parameters, the controller can determine whether the first media resource data meets the single-channel screen projection condition. For example, the controller can determine whether the first resolution is less than or equal to the maximum resolution based on the first resolution and the maximum resolution supported by the display device. If so, it is determined that the first media resource data meets the single-channel screen projection condition. Otherwise, if not, it is determined that the first media resource data does not meet the single-channel screen projection condition.
[0171] When the first media data meets the single-channel projection condition, the controller can control the display to play the first media data in the first projection window. Exemplarily, since there is only one channel of projection of the first media data, the controller can control the display to display the first projection window in full screen mode and play the first media data in the first projection window.
[0172] Step S1220: If it is determined that the first media asset data does not meet the single-channel screen projection condition, the display is controlled to display single-channel screen projection prompt information.
[0173] Among them, the single-channel screen projection prompt information is used to prompt the user to reduce the resolution or frame rate of the first media data and re-project the screen.
[0174] When the first media asset data does not meet the single-channel screen projection condition, the controller can control the display to display a single-channel screen projection prompt message to facilitate user operation. Fig.13 A schematic diagram of a screen projection interface provided in an embodiment of the present application is shown. Figure 7 As shown, a prompt window is displayed in the screen projection interface 1300, and the prompt window displays a single-channel screen projection prompt message "The resolution of the first media data is too high and the display device cannot play it. Please confirm whether to lower the resolution and re-project the screen." The user can determine whether to adjust the resolution or frame rate and re-project the screen based on the single-channel screen projection prompt message.
[0175] In some embodiments, the single-channel projection prompt information may include multiple sets of resolutions, and the user can refer to the multiple sets of resolutions to select the corresponding resolution for projection of media data. For example, in Fig.13 In the screen projection interface shown, the prompt window displays "Supported resolutions: 1080P, 720P, 540P, 270P".
[0176] Step S1230: In response to the instruction for re-projecting the screen in the first projection window, if it is determined that the re-projected fourth media data meets the single-channel projection condition, the fourth media data is played in the first projection window.
[0177] The resolution or frame rate of the fourth media data is less than that of the first media data. Exemplarily, the fourth media data may be media data having the same media content as the first media data, such as the first media data is TV series A with a first resolution of 4K, and the fourth media data may be TV series A with a fourth resolution of 1080P. In some examples, the fourth media data may also be media data completely different from the first media data, such as the fourth media data may be movie B with a fourth resolution of 1080P.
[0178] Through the above method, when the controller receives media data for projection, it can determine whether the display device can play the media data based on the performance parameters of the display device and the media parameters of the media data. If it cannot be played, the controller prompts the user to re-project new media data. Media data that meets the playback requirements of the display device can be obtained in an interactive manner, thereby ensuring the projection and playback quality of the media data.
[0179] In some embodiments, after controlling the display to display a single-channel screen projection prompt message, if no re-screen projection instruction is received from the first terminal device within a period of time, the controller can control the display to display a screen projection disconnection prompt message, such as "The display device does not support the current resolution, and the screen projection is about to be disconnected", so that the user can understand the screen projection status.
[0180] According to the display control method in the above embodiment, the controller can obtain the second media parameter of the second media data in response to the second operation instruction when playing the first media data in the first projection window, and determine whether the second media data meets the projection condition by analyzing the first media parameter and the second media parameter of the first media data and the performance parameters of the display device. When it is determined that the second media data does not meet the projection condition, the user is prompted to reduce the resolution or frame rate of the second media data and re-project. During the prompting process, the user can interact with the display device through the terminal device, which can facilitate the user to understand the projection status of the display device and improve the operability of the user's projection.
[0181] When it is determined that the second media data meets the screen projection condition, the first media data and the second media data can be played simultaneously on the display device to realize screen projection of multiple media data, which is convenient for users to watch multiple media data at the same time.
[0182] In another aspect, an embodiment of the present invention further provides a display control method. Fig.14 A flow chart of the display control method is shown, which can also be applied to Figure 1 A display device 200 is shown.
[0183] According to the display control method provided in the embodiment of the present application, the display device can, when playing first media data with first media parameters in the first projection window of the projection interface, respond to a second operation instruction for playing second media data in the second projection window, obtain second media parameters of the second media data, and when it is determined that the second media data does not meet the projection conditions, control the display to display second prompt information, respond to the instruction for re-projecting in the first projection window, and when it is determined that the re-projected fifth media data meets the projection conditions, play the fifth media data in the first projection window, and continue to play the second media data in the second projection window, wherein the resolution or frame rate of the fifth media data is lower than that of the first media data.
[0184] By applying this solution, when the display device receives media data from multiple screen projections, the user can be prompted to adjust the resolution of the media data according to the device performance parameters of the display device, thereby playing the media data from multiple screen projections simultaneously in the screen projection interface. This can avoid the impact on user experience caused by directly disconnecting the screen projection when the projected media data cannot be played, and can improve the playback success rate and playback quality of multiple media data, thereby enhancing the user viewing experience.
[0185] like Fig.14 As shown, the controller is configured to perform the following steps S1410-S1430:
[0186] Step S1410: When first media data having first media parameters are played in the first projection window of the projection interface, in response to a second operation instruction for playing second media data in the second projection window, second media parameters of the second media data are obtained.
[0187] The first media resource parameters include a first resolution and a first frame rate, and the second media resource parameters include a second resolution and a second frame rate.
[0188] Step S1420: If it is determined that the second media asset data does not meet the screen projection condition, the display is controlled to display the second prompt information.
[0189] The second prompt information is used to prompt the user to reduce the resolution or frame rate of the first media data and re-project the screen, and to play the second media data in the second projection window.
[0190] When it is determined that the second media data does not meet the projection conditions, the controller can control the display to display a second prompt message, such as "The resolution of the second media data is too high and the display device cannot play it. You can choose to lower the resolution of the first media data and re-project it" while playing the second media data in the second projection window, so that the user can re-project the new media data.
[0191] In some embodiments, if it is determined that the second media data meets the screen projection condition, the first media data continues to be played in the first screen projection window, and the second media data is played in the second screen projection window.
[0192] Step S1430: In response to the instruction for re-projecting the screen in the first projection window, if it is determined that the re-projected fifth media data meets the projection condition, the fifth media data is played in the first projection window, and the second media data continues to be played in the second projection window.
[0193] The resolution or frame rate of the fifth media data is lower than that of the first media data. The fifth media data may be media data having the same media content as the first media data, or may be media data completely different from the second media data. For example, the first media data may be a 1080P cartoon A, and the fifth media data may be a 720P cartoon A or a 720P movie A.
[0194] After receiving the instruction for re-projecting the screen in the first projection window, the fifth media data for re-projecting can be obtained, and it can be determined whether the fifth media data meets the projection condition. For example, it can be determined whether the fifth media data meets the projection condition based on the performance parameters of the display device, the fifth media parameter of the fifth media data, and the second media parameter of the second media data. When it is determined that the fifth media data meets the projection condition, the fifth media data can be played in the first projection window while the second media data continues to be played in the second projection window.
[0195] Through the above steps S1410 to S1430, when the display device receives multiple media data for screen projection, it can be determined whether the newly connected media data meets the screen projection conditions, and when the screen projection conditions are not met, the user is prompted to project the new media data, so that various media data that are adapted to the performance of the display device can be played simultaneously in the screen projection interface. Not only can multiple media data for screen projection be played on the display device, but the playback quality and playback effect of multiple media data can also be improved, thereby enhancing the user experience.
[0196] In some embodiments, when determining whether the second media asset data meets the screen projection condition, the controller may calculate the first parameter based on the first resolution and the first frame rate, and the second resolution and the second frame rate.
[0197] Exemplarily, the controller may calculate a first product of a first resolution and a first frame rate and a second product of a second resolution and a second frame rate based on a first algorithm, and then determine a first parameter based on the first product and the second product.
[0198] In some embodiments, the first media asset parameter includes the first media asset running memory usage, and the second media asset parameter includes the second media asset running memory usage.
[0199] When determining whether the second media asset data meets the screen projection condition, the controller can calculate the second parameter based on the second algorithm based on the first media asset running memory usage and the second media asset running memory usage. The comparison result of the second parameter and the preset third parameter determines whether the second media asset data meets the screen projection condition, and the preset third parameter is defined by the second performance parameter of the display device.
[0200] It should be noted that the above method for determining whether the second media asset data meets the screen projection condition has been described in detail in the above embodiment, and will not be repeated here to avoid redundancy.
[0201] Furthermore, when displaying the second prompt information, the controller can control the display to display the second prompt information when the window mode of the second projection window is the main window mode and the window mode of the first projection window is the sub-window mode, so as to prompt the user to reduce the resolution or frame rate of the first media data and re-project the screen, and keep playing the second media data in the second projection window. The window mode includes the main window mode and the sub-window mode.
[0202] By determining the window mode of the projection window and prompting the user to lower the resolution or frame rate of the media data played in the secondary window mode and re-project the screen, operational guidance can be provided to the user, thereby improving the success rate of playback of the projection media data and avoiding affecting the media data played in the projection window of the main window mode.
[0203] When displaying the first prompt information, the controller can also control the display to display the second prompt information when the media transmission type of the second media data is the second transmission type and the media transmission type of the first media data is the first transmission type, so as to prompt the user to reduce the resolution or frame rate of the second media data and re-project the screen, and keep playing the second media data in the second projection window.
[0204] Exemplarily, when the media transmission type of the second media data is the second transmission type, and the media transmission type of the first media data is the first transmission type, the controller can control the display to display a second prompt message of "Please lower the resolution of the first media data and re-project the screen", so that the user can select the media data for re-projection in a targeted manner, thereby improving the playback effect of the media data in multi-channel projection.
[0205] In some embodiments, the display device may send operation prompt information to the terminal device that initiates the projection of the first media data, and the operation prompt information may include a second confirmation control and a second cancel control, wherein the second confirmation control is used to prompt the user to confirm reducing the first media data or frame rate to re-project the screen, and the first cancel control is used to prompt the user to cancel reducing the first media data or frame rate to re-project the screen.
[0206] In response to the user's selection operation on the second confirmation control, an instruction to re-project the screen sent by the terminal device that initiated the projection of the first media data is received, or, in response to the user's selection operation on the second cancel control, an operation of disconnecting the projection connection is performed to stop playing the second media data in the second projection window and continue to play the first media data in the first projection window.
[0207] Through this method, the second confirmation control can be used to provide users with a quick screen projection operation method, which is convenient for quickly initiating re-screen projection to improve the timeliness and convenience of screen projection operations. The second cancellation control can also be used to cancel access to the second media data and continue playing the first media data if the user refuses to re-project the screen.
[0208] In some embodiments, before playing the first media data with the first media parameters in the first projection window of the projection interface, the controller can also control the split-screen display of the projection interface when the current projection mode of the display device is in the static split-screen mode, and display the first projection window and the second projection window in the split-screen display of the projection interface.
[0209] In some embodiments, before playing the first media data, if the current projection mode of the display device is in the dynamic split-screen mode, the controller can set the first projection window to a window displayed in full screen in the projection interface, so that when only the first media data is played, the first media data is played in full screen mode.
[0210] Based on the dynamic split screen mode, the first projection window is scaled, and the scaled first projection window and the second projection window are displayed in the projection interface, so that the fifth media data is played in the scaled first projection window, and the second media data is continued to be played in the second projection window. Through this method, when only the first media data is played, the first media data can be played in full screen mode, and when the media data of multiple projections are played at the same time, the windows can be dynamically adjusted and switched, thereby improving the flexibility of playing the media data.
[0211] It should be understood that the corresponding contents of the above control method have been described in detail in the embodiment part of the above display control method, and the relevant technical details are the same as or corresponding to the above embodiment part. To avoid repetition, they will not be repeated here.
[0212] According to the display control method provided in this embodiment, screen projection control based on multiple media data can be implemented. When new media data for projection is accessed, it is determined whether the media data meets the projection conditions. When the projection conditions are met, multiple media data for projection are played simultaneously. When the projection conditions are not met, corresponding prompt information can be output to prompt the user to choose to reduce the resolution or frame rate of any media data and re-project, thereby improving the projection success rate and playback quality of multiple media data.
[0213] In some embodiments, when it is determined that a certain channel of media data does not meet the screen projection conditions, the controller can determine the target resolution corresponding to each channel of media data based on the media parameters of each channel of media data and the performance parameters of the display device, thereby controlling the display to display a third prompt message to prompt the user to select the corresponding media data to re-project the screen.
[0214] Take the display device as an example. For example, if the user wants to access the third channel of media data C, the controller can determine the resolution strategy indicating the target resolution of each channel of media data parameters according to the media parameters of media data C, the media parameters of media data A, the media parameters of media data B, and the device performance parameters. Fig.15 As shown, after calculation, the resolution strategy is displayed in the projection interface 1500, that is, "target resolution of media data A: 1080P; target resolution of media data B: 720P; target resolution of media data C: 1080P".
[0215] Thus, the user can trigger the projection of new media data, i.e., new media data A, new media data B, and new media data C, according to the target resolution of each media parameter, so as to meet the demand of playing media data A, media data B, and media data C at the same time. Through this method, multiple media parameter selection strategies can be provided to the user, improving the convenience of user operation.
[0216] In some embodiments, when providing a resolution strategy for a user, there may be multiple target resolution combinations, each target resolution combination is used to indicate a target resolution of each channel of media asset data, and the target resolutions of different resolution combinations may not be completely the same.
[0217] In order to illustrate the screen projection process of media data, the present application embodiment provides a flowchart of another display control method, such as Fig.16 As shown, the following steps may be included:
[0218] Step S1601: Start the screen projection application.
[0219] In some embodiments, if the screen projection function is a system function of the display device, the controller can control the display device to start the screen projection function.
[0220] Step S1602: Monitor the screen projection request of the terminal device.
[0221] Exemplarily, when the screen projection application is started, the screen projection application starts screen projection monitoring and can receive screen projection requests sent by one or more terminal devices.
[0222] Step S1603: Determine whether the terminal device has established a screen projection connection with the display device. If the connection has been established, execute step S1604; if the connection has not been established, continue to execute step S1602 to monitor the screen projection request of the terminal device.
[0223] When receiving a screen projection request sent by any terminal device, the user can choose whether to establish a screen projection connection between the terminal device and the display device. In some examples, when the display device receives the screen projection request, if the display device and the terminal device have established a specified communication connection, such as being connected to the same wireless network, a screen projection connection between the two can be automatically established without user selection.
[0224] Step S1604: Receive operation instructions for screen projection sent by the newly connected terminal device.
[0225] After establishing the screen projection connection, the display device can receive an operation instruction for screen projection sent by the terminal device, and the operation instruction is used to instruct the playback of corresponding media data.
[0226] Step S1605: Analyze the playback support capability of the display device at the current moment.
[0227] Exemplarily, the display device may analyze the playback support capability of the display device at the current moment through the controller, such as analyzing the media parameters of the media data that the display device can support based on the performance parameters of the display device and the current operating conditions.
[0228] Step S1606: Determine whether the media data projected by the newly connected terminal device exceeds the device support capability of the display device. If not, execute step S1607; if exceeded, execute step S1610.
[0229] The controller can compare the media parameters of the media data projected by the terminal device with the device support capability of the display device to determine whether the media data exceeds the device support capability of the display device.
[0230] Exemplarily, the controller may calculate a first parameter based on a first algorithm for a first resolution and a first frame rate, and a second resolution and a second frame rate, and determine whether the second media resource data meets the screen projection condition according to a comparison result between the first parameter and a preset second parameter.
[0231] Step S1607: Determine the playback position parameters of the newly accessed media asset data.
[0232] The playback position parameters may include the playback position coordinates of the newly accessed media asset data, the aspect ratio of the playback screen, and the like.
[0233] When new media data is accessed, that is, the media data projected by the newly accessed terminal device does not exceed the device support capability of the display device, the controller can determine the playback layout of the media data through a layout algorithm, that is, playback position coordinates, aspect ratio of the playback screen, and other playback position parameters.
[0234] Step S1608: Control the display to play the newly-connected media asset data according to the playback position parameters.
[0235] Exemplarily, when playing media data, the controller can control the projection interface to display a corresponding number of projection windows according to the number of media data that have been connected to the projection, so as to play the media data in each projection window.
[0236] Step S1609: Continue to monitor the operation instructions sent by the newly connected terminal device.
[0237] During the screen projection and playback process, the controller can continuously monitor the operation instructions for screen projection sent by the terminal device, such as instructions for projecting new media data, playback pause instructions, fast forward instructions, fast rewind instructions, etc., to control the playback of media data according to the corresponding operation instructions.
[0238] Step S1610: Query the media resource parameters of the media resource data currently projected.
[0239] Among them, the media resource parameters may include the resolution, frame rate, memory usage of media resource data, etc. Exemplarily, the media resource parameters can be obtained by parsing the operation instructions for screen projection.
[0240] Step S1611: Control the display to display prompt information.
[0241] The prompt information can be used to prompt the user to choose to reduce the resolution or frame rate to re-project the screen and play the media data.
[0242] In some embodiments, the prompt information may include media resource parameters such as resolution and frame rate currently supported by the display device.
[0243] Step S1612: Determine whether new media asset data is received. If yes, execute step S1613; if no, execute step S1615.
[0244] In some embodiments, the controller may start a timer while displaying the prompt information, so as to detect whether new media asset data is received within a period of time.
[0245] When receiving new media data, the controller can determine whether the new media data exceeds the playback support capability of the display device by executing steps S1605 and S1606. If it does not exceed the playback support capability, step S1613 is executed. If it exceeds the playback support capability of the display device, prompt information continues to be output to reacquire the media data.
[0246] Step S1613: Control the display to play new media data.
[0247] Correspondingly, when playing new media data, the controller can also determine the play position parameters of the media data, thereby controlling the display to play the new media data according to the corresponding play position parameters.
[0248] Step S1614: Continue to monitor the operation instructions sent by the terminal device.
[0249] Correspondingly, during the process of playing new media data, the controller can continuously monitor the operation instructions sent by the terminal device in the projection state, such as play pause instructions, fast forward instructions, fast rewind instructions, etc., to control the playback of the corresponding media data according to the corresponding operation instructions.
[0250] Step S1615: Control the display to display a prompt message to disconnect the screen projection.
[0251] The disconnect screen projection prompt information is used to prompt the user to disconnect the screen projection connection of the newly connected terminal device.
[0252] Step S1616: Determine whether to disconnect the screen projection. If disconnected, execute step S1617 to determine whether to disconnect the current screen projection. If not disconnected, continue to execute step S1615.
[0253] Exemplarily, the controller may monitor the screen projection session process between the newly connected terminal device and the display device, and then determine whether the screen projection connection of the newly connected terminal device is disconnected.
[0254] Step S1617: Determine to disconnect the current screen projection.
[0255] In summary, according to the display control method provided in this embodiment, when receiving media data of multiple screen projections, it can be analyzed whether the display device can normally play the newly connected media data for projection, and when it cannot be played normally, different prompt information can be displayed to provide users with operational guidance so that they can re-project the media data, thereby ensuring the playback quality of the projected media data.
[0256] An embodiment of the present invention provides a computer-readable storage medium, wherein the storage medium stores at least one executable instruction. When the executable instruction is executed on a display device, the display device executes the display control method in any of the above method embodiments.
[0257] The executable instructions can be specifically used to enable the display device to execute the above display control method.
[0258] In this embodiment, computer readable storage media may be any tangible media that can contain or store a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
[0259] More specific examples (a non-exhaustive list) of computer-readable storage media may include: an electrical connection having one or more conductors, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), optical fibers, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0260] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system or other device. In addition, the embodiments of the present invention are not directed to any particular programming language.
[0261] In the description provided herein, a large number of specific details are described. However, it is understood that embodiments of the present invention can be practiced without these specific details. Similarly, in order to simplify the present invention and help understand one or more of the various inventive aspects, in the above description of exemplary embodiments of the present invention, the various features of the embodiments of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. Wherein, the claims that follow the specific embodiment are hereby expressly incorporated into the specific embodiment, wherein each claim itself is a separate embodiment of the present invention.
[0262] Those skilled in the art will appreciate that the modules in the devices in the embodiments may be adaptively changed and arranged in one or more devices different from the embodiments. The modules or units or components in the embodiments may be combined into one module or unit or component, and further may be divided into a plurality of submodules or subunits or subcomponents. Except that at least some of such features and / or processes or units are mutually exclusive.
Claims
1. A display device, characterized in that: include: A display configured to display a screen projection interface; A controller is coupled to the display and is configured to: When first media asset data having first media asset parameters are played in the first projection window of the projection interface, in response to a second operation instruction for playing second media asset data in the second projection window, second media asset parameters of the second media asset data are acquired; If it is determined that the second media asset data does not meet the screen projection condition, controlling the display to display the first prompt information; The first prompt information is used to prompt the user to reduce the resolution or frame rate of the second media data to re-project the screen, and to keep playing the first media data in the first projection window; In response to an instruction for re-projecting the screen in the second projection window, if it is determined that the third media data for re-projecting meets the projection conditions, the third media data is played in the second projection window, and the first media data continues to be played in the first projection window, wherein the resolution or frame rate of the third media data is smaller than that of the second media data.
2. The display device according to claim 1, characterized in that The first media resource parameters include a first resolution and a first frame rate, and the second media resource parameters include a second resolution and a second frame rate; the controller is further configured to: A first parameter is calculated based on a first algorithm for the first resolution and the first frame rate, and the second resolution and the second frame rate, wherein a comparison result between the first parameter and a preset second parameter determines whether the second media data meets the screen projection condition, and the preset second parameter is defined by a first performance parameter of the display device.
3. The display device according to claim 2, characterized in that The controller performs a calculation based on a first algorithm on the first resolution and the first frame rate, and the second resolution and the second frame rate to obtain a first parameter, and is specifically configured as follows: Calculate, based on the first algorithm, a first product of the first resolution and the first frame rate, and a second product of the second resolution and the second frame rate; Based on the first product and the second product, the first parameter is determined.
4. The display device according to claim 1, characterized in that The first media asset parameter includes the first media asset running memory usage, the second media asset parameter includes the second media asset running memory usage, and the controller is further configured to: A second parameter is calculated based on a second algorithm based on the memory usage of the first media asset and the memory usage of the second media asset, wherein a comparison result between the second parameter and a preset third parameter determines whether the second media asset data meets the screen projection condition, and the preset third parameter is defined by a second performance parameter of the display device.
5. The display device according to claim 1, characterized in that The controller is further configured to: If it is determined that the second media data meets the screen projection condition, the first media data continues to be played in the first screen projection window, and the second media data is played in the second screen projection window.
6. The display device according to claim 1, characterized in that The controller controls the display to display the first prompt information, and is specifically configured to: When the window mode of the first projection window is the main window mode and the window mode of the second projection window is the sub-window mode, the display is controlled to display the first prompt information to prompt the user to reduce the resolution or frame rate of the second media data to re-project the screen, and keep playing the first media data in the first projection window. The window modes include the main window mode and the sub-window mode.
7. The display device according to claim 1, characterized in that The controller controls the display to display the first prompt information, and is specifically configured to: When the media transmission type of the first media data is the second transmission type, and the media transmission type of the second media data is the first transmission type, the display is controlled to display the first prompt information to prompt the user to reduce the resolution or frame rate of the second media data to re-project the screen, and keep playing the first media data in the first projection window.
8. The display device according to claim 1, characterized in that The controller is further configured to: Sending operation prompt information to the target terminal device that sent the second operation instruction, the operation prompt information including a first confirmation control and a first cancel control; the first confirmation control is used to prompt the user to confirm to reduce the second media data or frame rate and re-project the screen, and the first cancel control is used to prompt the user to cancel reducing the second media data or frame rate and re-projecting the screen; In response to the user's selection operation on the first confirmation control, a re-screen projection instruction sent by the target terminal device is received.
9. The display device according to claim 8, characterized in that The controller is further configured to: In response to the user's selection operation on the first cancel control, an operation of disconnecting the screen projection connection is performed to stop receiving instructions for re-projecting the screen sent by the target terminal device.
10. The display device according to any one of claims 1 to 9, characterized in that: Before playing the first media asset data having the first media asset parameter in the first projection window of the projection interface, the controller is further configured to: If it is determined that the first media asset data meets the single-channel screen projection condition, triggering an operation of playing the first media asset data having the first media asset parameters in the first screen projection window of the screen projection interface; If it is determined that the first media asset data does not meet the single-channel screen projection condition, the display is controlled to display single-channel screen projection prompt information, where the single-channel screen projection prompt information is used to prompt the user to reduce the resolution or frame rate of the first media asset data and re-project; as well as, In response to an instruction for re-projecting the screen in the first projection window, if it is determined that the re-projected fourth media data meets the single-channel projection condition, the fourth media data is played in the first projection window, and the resolution or frame rate of the fourth media data is smaller than that of the first media data.
11. The display device according to any one of claims 1 to 9, characterized in that: Before playing the first media asset data having the first media asset parameter in the first projection window of the projection interface, the controller is further configured to: When the current projection mode of the display device is in the static split-screen mode, the projection interface is controlled to be displayed in split screen, and the first projection window and the second projection window are displayed in the projection interface displayed in split screen.
12. The display device according to any one of claims 1 to 9, characterized in that: The controller is further configured to: Before playing the first media asset data, if the current screen projection mode of the display device is in the dynamic split screen mode, the first screen projection window is set as a window displayed in full screen in the screen projection interface, and, Based on the dynamic split-screen mode, the first projection window is scaled, and the scaled first projection window and the second projection window are displayed in the projection interface, so as to continue playing the first media data in the scaled first projection window and play the third media data in the second projection window.
13. A display device, characterized in that: include: A display configured to display a screen projection interface; A controller is coupled to the display and is configured to: When first media asset data having first media asset parameters are played in the first projection window of the projection interface, in response to a second operation instruction for playing second media asset data in the second projection window, second media asset parameters of the second media asset data are acquired; If it is determined that the second media asset data does not meet the screen projection condition, controlling the display to display second prompt information; The second prompt information is used to prompt the user to reduce the resolution or frame rate of the first media data to re-project the screen, and to play the second media data in the second projection window; In response to an instruction for re-projecting the screen in the first projection window, if it is determined that the fifth media data to be re-projected meets the projection conditions, the fifth media data is played in the first projection window, and the second media data continues to be played in the second projection window, wherein the resolution or frame rate of the fifth media data is smaller than that of the first media data.
14. A display control method, characterized in that: Applied to a display device, the method comprises: When first media asset data having first media asset parameters are played in the first projection window of the projection interface, in response to a second operation instruction for playing second media asset data in the second projection window, second media asset parameters of the second media asset data are acquired; If it is determined that the second media data does not meet the screen projection condition, the display is controlled to display a first prompt message; the first prompt message is used to prompt the user to reduce the resolution or frame rate of the second media data to re-project the screen, and keep playing the first media data in the first screen projection window; In response to an instruction for re-projecting the screen in the second projection window, if it is determined that the third media data for re-projecting meets the projection conditions, the third media data is played in the second projection window, and the first media data continues to be played in the first projection window, wherein the resolution or frame rate of the third media data is smaller than that of the second media data.
15. A display control method, characterized in that: Applied to a display device, the method comprises: When first media asset data having first media asset parameters are played in the first projection window of the projection interface, in response to a second operation instruction for playing second media asset data in the second projection window, second media asset parameters of the second media asset data are acquired; If it is determined that the second media data does not meet the screen projection condition, the display is controlled to display a second prompt message; the second prompt message is used to prompt the user to reduce the resolution or frame rate of the first media data to re-project the screen, and play the second media data in the second screen projection window; In response to an instruction for re-projecting the screen in the first projection window, if it is determined that the fifth media data to be re-projected meets the projection conditions, the fifth media data is played in the first projection window, and the second media data continues to be played in the second projection window, wherein the resolution or frame rate of the fifth media data is smaller than that of the first media data.
Citation Information
Patent Citations
Screen projection method and screen projection system
CN113542841A
Display equipment and display control method
CN113794917A
Screen projection content display method and device, equipment and storage medium
CN115268817A
Screen projection method, device and equipment and computer readable storage medium
CN118102017A
Method of adjusting projection image, projection system, and control apparatus
US20230276036A1
Cited By
Display device and display control method
WO2026144304A1