Display device and screen projection configuration method

Abstract

The embodiment of the invention provides a display device and a screen projection configuration method, and the method responds to a screen projection instruction, obtains screen projection data, and determines a screen projection process based on the screen projection data. If the screen projection process is a second screen projection process, a screen projection configuration file is obtained through the second screen projection process, and the screen projection configuration file is obtained by connecting the first screen projection process with the service logic interface after startup. And configuring a screen projection parameter of the second screen projection process according to the screen projection configuration file, thereby playing the screen projection data according to the screen projection parameter, and enabling the display to display a screen projection picture corresponding to the screen projection data. According to the method, a first screen projection process is connected with a service logic interface in advance during startup to obtain a screen projection configuration file; when the second projection screen process is created, the projection screen configuration can be completed directly according to the projection screen configuration file obtained by the first projection screen process, so that the time for connecting with the business logic interface again is saved, and the projection screen configuration efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a projection configuration method. Background Technology

[0002] Screen mirroring is a protocol for wirelessly transmitting and playing multimedia information. It can be applied to display devices, meaning that users can send screen mirroring commands to display devices through terminal devices according to the screen mirroring protocol. After responding to the screen mirroring command, the display device can receive and display or play the screen mirroring data transmitted from the terminal device, such as image data, video data, or audio data.

[0003] To facilitate screen mirroring, display devices can use a screen mirroring client to play screen mirroring data sent by terminal devices. After starting, the client process needs to connect to the display device's business logic interface to obtain the display device's screen mirroring configuration information, and then configure the screen mirroring process accordingly. However, because the business logic interface contains a lot of configuration information, the client process needs to wait for the screen mirroring configuration after receiving the data before it can display the data, affecting screen mirroring playback efficiency. Summary of the Invention

[0004] Some embodiments of this application provide a display device and a screen projection configuration method to solve the problem that when the client process of the screen projection transmission of the display device starts, it needs to wait for the screen projection configuration time before the screen projection data is projected, which affects the screen projection playback efficiency.

[0005] In a first aspect, some embodiments of this application provide a display device, the display device including a display, a communication device, and a controller, wherein the display is configured to display a projection interface; the communication device is configured to establish a communication connection with a terminal device; and the controller is configured to:

[0006] In response to a screen mirroring command, screen mirroring data is acquired, and the screen mirroring process corresponding to the screen mirroring data is detected. The screen mirroring process is either a first screen mirroring process or a second screen mirroring process. The first screen mirroring process is started when a power-on event is detected. The first screen mirroring process is used to connect to the business logic interface to obtain the screen mirroring configuration file. The second screen mirroring process is started in response to the screen mirroring command.

[0007] If the screen casting process is a second screen casting process, then the screen casting configuration file is obtained through the second screen casting process, and the screen casting parameters of the second screen casting process are configured through the screen casting configuration file;

[0008] Play the projection data according to the projection parameters so that the display shows the projection screen corresponding to the projection data.

[0009] Secondly, this application provides a screen projection configuration method, applied to the display device described in the first aspect, wherein the display device should at least include a display, a communication device, and a controller, the display being configured to display the screen projection image; the communication device being configured to establish a communication connection with the terminal device; the method includes:

[0010] In response to a screen mirroring command, screen mirroring data is acquired, and the screen mirroring process corresponding to the screen mirroring data is detected. The screen mirroring process is either a first screen mirroring process or a second screen mirroring process. The first screen mirroring process is started when a power-on event is detected. The first screen mirroring process is used to connect to the business logic interface to obtain the screen mirroring configuration file. The second screen mirroring process is started in response to the screen mirroring command.

[0011] If the screen casting process is a second screen casting process, then the screen casting configuration file is obtained through the second screen casting process, and the screen casting parameters of the second screen casting process are configured through the screen casting configuration file;

[0012] Play the projection data according to the projection parameters so that the display shows the projection screen corresponding to the projection data.

[0013] As can be seen from the above technical solutions, some embodiments of this application provide a display device and a screen casting configuration method. The method responds to a screen casting command, acquires screen casting data, and determines a screen casting process based on the screen casting data. If the screen casting process is a second screen casting process, a screen casting configuration file is obtained through the second screen casting process. The screen casting configuration file is obtained by the first screen casting process after power-on by connecting to the business logic interface. The screen casting parameters of the second screen casting process are configured according to the screen casting configuration file, thereby playing the screen casting data according to the screen casting parameters so that the display shows the screen casting image corresponding to the screen casting data. The method obtains the screen casting configuration file by connecting to the business logic interface in advance during power-on of the first screen casting process. When creating the second screen casting process, the screen casting configuration can be completed directly based on the screen casting configuration file obtained by the first screen casting process, saving the time of reconnecting to the business logic interface and improving the efficiency of screen casting configuration. Attached Figure Description

[0014] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0015] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0016] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0017] Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0018] Figure 4 A flowchart illustrating how a display device obtains configuration information through a business logic interface, as provided in some embodiments of this application;

[0019] Figure 5 A flowchart illustrating the screen projection configuration performed by a display device according to some embodiments of this application;

[0020] Figure 6 Timing diagrams for screen projection configuration performed by display devices provided in some embodiments of this application;

[0021] Figure 7 A display diagram illustrating the receiving of a screen projection command by a display device according to some embodiments of this application;

[0022] Figure 8 Flowcharts for configuring projection parameters for display devices provided in some embodiments of this application;

[0023] Figure 9 This is a flowchart illustrating the process of the second screen mirroring process obtaining the configuration file in some embodiments of this application;

[0024] Figure 10 This is a flowchart illustrating the playback of screen projection data using projection parameters in some embodiments of this application;

[0025] Figure 11 This is a flowchart illustrating the second screen mirroring process reading the screen mirroring configuration file from memory in some embodiments of this application;

[0026] Figure 12 This is a flowchart illustrating the process of generating projection signals by the display device in some embodiments of this application. Detailed Implementation

[0027] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0028] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0029] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0030] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0031] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0032] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0033] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0034] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0035] In some embodiments, the mobile terminal 300 or terminal device may also simulate the function of the control device 100 by running an application that controls the display device 200.

[0036] like Figure 1The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0037] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0038] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0039] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0040] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0041] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0042] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0043] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0044] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0045] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0046] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0047] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0048] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0049] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0050] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0051] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0052] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0053] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0054] like Figure 3As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0055] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0056] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0057] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0058] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0059] In some embodiments, the display device 200 can also receive media data sent by the terminal device via a screen mirroring transmission protocol and perform screen mirroring playback or screen mirroring display. The screen mirroring transmission protocol is a protocol for wirelessly transmitting and playing multimedia information. The display device 200 can send screen mirroring commands to the terminal device via the screen mirroring transmission protocol, or it can receive screen mirroring commands sent from the terminal device. For ease of description, the device receiving the screen mirroring command can be referred to as the receiving end, and the device sending the screen mirroring command as the sending end. After responding to the screen mirroring command, the receiving end can determine the screen mirroring type based on the command. Screen mirroring types can include mirroring and URL mirroring. When the screen mirroring type is mirroring, the receiving end can receive media data sent by the sending end for playback or display. For example, when the display device 200 is the receiving end and the terminal device is the sending end, after the display device 200 responds to the screen mirroring command, it can receive video media data sent by the terminal device and play the video media data sent by the terminal device through the display device 200 to achieve the screen mirroring effect. When the screen casting type is URL screen casting, the receiving end can receive the URL link sent by the sending end and request screen casting data through the URL link, so as to play or display the data through the receiving end.

[0060] To facilitate data transfer during screen mirroring, such as Figure 4 As shown, the display device 200 can also establish a client-side projection process through a projection client. After responding to the projection command sent by the terminal device, the display device 200 can obtain media asset data through the client-side projection process and play the media asset data based on the client-side projection process. Before playing the projection media asset data, the client-side projection process needs to connect to the display device 200's Biz interface. The Biz interface, also known as the business logic interface, allows the client-side projection process to obtain projection configuration information to configure the projection parameters of the client-side projection process. However, since the business logic interface contains a lot of configuration information, such as projection configuration information and other configuration information, the display device 200 needs to request each piece of configuration information when it first connects to the business logic interface. That is, it requests both projection configuration information and other configuration information. This causes the client process to wait for the process of requesting configuration information after receiving the projection data, resulting in excessively long projection configuration time and affecting projection playback efficiency.

[0061] In some embodiments, the display device 200 can obtain screen projection configuration information by monitoring the screen projection process during the projection process, thereby solving the problem of waiting for screen projection configuration before projecting data, which affects the efficiency of screen projection playback. Specifically, some embodiments of this application provide a display device 200, which includes a display 260, a communication device 220, and a controller 250. The display 260 is configured to display the projection screen during the projection process. The communication device 220 is configured to establish a communication connection with a terminal device. The controller 250 is configured to execute a screen projection configuration method. Figure 5 This is a flowchart illustrating the screen projection configuration performed by a display device according to some embodiments of this application. Figure 6 This is a timing diagram showing the screen projection configuration performed by the display device provided in this embodiment. The display device 200 follows the procedure as follows: Figure 6 The timing sequence shown executes the screen mirroring configuration. See also... Figure 5 and Figure 6 The method includes the following:

[0062] S100: In response to the screen casting command sent by the terminal device, obtain screen casting data and detect the screen casting process corresponding to the screen casting data.

[0063] Users can send screen projection commands to display device 200 via terminal devices. These commands may include media asset information for the projection data. Display device 200 can then display information such as... Figure 7 The pop-up window indicates that the user of the display device 200 can input feedback commands based on the screen projection information, such as an agreement command or a rejection command.

[0064] The display device 200 can respond to an agreement command to obtain the projection data. The display device 200 can also respond to a rejection command to reject the projection command from the terminal device and refuse to accept the projection data. After obtaining the projection data, the display device 200 can detect the projection process corresponding to the projection data so that the display device 200 can execute subsequent projection processes.

[0065] The screen mirroring process includes a first screen mirroring process or a second screen mirroring process. The first screen mirroring process can be a daemon screen mirroring process. See also... Figure 8 The guardian casting process is a casting process that runs in the background of the display device 200. It can start when the display device 200 powers on; that is, after the controller 250 detects the power-on event, it connects to the business logic interface through the guardian casting process to obtain the casting configuration file. The casting configuration file is used to configure the casting process for casting data.

[0066] The display device 200 can also transmit client data and play the projected data via screen mirroring. Therefore, the second screen mirroring process can be the client screen mirroring process, which can be started after the display device 200 responds to the screen mirroring command.

[0067] In some embodiments, the controller 250 can determine the screen casting process based on the screen casting method obtained by parsing the screen casting data. For example, the screen casting method may include audio screen casting and video screen casting.

[0068] When the screen mirroring method is audio mirroring, the display device 200 can control the audio output device 270 to play the audio data sent by the terminal device through the first mirroring process. When the screen mirroring method is video mirroring, the display device 200 can control the audio output device 270 to play the audio part of the media data through the second mirroring process, and control the display 260 to display the mirrored screen corresponding to the media data through the second mirroring process.

[0069] In some embodiments, the display device 200 can also control the audio output device 270 to play the audio portion of the media asset data through the first projection process, and control the display 260 to display the projection screen corresponding to the media asset data through the second projection process.

[0070] The first projection process starts when the display device 200 is powered on and runs continuously in the background. Therefore, even in scenarios where no projection command is received after power-on, the first projection process can connect to the business logic interface to obtain the projection configuration file. Thus, after the display device 200 responds to the projection command, it can directly configure the projection parameters of the first and / or second projection processes according to the projection configuration file. This saves time for the second projection process to connect to the business logic interface to obtain the projection configuration file, and also saves time for the first projection process to connect to the business logic interface after responding to the projection command, thereby improving projection transmission efficiency.

[0071] S200: If the screen casting process is a second screen casting process, then the screen casting configuration file is obtained through the second screen casting process, and the screen casting parameters of the second screen casting process are configured through the screen casting configuration file.

[0072] The casting process differs depending on the type of data being cast. When the casting process is the first casting process, the display device 200 casts media data through this first process. The display device 200 can configure the casting parameters for the first casting process using the casting configuration parameters.

[0073] In some embodiments, when the screen casting process is the first screen casting process, the display device 200 can include at least two configuration methods in terms of the timing of configuring screen casting parameters. The first configuration method involves configuring the screen casting parameters of the first screen casting process using a screen casting configuration file obtained from the connection business logic interface during power-on, after the display device 200 responds to the screen casting command. Since the first screen casting process is a resident process, the controller 250 can also configure the screen casting parameters before responding to the screen casting command. See also... Figure 8 The second configuration method involves the first screen-casting process obtaining the screen-casting configuration file and then directly configuring its screen-casting parameters using that file. This saves configuration time for the first screen-casting process after responding to a screen-casting command, thus improving its screen-casting efficiency.

[0074] Since the second projection process is a client process, the controller 250 needs to transmit the client call through projection after the display device 200 responds to the projection command. Therefore, the second projection process cannot configure the projection parameters before responding to the projection command.

[0075] Figure 9 This is a flowchart illustrating how the second screen-casting process requests a screen-casting configuration file from the first screen-casting process, as described in this embodiment. See also... Figure 9 If the screen mirroring process is the second screen mirroring process, the controller 250 can obtain the screen mirroring configuration file obtained by the first screen mirroring process through the second screen mirroring process, and configure the screen mirroring parameters of the second screen mirroring process through the screen mirroring configuration file, saving the time of the second screen mirroring process to connect to the business logic interface to obtain the screen mirroring configuration file and improving the screen mirroring transmission efficiency.

[0076] In some embodiments, when the second screen-casting process obtains the screen-casting configuration file, it can also parse the configuration file to filter out redundant information. Redundant information refers to screen-casting configuration information that the second screen-casting process does not need. When configuring screen-casting parameters, redundant information can affect the process and efficiency of parameter configuration. Therefore, after filtering out redundant information, the controller 250 can retain the screen-casting configuration information needed by the second screen-casting process in the screen-casting configuration file to mitigate the impact of redundant information on configuring the screen-casting parameters of the second screen-casting process, thereby improving the efficiency of screen-casting parameter configuration for the second screen-casting process.

[0077] The screen mirroring configuration file can include device information of the display device 200, i.e., screen mirroring configuration information. This configuration information can include language information, volume information, brightness information, etc., of the display device 200, thereby configuring the screen mirroring parameters of the screen mirroring process according to the configuration information. For example, taking movie A as the screen mirroring data and video mirroring as the mirroring method, the controller 250 can configure the screen mirroring parameters of the second screen mirroring process according to the configuration information. For instance, the screen mirroring interface language information of the second screen mirroring process can be configured according to the language information; for example, when the screen mirroring configuration information is Chinese, the screen mirroring interface language information of the second screen mirroring process can be configured to Chinese. Similarly, the screen mirroring volume of the second screen mirroring process can be configured according to the volume information.

[0078] S300: Play the screen projection data according to the screen projection parameters and project it onto the display so that the display shows the screen projection screen corresponding to the screen projection data.

[0079] like Figure 10 As shown, after configuring the projection parameters, the controller 250 can project the projection data to the display 260 through the second projection process according to the projection parameters. After receiving the projection data, the display 260 can display the projection interface corresponding to the projection data according to the projection parameters.

[0080] In some embodiments, media data may include audio data. While projecting the projection data to the display 260 via the second projection process, the controller 250 can also project the audio data to the audio output device 270 via the second projection process, so that the audio data can be played synchronously through the audio output device 270. Before playing the audio data, the controller 250 can also configure the audio output device 270 according to the audio playback parameters in the projection parameters, so that the audio output device 270 plays the audio data according to the audio playback parameters. Therefore, when projecting the projection data to the display 260 according to the projection parameters, the controller 250 can also parse the projection parameters to obtain the audio playback parameters in the projection parameters.

[0081] After acquiring the audio playback parameters, the controller 250 can configure the audio data in the projection data according to these parameters. During audio data configuration, the controller 250 can separate the audio data based on the media asset tracks of the projection data. These media asset tracks can include audio tracks, video tracks, subtitle tracks, etc., to facilitate the selection of different playback methods based on different media asset tracks. For example, different languages ​​and sound effects can be selected to play the media asset data based on the audio track; different resolutions can be selected to play the media asset data based on the video track; or different subtitles can be selected to play the media asset data based on the subtitle track.

[0082] It should be noted that the media asset track is determined by the playback format supported by the media asset data. For example, if the media asset data only supports 1080p resolution playback, then the video track in the media asset track will only include a 1080p resolution video track. This media asset data cannot support playback formats of other resolutions.

[0083] The controller 250 can traverse the audio tracks in the media asset track to obtain the audio data corresponding to the media asset data. After obtaining the audio data, the controller 250 can configure the audio data according to the audio playback parameters. The audio playback parameters are used to represent the configuration parameters when playing the audio data, such as audio volume parameters, playback speed parameters, and audio sound effect parameters. After configuring the audio data, the controller 250 can control the audio output device 270 to play the audio data according to the audio playback parameters while the screen corresponding to the projection data is displayed on the display. For example, when the audio volume parameter is 30, the playback speed parameter is 2x speed, and the audio sound effect parameter is ambient sound 50, the controller 250 can configure the audio data according to the above audio playback parameters, so that the display device 200 plays audio data with an audio volume parameter of 30, a playback speed parameter of 2x speed, and an ambient sound 50 audio sound effect parameter.

[0084] In some embodiments, after the controller 250 responds to the screen casting command sent by the terminal device, the screen casting process needs to call the application programming interface (API) so that the screen casting data can be sent to the display 260 or the audio output device 270 through the API for screen casting playback or display.

[0085] Based on this, in some embodiments, the controller 250 can also determine the screen-casting process based on the application interface (API) call information. Specifically, after responding to a screen-casting command, the controller 250 can listen for API call events, which are generated when the screen-casting process calls the API. When the screen-casting program calls the API for the first time, the API performs initialization based on the call event to query the process identifier (PID) of the screen-casting process. The PID indicates the name of the process calling the API. The controller 250 can then query the process name in the pro oc file system based on the PID. If the process name is a daemon process, the screen-casting process is the first screen-casting process; if the process name is a client process, the screen-casting process is the second screen-casting process.

[0086] In some embodiments, the display device 200 may further include a memory for storing various data during the screen mirroring interaction process, such as storing a screen mirroring configuration file. Before detecting the screen mirroring process, the first screen mirroring process can connect to the business logic interface after power-on to obtain the screen mirroring configuration file. The controller 250 can obtain the connection result of the first screen mirroring process connecting to the business logic interface and the screen mirroring configuration items. Since the business logic interface includes multiple configuration information, the screen mirroring configuration items can be used to filter the screen mirroring configuration information to remove other configuration information that the screen mirroring process does not need. If the first screen mirroring process successfully connects to the business logic interface, the controller 250 can filter the screen mirroring configuration information according to the screen mirroring configuration items through the business logic interface. The screen mirroring configuration information is the configuration information corresponding to the screen mirroring configuration items, such as setting the screen mirroring language, screen mirroring volume, screen mirroring brightness, etc.

[0087] After the controller 250 obtains the screen projection configuration information, it can encode the information according to the information encoding format. For example, the controller 250 can encode the obtained screen projection configuration information according to JSON format to obtain the screen projection configuration file. The first screen projection process can store the screen projection configuration file. However, if the first screen projection process encounters a program error after obtaining the screen projection configuration file, causing the process to close, the controller 250 will be unable to retrieve the screen projection configuration file from the first screen projection data after responding to the screen projection command. Therefore, in some embodiments, such as... Figure 11 As shown, after obtaining the screen mirroring configuration file, the controller 250 can store the configuration file in the memory. When the controller 250 subsequently responds to a screen mirroring command, if the screen mirroring process is the first screen mirroring process, it can directly configure the screen mirroring parameters according to the configuration file. If the screen mirroring process is the second screen mirroring process, it can request the configuration file from the memory to mitigate the problem of the second screen mirroring process being unable to request the configuration file due to a program error in the first screen mirroring process.

[0088] During the second screen mirroring process, as it reads the screen mirroring configuration file from memory, it can obtain the format string of the screen mirroring configuration file. This format string is generated during the encoding process of the screen mirroring configuration information and is used to characterize the encoding format of the screen mirroring configuration information. The controller 250 can obtain the information encoding format through the format string and parse the format string using the corresponding information decoding format to obtain the screen mirroring configuration information of the screen mirroring configuration file. Based on this information, the controller can then configure the screen mirroring parameters of the second screen mirroring process.

[0089] When configuring the screen mirroring parameters, the user may send control commands to the display device 200 to change the configuration information in the business logic interface, which will cause the screen mirroring configuration information to change. This will cause the controller 250 to configure the screen mirroring parameters of the screen mirroring process according to the screen mirroring configuration information before the change, resulting in a screen mirroring error.

[0090] In some embodiments, to mitigate the problem of screen mirroring errors, the controller 250 can monitor the configuration status of the screen mirroring process through the screen mirroring signal process to determine changes in the screen mirroring configuration information. To this end, the controller 250 can parse the current configuration information and optional configuration information in the screen mirroring configuration file. The current configuration information is the screen mirroring configuration information for the current screen mirroring state, and the optional configuration information is the screen mirroring configuration information for optional screen mirroring states. For example, the screen mirroring configuration information includes three language information, used to configure the screen mirroring interface language information, including Chinese, English, and Russian. When the screen mirroring configuration information is set to Chinese, the current configuration information is Chinese; the optional configuration information includes English and Russian. The screen mirroring configuration information can be determined based on the device information of the display device 200. That is, when the current language information of the display device 200 is set to Chinese, the current configuration information of the screen mirroring configuration information is Chinese; other language information in the display device 200 besides the current language is optional configuration information.

[0091] The controller 250 can create a projection signal process based on the current configuration information and optional configuration information through the first projection process, so that the projection parameters can be changed in a timely manner according to the monitoring of the projection signal process, thereby mitigating the problem of projection errors caused by failure to adjust the projection parameters in a timely manner due to changes in configuration information.

[0092] like Figure 12 As shown, users can also send control commands to the display device 200 to change its device information, thereby altering the projection configuration parameters and changing the projection status. In this case, the current configuration information changes, and correspondingly, the projection signal process also changes. Therefore, the projection configuration file needs to be updated according to the changed projection signal process.

[0093] In some embodiments, the controller 250 can listen for configuration update events through the first projection process. These configuration update events characterize updates to the configuration status of the projection configuration information. When the display device 200 receives a control command from a user to adjust the language information of the display device 200, it can set the current configuration information according to the language information specified in the control command.

[0094] For example, if the current configuration information is set to Chinese, the user can send a control command to the display device 200 to switch the language. The controller 250 will then respond to the control command and set the language of the display device 200 to English. At this time, the controller can update the current configuration information based on the language information of the display device 200, i.e., the current configuration information is updated from Chinese to English. The controller 250 can then generate a configuration update event based on the updated current configuration information and modify the projection signal process accordingly.

[0095] When the first projection process detects a change in the projection signal process, it can update the projection configuration file according to the modified projection signal process. The controller 250 can parse the revised configuration information of the modified projection signal process; this revised configuration information represents the changed projection configuration information. Following the above embodiment, when the language information of the display device 200 changes from Chinese to English, the current configuration information changes from Chinese to English. At this time, the Chinese language is optional configuration information; that is, the Chinese and English languages ​​in the language information are revised configuration information. The controller 250 can update the current configuration information and optional configuration information according to the revised configuration information; that is, the language information in the projection configuration file is updated to English, and the optional configuration information includes Chinese. The controller 250 can synchronously update the projection interface language information using the updated current configuration information and the updated optional configuration information, thus updating the projection configuration file in a timely manner.

[0096] It should be understood that the embodiments in this application are only illustrated by way of language information. In the actual process of updating the screen casting configuration file, the configuration can also be updated based on other screen casting configuration information such as volume information, playback speed information, and sound effect information. For example, when the control command changes the device information of one display device 200 at the same time, or changes the device information of multiple different types of display devices 200 at the same time, the controller 250 can update the current configuration information and optional configuration information according to the same category or different categories based on the changed device information of the display devices 200, so as to update the screen casting configuration file.

[0097] After the screen mirroring configuration file is updated, the controller 250 can generate an update prompt message based on the updated current configuration information and the updated optional configuration information, and send the update prompt message to the second screen mirroring process. The second screen mirroring process can then update the screen mirroring configuration file based on the updated current configuration information and the updated optional configuration information, and thus reconfigure the screen mirroring parameters based on the updated screen mirroring configuration file.

[0098] In some embodiments, the controller 250 can also switch the media asset track of the projected data according to the updated projection configuration file. The controller 250 can detect the target media asset track in the media asset track of the media asset data based on the updated current configuration information, wherein the target media asset track is the same as the media asset track in the updated current configuration information. If the media asset data includes a target media asset track, the controller 250 can switch the projected data to the target media asset track for playback according to the updated current configuration information after the second projection program updates the projection configuration file.

[0099] For example, when the language information in the casting configuration is changed from Chinese to English, after the casting configuration file is updated in the second casting process, the audio track and subtitle track in the media asset track can be detected based on the English language. If the audio track in the media asset data includes an English audio track and an English subtitle track, the controller 250 can control the audio output device 270 to switch the media asset data to play on the English audio track, and control the display 260 to display the English subtitle data, thereby changing the playback status of the media asset data according to the casting configuration information.

[0100] Some embodiments of this application also provide a screen projection configuration method, which is applied to a display device 200. The display device 200 should include at least a display 260, a communication device 220, and a controller 250. The display 260 is configured to display a screen projection image; the communication device 220 is configured to establish a communication connection with a terminal device, and the terminal device is configured to send screen projection data to the display device through the communication connection; the method includes:

[0101] S100: In response to the screen casting command, obtain screen casting data and detect the screen casting process corresponding to the screen casting data.

[0102] The screen casting process can be either a first screen casting process or a second screen casting process. The first screen casting process is started when a power-on event is detected. The first screen casting process is used to connect to the business logic interface to obtain the screen casting configuration file. The second screen casting process is started when the screen casting command is received.

[0103] S200: If the screen casting process is a second screen casting process, then the screen casting configuration file is obtained through the second screen casting process, and the screen casting parameters of the second screen casting process are configured through the screen casting configuration file.

[0104] S300: Play the screen projection data according to the screen projection parameters and project it onto the display so that the display shows the screen projection screen corresponding to the screen projection data.

[0105] As can be seen from the above technical solutions, some embodiments of this application provide a display device and a screen casting configuration method. The method responds to a screen casting command, acquires screen casting data, and determines a screen casting process based on the screen casting data. If the screen casting process is a second screen casting process, a screen casting configuration file is obtained through the second screen casting process. The screen casting configuration file is obtained by the first screen casting process after power-on by connecting to the business logic interface. The screen casting parameters of the second screen casting process are configured according to the screen casting configuration file, thereby playing the screen casting data according to the screen casting parameters so that the display shows the screen casting image corresponding to the screen casting data. The method obtains the screen casting configuration file by connecting to the business logic interface in advance during power-on of the first screen casting process. When creating the second screen casting process, the screen casting configuration can be completed directly based on the screen casting configuration file obtained by the first screen casting process, saving the time of reconnecting to the business logic interface and improving the efficiency of screen casting configuration.

[0106] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0107] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0108] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0109] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the projected image. A communication device configured to establish a communication connection with a terminal device; The controller is configured as follows: In response to a screen mirroring command, screen mirroring data is obtained, and the screen mirroring process corresponding to the screen mirroring data is detected. The screen mirroring process is either a first screen mirroring process or a second screen mirroring process. The first screen mirroring process is started when a power-on event is detected. The first screen mirroring process is used to connect to the business logic interface to obtain the screen mirroring configuration file. The second screen mirroring process starts in response to the screen mirroring command; If the screen casting process is a second screen casting process, then the screen casting configuration file is obtained through the second screen casting process, and the screen casting parameters of the second screen casting process are configured through the screen casting configuration file; Play the projection data according to the projection parameters so that the display shows the projection screen corresponding to the projection data.

2. The display device according to claim 1, characterized in that, The controller is configured to detect the screen projection process corresponding to the screen projection data. Listen for application interface call events; Based on the invocation event, obtain the process control character, which is used to represent the name of the process that invoked the application interface; The screen casting process corresponding to the screen casting data is detected based on the process controller.

3. The display device according to claim 1, characterized in that, It also includes a memory configured to store screen mirroring configuration files, and is further configured to: Before the controller performs the step of detecting the screen mirroring process corresponding to the screen mirroring data, it also includes: Obtain the screen mirroring configuration items and the connection result of the first screen mirroring process connecting to the business logic interface; If the connection result is successful, then the screen projection configuration information is obtained through the business logic interface according to the screen projection configuration item; The screen projection configuration information is encoded according to the information encoding format to obtain the screen projection configuration file, and the screen projection configuration file is stored in the memory.

4. The display device according to claim 3, characterized in that, The controller executes the screen casting parameters configured for the second screen casting process through the screen casting configuration file, specifically configured as follows: Read the screen mirroring configuration file from the memory; Obtain the format string of the screen casting configuration file, which is generated during the encoding process of the screen casting configuration information; The format string is parsed according to the information decoding format to obtain the screen casting configuration information of the screen casting configuration file; Configure the screen casting parameters of the second screen casting process according to the screen casting configuration information.

5. The display device according to claim 3, characterized in that, After the first screen projection process connects to the business logic interface, the controller is further configured to: Parse the current configuration information and optional configuration information in the screen mirroring configuration file; Through the first screen projection process, a screen projection signal process is created based on the current configuration information and the optional configuration information. The screen projection signal process is used to characterize the configuration status of the screen projection process.

6. The display device according to claim 5, characterized in that, The controller performs the step of obtaining the screen projection configuration file through the second screen projection process, specifically configured as follows: The first screen casting process listens for configuration update events, which are used to indicate that the configuration status of the screen casting configuration information has been updated. Modify the screen projection signal process according to the configuration update event; The screen casting configuration file is updated according to the modified screen casting signal process.

7. The display device according to claim 6, characterized in that, The controller updates the screen projection configuration file according to the modified screen projection signal process, specifically configured as follows: The revised configuration information of the modified screen projection signal process is parsed, and the revised configuration information is used to characterize the modified screen projection configuration information; Update the current configuration information and the optional configuration information according to the revised configuration information; The screen mirroring configuration file is updated based on the updated current configuration information and the updated optional configuration information.

8. The display device according to claim 7, characterized in that, The controller updates the screen projection configuration file based on the updated current configuration information and the updated optional configuration information, specifically configured as follows: An update prompt message is generated based on the updated current configuration information and the updated optional configuration information; The update prompt message is sent to the second screen mirroring process to update the screen mirroring configuration file through the second screen mirroring process.

9. The display device according to claim 1, characterized in that, It also includes an audio output device configured to play audio data, and the controller, according to the projection parameters, projects the projection data onto the display, and is further configured to: Obtain the audio playback parameters from the screen projection parameters; Configure the audio data in the screen projection data according to the audio playback parameters; While the screen is displaying the screen projection data, the audio output device is controlled to play the audio data.

10. A screen mirroring configuration method, characterized in that, The display device according to any one of claims 1-9 includes a display, a communication device, and a controller, wherein the display is configured to display a projected image. The communication device is configured to establish a communication connection with a terminal device; the method includes: In response to a screen mirroring command, screen mirroring data is acquired, and the screen mirroring process corresponding to the screen mirroring data is detected. The screen mirroring process is either a first screen mirroring process or a second screen mirroring process. The first screen mirroring process is started when a power-on event is detected. The first screen mirroring process is used to connect to the business logic interface to obtain the screen mirroring configuration file. The second screen mirroring process is started in response to the screen mirroring command. If the screen casting process is a second screen casting process, then the screen casting configuration file is obtained through the second screen casting process, and the screen casting parameters of the second screen casting process are configured through the screen casting configuration file; Play the projection data according to the projection parameters so that the display shows the projection screen corresponding to the projection data.

Images