Display device and black screen detection method

Abstract

The application provides a display device and a black screen detection method. The display device comprises a display and a controller. The controller is configured to obtain a target image screenshot corresponding to a target image, detect all pixel points in a preset region of the target image screenshot, and determine that a video layer corresponding to the target image is in a black screen state if all the pixel points in the preset region are black. If there is a pixel point in the preset region that is not black, it is determined that the video layer corresponding to the target image is not in the black screen state. The display device can automatically detect the black screen of the video layer, has high intelligence, and improves the user experience. Meanwhile, manual detection is avoided, and the accuracy of the black screen detection can be improved.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a black screen detection method. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, mobile terminals, smart advertising screens, and projectors. With the rapid development of display devices, their functions are becoming increasingly rich and their performance increasingly powerful, enabling two-way human-computer interaction and integrating multiple functions such as audio-visual, entertainment, and data processing to meet diverse and personalized user needs. Display devices can play various media materials for users to watch and can also utilize camera devices to achieve specific functions such as video chat and video recording.

[0003] When a user uses a display device, such as when playing media files, the displayed media interface may appear black. If this black screen occurs frequently, the display device may be malfunctioning, for example, due to a problem with its internal wiring. Therefore, to determine if the display device is malfunctioning, the black screen issue can be detected while the display is playing media files.

[0004] However, during the use of display devices, users typically manually inspect the black screen of the media asset interface. Therefore, the display devices have a low level of intelligence, resulting in a poor user experience. Furthermore, manual inspection of the black screen may lead to missed instances, making it impossible to detect all black screen conditions, thus resulting in poor accuracy. Summary of the Invention

[0005] This invention provides a display device and a black screen detection method to solve the problem of poor accuracy in detecting black screen conditions on media asset interfaces in related technologies.

[0006] In a first aspect, this application provides a display device. The display device includes a display and a controller. The display is configured to display a target image; the controller is configured to perform the following steps:

[0007] In response to a user-input instruction to detect a black screen state, a screenshot of the target image is obtained; all pixels in a preset area of ​​the target image screenshot are detected; if all pixels in the preset area are black, it is determined that the video layer corresponding to the target image is in a black screen state.

[0008] In some implementations, the controller is further configured to: during the step of acquiring a screenshot of the target image corresponding to the target image,

[0009] When the monitor displays the target image in full-screen mode, a screenshot is taken of the currently displayed screen to obtain a screenshot of the target image.

[0010] In some implementations, the controller is further configured to: during the step of acquiring a screenshot of the target image corresponding to the target image,

[0011] When the monitor is not displaying the target image in full-screen mode, a screenshot operation is performed on the current display screen to obtain a screenshot image; the position information of the video layer corresponding to the target image on the monitor is obtained; the image corresponding to the position information in the screenshot image is cropped to obtain a screenshot of the target image.

[0012] In some implementations, the controller is further configured to: after performing the step of detecting all pixels in a preset area of ​​the target image screenshot,

[0013] When all pixels in the preset area are detected to be black, all pixels in the target image screenshot are detected; if all pixels in the target image screenshot are black, it is determined that the video layer corresponding to the target image is in a black screen state.

[0014] In some implementations, the controller is further configured to: acquire a screenshot of the target image corresponding to the target image at the next moment, so as to detect whether the video layer is in a black screen state at the next moment.

[0015] In some implementations, the controller is further configured as follows:

[0016] When it is detected that the video layer corresponding to the target image is in a black screen state, a screenshot of the target image corresponding to the target image is obtained after a first preset time, and it is detected whether the video layer is in a black screen state after the first preset time; when it is detected that the video layer corresponding to the target image is not in a black screen state, a screenshot of the target image corresponding to the target image is obtained after a second preset time, and it is detected whether the video layer is in a black screen state after the second preset time.

[0017] In some implementations, the controller is further configured as follows:

[0018] When the video layer is detected to be continuously in a black screen state, and the number of consecutive black screen states reaches a preset threshold, it is considered that the display is in an abnormal state when displaying the target image, and an abnormal state information is sent to the server. The abnormal state information includes the number of consecutive black screen states of the video layer.

[0019] In some implementations, the controller is further configured as follows:

[0020] In response to a user's input query command to inquire about the black screen status of the video layer, the display is controlled to show the black screen status, so that the user can set the first preset time and the second preset time according to the black screen status; the black screen status includes the total number of times the video layer is in the black screen state, the number of times the video layer is in the black screen state consecutively, the first preset time and the second preset time.

[0021] In some implementations, the controller is further configured to: before performing the step of acquiring a screenshot of the target image corresponding to the target image,

[0022] Send a screenshot lock request to a preset screenshot lock file; the preset screenshot lock file stores screenshot locks, which have the permission to take screenshots of the currently displayed screen; receive a screenshot lock sent by the screenshot lock file when no other application requests a screenshot lock; when a screenshot lock is received from the screenshot lock file, execute the step of obtaining a screenshot of the target image corresponding to the target image.

[0023] Secondly, this application provides a black screen detection method, applied to a display device, the method comprising:

[0024] In response to a user-input instruction to detect a black screen state, a screenshot of the target image is acquired; all pixels in a preset area of ​​the target image screenshot are detected; if all pixels in the preset area are black, it is determined that the video layer corresponding to the target image is in a black screen state.

[0025] As can be seen from the above technical solutions, this application provides a display device and a black screen detection method, which can acquire a screenshot of the target image corresponding to the target image. Then, all pixels in a preset area of ​​the target image screenshot are detected; if all pixels in the preset area are black, it is determined that the video layer corresponding to the target image is in a black screen state. If there are non-black pixels in the preset area, it is determined that the video layer corresponding to the target image is not in a black screen state. The display device can automatically perform black screen detection on the video layer, exhibiting a high degree of intelligence and improving the user experience. Simultaneously, it avoids manual detection, improving the accuracy of black screen detection. Attached Figure Description

[0026] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This illustrates a use case of a display device according to some embodiments;

[0028] Figure 2 A hardware configuration block diagram of a control device 100 according to some embodiments is shown;

[0029] Figure 3 A hardware configuration block diagram of a display device 200 according to some embodiments is shown;

[0030] Figure 4 A software configuration diagram of a display device 200 according to some embodiments is shown;

[0031] Figure 5 The diagrams show the interaction flowcharts of various components of the display device in some embodiments;

[0032] Figure 6 A schematic diagram of a program recommendation interface in a feasible embodiment is shown;

[0033] Figure 7a A user interface in a display is shown in a feasible embodiment;

[0034] Figure 7b A schematic diagram of a player software list in a feasible embodiment is shown;

[0035] Figure 8 A schematic diagram showing the display of black screen detection mode confirmation information in a feasible embodiment is shown;

[0036] Figure 9 The image displayed on the monitor in one feasible embodiment is shown;

[0037] Figure 10a -c illustrates a schematic diagram of a preset area in a feasible embodiment;

[0038] Figure 11 A schematic diagram illustrating the logic of detecting all pixels in a preset area in a feasible embodiment is shown.

[0039] Figure 12 A schematic diagram illustrating the logic for performing the next black screen detection in a feasible embodiment is shown;

[0040] Figure 13 A schematic diagram of a black screen state in a display showing the video layer in a feasible embodiment is shown;

[0041] Figure 14 A schematic diagram of the logic of the black screen detection module requesting a screenshot lock in a feasible embodiment is shown;

[0042] Figure 15 A flowchart illustrating an embodiment of a black screen detection method is shown. Detailed Implementation

[0043] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0044] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0045] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0046] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0047] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0048] Figure 1 This is a schematic diagram illustrating a usage scenario of the display device according to an embodiment. For example... Figure 1 As shown, the display device 200 also communicates with the server 400, and the user can operate the display device 200 through the smart device 300 or the control device 100.

[0049] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via a wired connection. Users can control the display device 200 by inputting user commands through at least one method, such as buttons on the remote control, voice input, or control panel input.

[0050] In some embodiments, the smart device 300 may include any one of a mobile terminal, tablet computer, computer, laptop computer, AR / VR device, etc.

[0051] In some embodiments, a smart device 300 may also be used to control the display device 200. For example, a camera application running on the smart device may be used to control the display device 200.

[0052] In some embodiments, the smart device 300 and the display device may also be used for data communication.

[0053] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0054] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0055] In some embodiments, software steps executed by one execution entity can be migrated to another execution entity with which it communicates data, as needed. For example, software steps executed by a server can be migrated to a display device with which it communicates data, and vice versa.

[0056] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0057] In some embodiments, the communication interface 130 is used for external communication and includes at least one of a WIFI chip, a Bluetooth module, an NFC module, or an alternative module.

[0058] In some embodiments, the user input / output interface 140 includes at least one of a microphone, touchpad, sensor, button, or alternative module.

[0059] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown.

[0060] In some embodiments, the display device 200 includes at least one of a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0061] In some embodiments, the controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to an nth interface for input / output.

[0062] In some embodiments, the display 260 includes a display screen component for presenting an image, a driving component for driving image display, a component for receiving image signals output from a controller, and a user control UI interface, etc.

[0063] In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0064] In some embodiments, the tuner 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

[0065] In some embodiments, the communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

[0066] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0067] In some embodiments, the external device interface 240 may include, but is not limited to, one or more interfaces such as: High Definition Multimedia Interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0068] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0069] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations via various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command.

[0070] In some embodiments, the object can be any of the optional objects, such as a hyperlink, an icon, or other operable controls. Operations related to the selected object include: displaying links to hyperlinked pages, documents, images, etc., or performing operations corresponding to the program associated with the icon.

[0071] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0072] A CPU (CPU) processor is used to execute operating system and camera application instructions stored in memory, as well as various interactive instructions received from external input, to perform various camera applications, data, and content, ultimately displaying and playing various audio and video content. A CPU processor may include multiple processors, such as a main processor and one or more sub-processors.

[0073] In some embodiments, a graphics processor is used to generate at least one of various graphical objects, such as icons, operation menus, and user-input-based graphics. The graphics processor includes an arithmetic logic unit (ALU) that performs calculations based on various user-input interactive commands and displays various objects according to display attributes; it also includes a renderer that renders the various objects obtained from the ALU, the rendered objects being displayed on a monitor.

[0074] In some embodiments, a video processor is configured to receive an external video signal and perform at least one of the following video processing operations according to a standard encoding and decoding protocol of the input signal: decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., to obtain a signal that can be directly displayed or played on a display device 200.

[0075] In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, and a display formatting module. The demultiplexing module demultiplexes the input audio and video data streams. The video decoding module processes the demultiplexed video signal, including decoding and scaling. The image compositing module, such as an image synthesizer, overlays and blends a GUI signal generated by a graphics generator based on user input or its own generation with the scaled video image to generate a displayable image signal. The frame rate conversion module converts the input video frame rate. The display formatting module modifies the received frame rate-converted video output signal to conform to a display format, such as outputting RGB data signals.

[0076] In some embodiments, an audio processor is configured to receive external audio signals, perform decompression and decoding according to a standard codec protocol of the input signal, and at least one of the following processes: noise reduction, digital-to-analog conversion, and amplification, to obtain a sound signal that can be played in a speaker.

[0077] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0078] In some embodiments, a "user interface" is the medium through which a camera application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0079] In some embodiments, the user interface 280 is an interface that can be used to receive control input (e.g., physical buttons on the display device body, or others).

[0080] In some embodiments, the display device's system may include a kernel, a command interpreter (shell), a file system, and a camera application. The kernel, shell, and file system together form the basic operating system structure, allowing users to manage files, run programs, and use the system. Upon power-up, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, and runs and maintains virtual memory, the scheduler, signals, and inter-process communication (IPC). After the kernel starts, the shell and the user's camera application are loaded. The camera application is compiled into machine code after startup, forming a process.

[0081] See Figure 4 In some embodiments, the system is divided into four layers, from top to bottom: the camera application layer (referred to as the "application layer"), the camera application framework layer (referred to as the "framework layer"), the Android runtime and system library layer (referred to as the "system runtime library layer"), and the kernel layer.

[0082] In some embodiments, at least one camera application runs in the camera application layer. These camera applications can be built-in Windows programs, system settings programs, or clock programs of the operating system; they can also be camera applications developed by third-party developers. In specific implementations, the camera application package in the camera application layer is not limited to the examples above.

[0083] The framework layer provides the application programming interface (API) and programming framework for the camera application in the camera application layer. The camera application framework layer includes some predefined functions. It acts as a processing center, determining the actions taken by the camera application within the application layer. Through the API interface, the camera application can access system resources and obtain system services during execution.

[0084] like Figure 4As shown, the camera application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: ActivityManager, which interacts with all activities running in the system; LocationManager, which provides access to system location services to system services or applications; PackageManager, which retrieves various information related to the camera application package currently installed on the device; NotificationManager, which controls the display and clearing of notification messages; and WindowManager, which manages icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0085] In some embodiments, the Activity Manager manages the lifecycle of each camera application and common navigation and back functions, such as controlling the exit, opening, and back actions of the camera application. The Window Manager manages all window applications, such as obtaining the screen size, determining whether a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0086] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0087] In some embodiments, the kernel layer is a layer between hardware and software. For example... Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0088] When users play media files on a display device, the displayed media file interface may appear black. If this black screen occurs frequently, the display device may be malfunctioning; for example, there might be a problem with its internal wiring. Therefore, to determine if there is a malfunction, the black screen phenomenon can be detected while the display device is playing media files.

[0089] This application provides a display device, including a monitor and a controller. The monitor is used to display a target image, which may be a user-specified video or similar image.

[0090] Figure 5 The diagram shows the interaction flowcharts of various components of the display device in some embodiments.

[0091] In some embodiments, the target image can be various media resources. The display can play media resources from the network, such as movies and videos. When playing media resources, the controller can acquire image data from the network signal source, process the image data to obtain the target image, and display the target image on the video layer of the display. This allows the user to view the target image.

[0092] In some embodiments, when the user controls the display device to power on, the controller can control the display to show a program recommendation interface. Figure 6 A schematic diagram of a program recommendation interface in a feasible embodiment is shown. Users can select specific programs on the program recommendation interface, while the controller acquires the target image corresponding to the specific program from the network signal source and displays the target image on the video layer of the display for the user to watch.

[0093] In some embodiments, multiple media player software programs may be installed on the display device. When a user clicks on a media player software program, a list of media assets within that program can be displayed on the screen. When the user selects a media asset, the media player software can retrieve the corresponding media asset from the network and play it on the screen. Figure 7a A user interface on a display is shown in one feasible embodiment. Users can click "My Apps" in the user interface to view a list of media player software, which includes all media player software installed on the display device.

[0094] Figure 7b A schematic diagram of a player software list in a feasible embodiment is shown. When the player software list is displayed on the screen, the user can select one of the player software programs and open it to select and play media resources within that program.

[0095] In some embodiments, the display device further includes an image acquisition device, such as a camera. The camera is used to acquire image data. The target image may also be an image acquired by the camera.

[0096] A camera can be built into a display device as a detector, or it can be connected externally to the display device. For cameras connected externally, the camera can be connected to the display device's external interface. Users can then use the camera to take photos or videos on the display device, displaying the captured images on the video layer of the monitor for viewing.

[0097] The camera may further include a lens assembly, which houses a photosensitive element and a lens. The lens, through the refraction of light by multiple lenses, allows light from the scene to illuminate the photosensitive element. The photosensitive element, depending on the camera's specifications, may be based on a CCD (Charge-coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) detection principle. It converts light signals into electrical signals using photosensitive materials and outputs the converted electrical signals as image data. The camera can also acquire image data frame-by-frame at a set sampling frequency to form a video stream.

[0098] While displaying the target image, the display device can also detect the corresponding video layer to determine whether the video layer is black.

[0099] In some embodiments, the display device has a black screen detection function, which can detect the black screen status of the video layer corresponding to the target image. The display device can be configured with a black screen detection mode. In the black screen detection mode, the display device can automatically detect whether the video layer is in a black screen state.

[0100] In some embodiments, a user can send a black screen detection mode command to the display device by operating a designated button on the remote control. In practical applications, a pre-defined mapping between the black screen detection mode command and the remote control button is established. For example, a black screen detection mode button is set on the remote control. When the user touches this button, the remote control sends a black screen detection mode command to the controller, which then controls the display device to enter black screen detection mode. When the user touches the button again, the controller can control the display device to exit black screen detection mode.

[0101] In some embodiments, a pre-defined mapping relationship can be established between the black screen detection mode command and multiple remote control buttons. When the user touches the buttons bound to the black screen detection mode command, the remote control issues the black screen detection mode command. In one feasible embodiment, the buttons bound to the black screen detection mode command are, in sequence, the directional keys (left, down, left, down). That is, the remote control only sends the black screen detection mode command to the controller when the user continuously touches the buttons (left, down, left, down) within a preset time. Using the above binding method can prevent the black screen detection mode command from being issued due to user error. This application embodiment only provides several exemplary binding relationships between black screen detection mode commands and buttons. In actual applications, the binding relationship between black screen detection mode commands and buttons can be set according to user habits, and no further limitations are imposed here.

[0102] In some embodiments, a user can use the display device's sound acquisition device, such as a microphone, to send a black screen detection mode command to the display device via voice input, thereby controlling the display device to enter black screen detection mode. The display device may be equipped with an intelligent voice system that can recognize the user's voice to extract the user's input commands. The user can input a preset wake-up word through the microphone to activate the intelligent voice system, allowing the controller to respond to the user's input commands. Within a certain time period, the user can input a black screen detection mode command to cause the display device to enter black screen detection mode. For example, the user can input "[User's name]" to activate the intelligent voice system, and then input "Enter black screen detection mode" to send the black screen detection mode command to the display device.

[0103] In some embodiments, the user can also send a black screen detection mode command to the display device via a preset gesture. The display device can detect the user's behavior through an image sensor, such as a camera. When the user makes a preset gesture, it can be considered that the user has sent a black screen detection mode command to the display device. For example, it can be set so that when the user draws a V-shape, it is determined that the user has input a black screen detection mode command to the display device. The user can also send a black screen detection mode command to the display device via a preset action. For example, it can be set so that when the user simultaneously raises their left foot and right hand, it is determined that the user has input a black screen detection mode command to the display device.

[0104] In some embodiments, when a user controls a display device using a smart device, such as a mobile phone, a black screen detection mode command can be sent to the display device. In practical applications, a control can be set in the mobile phone, which allows the user to select whether to enter the black screen detection mode, thereby sending a black screen detection mode command to the controller. At this time, the controller can control the display device to enter the black screen detection mode.

[0105] In some embodiments, when a user controls a display device using a mobile phone, they can issue a continuous click command to the phone. A continuous click command refers to the user clicking the same area of ​​the phone's touchscreen more than a preset threshold number of times within a preset period. For example, if a user clicks a certain area of ​​the phone's touchscreen three times consecutively within 1 second, it is considered one continuous click command. After receiving the continuous click command, the mobile phone can send a black screen detection mode command to the display device, so that the controller controls the display device to enter black screen detection mode.

[0106] In some embodiments, when a user controls a display device using a mobile phone, the mobile phone can be configured to send a black screen detection mode command to the display device when the user's touch pressure value on a certain area of ​​the mobile phone touch screen exceeds a preset pressure threshold.

[0107] You can also set a black screen detection mode option in the UI of the display device. When the user clicks this option, they can control the display device to enter or exit the black screen detection mode.

[0108] In some embodiments, to prevent users from accidentally triggering the black screen detection mode, when the controller receives a black screen detection mode instruction, it can control the display to show black screen detection mode confirmation information, thereby allowing the user to confirm whether to control the display device to enter the black screen detection mode. Figure 8 A schematic diagram showing the display of black screen detection mode confirmation information in a feasible embodiment is shown.

[0109] When the display device enters the black screen detection mode, it can automatically detect whether the video layer corresponding to the target image is in a black screen state.

[0110] In some embodiments, when the display device enters a black screen detection mode, the controller can detect whether a target image is displayed on the screen. When a target image is displayed on the screen, the controller can acquire a screenshot of the target image, i.e., a target image screenshot.

[0111] Specifically, the display device enters the black screen detection mode at time t1. At this time, the controller can obtain the target image screenshot corresponding to the target image at time t1 and detect whether the video layer corresponding to the target image at time t1 is in a black screen state.

[0112] In some embodiments, the controller can control the display to show the target image in full screen, in which case the image displayed on the display is the target image. Alternatively, the controller can control the display not to show the target image in full screen, in which case the image displayed on the display includes other content besides the target image. Figure 9 The illustration shows a display screen in a feasible embodiment. The display screen may include multiple windows, such as a video layer and an OSD layer. The video layer displays the target image, such as media assets. The OSD layer may display information about the media assets, such as lead actors, director, screenwriter, region, film / television genre, and release date.

[0113] In some embodiments, when the display shows the target image in full-screen mode, the controller can take a screenshot of the currently displayed screen to obtain a screenshot image. Since the display shows the target image in full-screen mode, the currently displayed screen is the target image. The obtained screenshot image is a capture of the target image, i.e., a screenshot of the target image.

[0114] In some embodiments, when the display is not showing the target image in full-screen mode, the controller can also take a screenshot of the currently displayed screen to obtain a screenshot image. It should be noted that the currently displayed screen contains other content besides the target image. Since the controller detects the black screen state of the video layer corresponding to the target image, directly detecting the screenshot image would also detect some irrelevant areas, resulting in low detection efficiency and wasted resources. Therefore, the controller can obtain the position information of the video layer corresponding to the target image on the display. For example, when the video layer is rectangular, the controller can obtain the coordinate information of the four vertices X1, X2, X3, and X4 of the video layer; the area between points X1, X2, X3, and X4 is the video layer. The position information of the video layer on the display can be determined based on the coordinate information of points X1, X2, X3, and X4.

[0115] When the position information of the video layer on the display is obtained, the image corresponding to that position information in the screenshot image can be cropped, and the final cropped image is the target image screenshot.

[0116] This application can perform black screen detection on the video layer corresponding to the target image even when the target image is not displayed in full screen on the monitor, and the detection efficiency is relatively high.

[0117] In some embodiments, the display device may include a monitoring module. When the display is not showing the target image in full-screen mode, the monitoring module can detect the position information of the video layer on the display in real time. Upon detecting the position information of the video layer on the display, the monitoring module can send the position information to the controller, thereby enabling the controller to obtain a screenshot of the target image based on the position information of the video layer on the display.

[0118] In some embodiments, after obtaining a screenshot of the target image, the controller can detect the black screen condition of the video layer corresponding to the target image based on the screenshot.

[0119] When detecting black screen conditions in the video layer, a preset area of ​​the target image screenshot can be detected.

[0120] In some embodiments, the controller can detect all pixels in a preset area. When all pixels in the preset area are black, the preset area is in a black screen state. In this case, the video layer corresponding to the target image can be considered to be in a black screen state.

[0121] If there are non-black pixels in the preset area, then the preset area is not in a black screen state. At this time, the video layer corresponding to the target image is also not in a black screen state.

[0122] This application can automatically detect whether the video layer corresponding to the target image is in a black screen state using the display device, thus exhibiting a high degree of intelligence and providing a superior user experience. Furthermore, it utilizes pixel-level detection to determine whether the video layer is in a black screen state, ensuring high accuracy and eliminating false positives.

[0123] In some embodiments, when detecting whether a pixel in a preset area is black, the controller can detect the RGB (optical primary colors) value of each pixel. For a pixel, if the RGB value is 0 / 0 / 0, then the pixel is black. Therefore, if the RGB value of all pixels in the preset area is 0 / 0 / 0, then all pixels in the preset area are black, and the preset area is in a black screen state. Further, it can be considered that the video layer corresponding to the target image is in a black screen state.

[0124] In some embodiments, users can set the preset areas to be detected. To improve the accuracy of black screen detection, the preset areas can be made to intersect with various areas of the target image screenshot as much as possible.

[0125] Figure 10a -c illustrates a schematic diagram of a preset region in a feasible embodiment. The preset region may include three parts. The first part of the preset region is as follows: Figure 10a As shown, in the target image screenshot, four diagonal lines k1, k2, k3, and k4 can be drawn with the four vertices as endpoints. These four diagonal lines constitute the first part of the preset area. The second part of the preset area is as follows... Figure 10b As shown, the target image screenshot can be divided into M+1 equal parts along the vertical direction using M dividing lines. These M horizontal dividing lines constitute the second part of the preset area. For example, the target image screenshot can be divided into 4 equal parts using 3 horizontal lines m1, m2, and m3, and the second part of the preset area is these 3 horizontal lines. The third part of the preset area is as follows. Figure 10c As shown, the target image screenshot can be divided into N+1 equal parts along the horizontal direction using N dividing lines. These N vertical dividing lines are the third part of the preset area. For example, the target image screenshot can be divided into 6 equal parts using 5 vertical lines n1, n2, n3, n4 and n5. The third part of the preset area is these 5 vertical lines.

[0126] In the target image screenshot, four diagonal lines, M horizontal dividing lines, and N vertical dividing lines together constitute the preset area. The controller can detect all pixels in the preset area to determine whether the video layer corresponding to the target image is in a black screen state.

[0127] In some embodiments, the width of all dividing lines in a preset area can be set to the width of one pixel. Specifically, for horizontal dividing lines, their length is the same as the length of the target image screenshot, and their width is one pixel. For vertical dividing lines, their length is the same as the width of the target image screenshot, and their width is one pixel. For the four diagonal lines, their width is one pixel.

[0128] In some embodiments, when the controller detects all pixels in a preset area, it can sequentially determine the three parts of the preset area. For example, the controller can first detect all pixels along the four diagonal lines. If the RGB value of a pixel in these four diagonal lines is not 0 / 0 / 0, that is, if a pixel in the preset area is not black, then the preset area is not in a black screen state, and the video layer corresponding to the target image is also not in a black screen state. At this time, it is not necessary to detect the remaining preset areas.

[0129] When all pixels along the four diagonal lines have RGB values ​​of 0 / 0 / 0 (meaning all pixels along the four diagonal lines are black), the detection continues with all pixels along the M horizontal dividing lines. If any pixel along these four diagonal lines has an RGB value other than 0 / 0 / 0 (meaning there are pixels in the preset area that are not black), then the preset area is not a black screen, and the corresponding video layer of the target image is also not a black screen. In this case, it is unnecessary to detect the remaining preset areas.

[0130] When all pixels in the M horizontal dividing lines have RGB values ​​of 0 / 0 / 0, meaning all pixels in the M horizontal dividing lines are black, the process continues to detect all pixels in the N vertical dividing lines. If there are pixels in the N vertical dividing lines whose RGB values ​​are not 0 / 0 / 0, meaning there are pixels in the preset area that are not black, then the preset area is not a black screen, and the video layer corresponding to the target image is also not a black screen. If all pixels in the N vertical dividing lines have RGB values ​​of 0 / 0 / 0, then all pixels in the preset area are black. Therefore, the preset area is a black screen, and the video layer corresponding to the target image can be considered to be in a black screen state.

[0131] Figure 11 A schematic diagram of the logic for detecting all pixels in a preset area is shown in a feasible embodiment.

[0132] In some embodiments, if only a very small number of pixels in the target image screenshot are not black, the preset area may not be able to cover these pixels, resulting in their failure to be detected. In this case, classifying the video layer corresponding to the target image as a black screen would be clearly inaccurate. Therefore, to ensure the accuracy of black screen detection and prevent missed detections, when all pixels in the preset area are detected to be black, further detection can be performed on all pixels in the target image screenshot.

[0133] If any pixel in the target image screenshot has an RGB value that is not 0 / 0 / 0 (meaning there are pixels in the target image screenshot that are not black), then the corresponding video layer of the target image is not in a black screen state. If all pixels in the target image screenshot have an RGB value of 0 / 0 / 0 (meaning all pixels in the target image screenshot are black), then the corresponding video layer of the target image is in a black screen state.

[0134] In some embodiments, after detecting a black screen in the video layer corresponding to the target image at time t1, the controller can continue to detect the target image screenshot at the next time step, i.e., time t2. Furthermore, all pixels in the target image screenshot at time t2 can be detected to determine whether the video layer corresponding to the target image is in a black screen state at time t2.

[0135] In some embodiments, a preset period T, such as 5 seconds, can be set between two black screen detections. That is, the controller can detect black screen conditions in the video layer based on the period T. After detecting a black screen in the video layer at a certain moment, the next screenshot operation can be performed after period T to obtain the next target image screenshot, and then the next black screen detection can be performed.

[0136] In some embodiments, when a black screen is detected in the video layer corresponding to the target image, the black screen detection period can be shortened to ensure real-time performance. When no black screen is detected in the video layer corresponding to the target image, the black screen detection period can be lengthened to avoid wasting resources due to frequent black screen detection.

[0137] Therefore, two black screen detection cycles can be set. When a black screen is detected in the video layer corresponding to the target image, a screenshot of the target image can be obtained again after a first preset time T1, for example, 1 second, and the next black screen detection can be performed. At this time, the black screen detection cycle is relatively short, which can quickly detect the black screen state of the video layer.

[0138] When the video layer corresponding to the target image is detected to be not in a black screen state, a screenshot of the target image can be acquired again after a second preset time T2, for example, 5 seconds, and the next black screen detection can be performed. Since no video layer is detected to be in a black screen state, the black screen detection period is set to be relatively long at this time to avoid wasting resources.

[0139] Figure 12 A schematic diagram illustrating the logic for the next black screen detection in a feasible embodiment is shown. Specifically, a first preset time T1 and a second preset time T2 can be preset. After performing a black screen detection on the video layer corresponding to the target image at time t1, the black screen status of the video layer can be determined. If the video layer is in a black screen state at time t1, the next black screen detection is performed after the first preset time T1, that is, at time t1+T1. If the video layer is not in a black screen state at time t1, the next black screen detection is performed after the second preset time T2, that is, at time t1+T2.

[0140] In some embodiments, a preset threshold N can be set in advance. When performing black screen detection, if the video layer corresponding to the target image is detected to be in a black screen state N times consecutively, it can be considered that the display is in an abnormal state when displaying the target image. At this time, the display device may be malfunctioning, such as a loose or disconnected circuit.

[0141] At this point, abnormal status information can be generated to indicate that the current display device is in an abnormal playback state. The number of consecutive times the video layer is in a black screen state, i.e., a preset threshold N, can also be written into the abnormal status information and sent to the server. The server can then statistically process and analyze the abnormal status information to generate a black screen detection result analysis report. Based on this report, product optimization for the display device can be performed.

[0142] In some embodiments, the display device can show the user the black screen state of the video layer. The black screen state of the video layer may include the total number of times the video layer is in a black screen state, the number of consecutive times the video layer is in a black screen state, a first preset time, and a second preset time.

[0143] Users can send query commands to the display device by pressing designated buttons on the remote control. In practical applications, a pre-defined mapping is established between query commands and remote control buttons. For example, a query button can be set on the remote control; when the user touches this button, the remote control sends a query command to the controller, which then controls the display to show the black screen state of the video layer. Alternatively, the user can access the settings UI menu, and the controller controls the OSD layer menu to show the black screen state of the video layer.

[0144] After viewing the black screen status of the video layer, users can also set the first and second preset times themselves. Figure 13 This diagram illustrates a feasible embodiment of a display showing a black screen state of the video layer. The user can view the total number of times the video layer was in a black screen state, the number of consecutive times the video layer was in a black screen state, and the first and second preset times. The user can also set the values ​​for the first and second preset times themselves.

[0145] In some embodiments, the display device may include a black screen detection module. The black screen detection module internally stores the algorithm corresponding to the aforementioned black screen detection method. Therefore, the black screen detection module can obtain a screenshot of the target image and further detect all pixels in a preset area of ​​the target image screenshot to determine whether the video layer corresponding to the target image is in a black screen state.

[0146] In some embodiments, applications within the display device can also take screenshots of the screen displayed. When the black screen detection module and other applications attempt to take screenshots, screenshot conflicts may occur. To avoid these conflicts, the display device can have a pre-configured screenshot lock file. This file stores screenshot locks, each granting permission to take screenshots of the currently displayed screen. Only when the black screen detection module or other applications obtain a screenshot lock from the file can they take a screenshot of the screen.

[0147] Figure 14 A schematic diagram illustrating the logic of a black screen detection module requesting a screenshot lock in a feasible embodiment is shown. First, it is determined whether a screenshot lock file exists; if not, a screenshot lock file is constructed. When a screenshot lock file exists on the display device, the black screen detection module can send a screenshot lock request to the screenshot lock file. If no other application requests a screenshot lock from the screenshot lock file, the screenshot lock file can send the screenshot lock to the black screen detection module. After obtaining the screenshot lock, the black screen detection module can perform a screenshot operation on the screen, thereby obtaining a screenshot of the target image.

[0148] Once the screenshot operation is complete, the black screen detection module can release the screenshot lock, allowing other applications to take screenshots of the screen displayed on the monitor.

[0149] This application takes into account the possibility that other applications may occupy the screenshot operation when performing black screen detection, thus avoiding screenshot conflicts and further improving the stability of black screen detection.

[0150] This application also provides a black screen detection method, applied to display devices, such as... Figure 15 As shown, the method includes:

[0151] Step 1501: In response to the user's input instruction to detect the black screen state, obtain the target image screenshot corresponding to the target image;

[0152] Step 1502: Detect all pixels in the preset area of ​​the target image screenshot;

[0153] Step 1503: If all pixels in the preset area are black, then the video layer corresponding to the target image is determined to be in a black screen state; if there are pixels in the preset area that are not black, then the video layer corresponding to the target image is determined to be not in a black screen state.

[0154] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0155] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0156] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0157] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of embodiments suitable for specific application considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the target image; The controller is configured as follows: In response to user input, a detection command is used to detect a black screen state. When the monitor is not displaying the target image in full-screen mode, a screenshot operation is performed on the currently displayed screen to obtain a screenshot image. The position information of the video layer corresponding to the target image in the display is obtained, wherein the position information is detected in real time by the monitoring module of the display device and sent to the controller; The image corresponding to the location information in the screenshot is cropped to obtain the target image screenshot; All pixels in a preset area of ​​the target image screenshot are detected. The preset area includes four diagonal lines, M horizontal dividing lines, and N vertical dividing lines drawn from the four vertices of the video layer. The M horizontal dividing lines divide the target image screenshot vertically into M+1 equal parts, and the N vertical dividing lines divide the target image screenshot horizontally into N+1 equal parts. The width of each diagonal line, horizontal dividing line, and vertical dividing line is the width of one pixel. The length of each horizontal dividing line is the length of the target image screenshot, and the length of each vertical dividing line is the width of the target image screenshot. Sequentially determine whether there are non-black pixels in the diagonal lines, M horizontal dividing lines, and N vertical dividing lines. If they exist, determine that the video layer corresponding to the target image is not in a black screen state. If all pixels in the preset area are black, then all pixels in the target image screenshot are detected, wherein if the RGB value of any pixel is 0 / 0 / 0, then the pixel is black; If all pixels in the target image screenshot are black, it is determined that the video layer corresponding to the target image is in a black screen state.

2. The display device according to claim 1, characterized in that, The controller is further configured to: In the step of obtaining a screenshot of the target image corresponding to the target image... When the monitor displays the target image in full-screen mode, a screenshot is taken of the currently displayed screen to obtain a screenshot of the target image.

3. The display device according to claim 1, characterized in that, The controller is also configured to: Obtain a screenshot of the target image corresponding to the target image at the next moment to detect whether the video layer is in a black screen state at the next moment.

4. The display device according to claim 1, characterized in that, The controller is also configured to: When it is detected that the video layer corresponding to the target image is in a black screen state, a screenshot of the target image corresponding to the target image is obtained after a first preset time, and it is detected whether the video layer is in a black screen state after the first preset time. When it is detected that the video layer corresponding to the target image is not in a black screen state, a screenshot of the target image corresponding to the target image is obtained after a second preset time, and it is detected whether the video layer is in a black screen state after the second preset time.

5. The display device according to claim 4, characterized in that, The controller is also configured to: When the video layer is detected to be continuously in a black screen state, and the number of consecutive black screen states reaches a preset threshold, it is considered that the display is in an abnormal state when displaying the target image, and an abnormal state information is sent to the server. The abnormal state information includes the number of consecutive black screen states of the video layer.

6. The display device according to claim 5, characterized in that, The controller is also configured to: In response to a user's input query command to inquire about the black screen status of the video layer, the display is controlled to show the black screen status, so that the user can set the first preset time and the second preset time according to the black screen status; the black screen status includes the total number of times the video layer is in the black screen state, the number of times the video layer is in the black screen state consecutively, the first preset time and the second preset time.

7. The display device according to claim 2, characterized in that, The controller is also configured to: Before performing the step of obtaining a screenshot of the target image corresponding to the target image. Send a screenshot lock request to a preset screenshot lock file; the preset screenshot lock file stores screenshot locks, and the screenshot locks have the permission to take screenshots of the currently displayed screen. Receive the screenshot lock file when no other application requests a screenshot lock; When a screenshot lock is received from the screenshot lock file, the step of obtaining the screenshot of the target image corresponding to the target image is executed.

8. A black screen detection method, applied to a display device, characterized in that, The method includes: In response to user input, a detection command is used to detect a black screen state. When the monitor is not displaying the target image in full-screen mode, a screenshot operation is performed on the currently displayed screen to obtain a screenshot image. The position information of the video layer corresponding to the target image in the display is obtained, wherein the position information is detected in real time by the monitoring module of the display device; The image corresponding to the location information in the screenshot is cropped to obtain the target image screenshot; All pixels in a preset area of ​​the target image screenshot are detected. The preset area includes four diagonal lines, M horizontal dividing lines, and N vertical dividing lines drawn from the four vertices of the video layer. The M horizontal dividing lines divide the target image screenshot vertically into M+1 equal parts, and the N vertical dividing lines divide the target image screenshot horizontally into N+1 equal parts. The width of each diagonal line, horizontal dividing line, and vertical dividing line is the width of one pixel. The length of each horizontal dividing line is the length of the target image screenshot, and the length of each vertical dividing line is the width of the target image screenshot. Sequentially determine whether there are non-black pixels in the diagonal lines, M horizontal dividing lines, and N vertical dividing lines. If they exist, determine that the video layer corresponding to the target image is not in a black screen state. If all pixels in the preset area are black, then all pixels in the target image screenshot are detected, wherein if the RGB value of any pixel is 0 / 0 / 0, then the pixel is black; If all pixels in the target image screenshot are black, it is determined that the video layer corresponding to the target image is in a black screen state.

Images