Display apparatus, video format recognition method, and storage medium
By using preset video format recognition and image feature comparison algorithms to identify 3D video formats, the problem of complex manual operation for users is solved. It achieves automatic recognition and prompts for correct settings, simplifying the 3D video viewing process.
Patent Information
- Application Number
- CN202411082479.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2026-02-10
AI Technical Summary
In existing technologies, the lack of a clear 3D video format makes it impossible for display devices to automatically switch processing flows, requiring users to manually operate the device to watch 3D videos, resulting in high operational complexity.
The system identifies 3D video formats using preset video format recognition methods and preset image feature comparison algorithms. If recognition fails, it outputs a prompt message to guide the user to select the correct format in the settings menu.
It reduces the complexity of user operations by triggering video format detection at different times, reducing system load, accurately identifying 3D video formats and automatically guiding users to set them up, thus simplifying the 3D movie viewing process.
Smart Images

Figure CN121509639A_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of video data processing, and particularly relates to a display device, a video format identification method and a storage medium. BACKGROUND
[0002] When playing a 3D (3-dimensional) format video through a U disk or an external HDMI (High Definition Multimedia Interface) device, since 3D formats are various, and most 3D format videos do not accurately maintain format information in their data packets or frame packets, the display device cannot automatically cut into the corresponding format processing flow, which causes certain disturbance to the user, and the user must manually adjust the television options to normally watch the 3D video.
[0003] In the related art, the 3D video format is determined by an automatic detection method, and the corresponding format information needs to exist in the slice source code stream or the protocol for transmitting the 3D video. For example, after recognizing the 3D video format, the display device automatically switches to the corresponding mode according to its own capability, such as the 3D format being a left-right format, and then the display device combines the picture into a full-screen mode through an algorithm. However, if the source device does not correctly maintain the information, the television cannot automatically detect it, and at this time, the user needs to manually operate, such as a display device supporting processing of 3D videos in an up-down format and a left-right format. At this time, the played 3D format is left-right, but after the user manually selects the up-down mode, the picture will be seriously distorted, and the user cannot watch it.
[0004] Therefore, for the 3D video without format information transmission, how to reduce the operation complexity of the user in 3D viewing is a current problem to be solved. SUMMARY
[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a display device, a video format identification method and a storage medium, which can reduce the operation complexity of the user in 3D viewing for the 3D video without format information transmission.
[0006] In a first aspect, the present disclosure provides a display device, comprising:
[0007] The communicator is configured to:
[0008] receive a to-be-played video sent by a signal source device; the video format of the to-be-played video is a first 3D video format;
[0009] The controller is configured to:
[0010] In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method;
[0011] If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm.
[0012] The monitor is configured as follows:
[0013] If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, a first prompt message is output; the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu.
[0014] As an optional implementation of this invention, the display is further configured to:
[0015] The step of determining whether the video format of the video to be played has been identified through a preset video format recognition method further includes:
[0016] If the video format of the video to be played is identified as a first 3D video format by the preset video format recognition method, a second prompt message is output; the second prompt message is used to prompt the user that the display should process the video to be played in the first 3D video format.
[0017] As an optional implementation of this invention, the communicator is further configured to:
[0018] Before determining whether the video format of the video to be played is identified through a preset video format recognition method in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, the method further includes:
[0019] Receive a video playback instruction; the video playback instruction is used to instruct the playback of the video to be played.
[0020] or;
[0021] Receive video format setting instructions; the video format setting instructions are used to instruct the setting of the video format of the video to be played.
[0022] As an optional implementation of this invention, the communicator is specifically configured as follows:
[0023] The video to be played, sent by the receiving signal source device, includes:
[0024] The receiving signal source device sends a video to be played via a high-definition multimedia interface in a preset image file format; the preset image file format stores the video format information of the video to be played.
[0025] As an optional implementation of this invention, the controller is specifically configured as follows:
[0026] The step of determining whether the video format of the video to be played is identified through a preset video format recognition method in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, includes:
[0027] Get the numerical value corresponding to the video format information of the video to be played;
[0028] If the value corresponding to the video format information belongs to the preset video format value table, then the video format of the video to be played is determined to be the first 3D video format; the preset video format value table includes values corresponding to multiple video formats;
[0029] If the value corresponding to the video format information does not belong to the preset video format value table, it is determined that the video format of the video to be played has not been identified by the preset video format identification method.
[0030] As an optional implementation of this invention, the controller is further configured as follows:
[0031] The step of determining the target 3D video format of the video to be played using a preset image feature comparison algorithm includes:
[0032] For each separate 3D video frame, the area is divided into regions according to a preset number;
[0033] Obtain the average brightness of the image in each region;
[0034] The target 3D video format of the video to be played is determined by comparing the average brightness of corresponding areas of each separate 3D video frame.
[0035] As an optional implementation of this invention, the controller is further configured to:
[0036] After outputting the first prompt message when the video format input by the user is inconsistent with the target 3D video format of the video to be played, the method further includes:
[0037] In response to the user's target 3D video format setting, the individual 3D video frames are stitched together into a complete 3D video frame using the target 3D video format.
[0038] Secondly, a video format recognition method is provided, the method comprising:
[0039] The system receives a video to be played from a signal source device; the video format of the video to be played is a first 3D video format.
[0040] In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method;
[0041] If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm.
[0042] If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, a first prompt message is output; the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu.
[0043] As an optional implementation of this invention, the step of determining whether the video format of the video to be played is identified through a preset video format recognition method further includes:
[0044] If the video format of the video to be played is identified as a first 3D video format by the preset video format recognition method, a second prompt message is output; the second prompt message is used to prompt the user's monitor to process the video to be played in the first 3D video format.
[0045] As an optional implementation of this invention, before determining whether the video format of the video to be played is identified through a preset video format recognition method in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, the method further includes:
[0046] Receive a video playback instruction; the video playback instruction is used to instruct the playback of the video to be played.
[0047] or;
[0048] Receive video format setting instructions; the video format setting instructions are used to instruct the setting of the video format of the video to be played.
[0049] As an optional implementation of this invention, the communicator is specifically configured as follows:
[0050] The video to be played, sent by the receiving signal source device, includes:
[0051] The receiving signal source device sends a video to be played via a high-definition multimedia interface in a preset image file format; the preset image file format stores the video format information of the video to be played.
[0052] As an optional implementation of this invention, the step of determining whether the video format of the video to be played is identified through a preset video format recognition method in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, includes:
[0053] Get the numerical value corresponding to the video format information of the video to be played;
[0054] If the value corresponding to the video format information belongs to the preset video format value table, then the video format of the video to be played is determined to be the first 3D video format; the preset video format value table includes values corresponding to multiple video formats;
[0055] If the value corresponding to the video format information does not belong to the preset video format value table, it is determined that the video format of the video to be played has not been identified by the preset video format identification method.
[0056] As an optional implementation of this invention, the step of determining the target 3D video format of the video to be played using a preset image feature comparison algorithm includes:
[0057] For each separate 3D video frame, the area is divided into regions according to a preset number;
[0058] Obtain the average brightness of the image in each region;
[0059] The target 3D video format of the video to be played is determined by comparing the average brightness of corresponding areas of each separate 3D video frame.
[0060] As an optional implementation of this invention, after outputting the first prompt message when the video format input by the user is inconsistent with the target 3D video format of the video to be played, the method further includes:
[0061] In response to the user's target 3D video format setting, the individual 3D video frames are stitched together into a complete 3D video frame using the target 3D video format.
[0062] Thirdly, a computer-readable storage medium is provided, comprising: storing a computer program on the computer-readable storage medium, wherein when the computer program is executed by a processor, it implements the video format recognition method as shown in the second aspect.
[0063] Fourthly, a computer program product is provided, comprising: when the computer program product is run on a computer, causing the computer to implement the video format recognition method as shown in the second aspect.
[0064] The technical solution provided in this disclosure has the following advantages compared with the prior art: receiving a video to be played sent by a signal source device; wherein the video format of the video to be played is a first 3D video format; responding to a video playback command for the video to be played, or responding to a video format setting command for the video to be played, determining whether the video format of the video to be played is identified by a preset video format identification method; if the video format of the video to be played is not identified by the preset video format identification method, then determining the target 3D video format of the video to be played by a preset image feature comparison algorithm; outputting a first prompt message when the video format input by the user is inconsistent with the target 3D video format of the video to be played; wherein the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu. For 3D videos that cannot be identified using a preset recognition method, video format detection is triggered at different times. Specifically, when a video playback command for a video to be played is received, or when a video format setting command for a video to be played is received, the video format of the video to be played is first identified using a preset video format recognition method. By triggering video format detection at different times, the detection frequency can be reduced, thereby reducing the system load. If the preset video format recognition method fails, a preset image feature comparison algorithm is used to determine the target 3D video format of the video to be played. If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, the first prompt message is output, prompting the user to select the setting item corresponding to the target 3D video format in the video format setting menu. This accurately identifies the actual format of the video to be played, automatically guides the user to make the correct settings, and reduces the operational complexity of 3D viewing. Attached Figure Description
[0065] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0066] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0067] Figure 1A This is a schematic diagram illustrating an application scenario of a video format recognition method for a display device provided in an embodiment of this disclosure;
[0068] Figure 1A This is a schematic diagram of a 3D video format settings page provided in an embodiment of the present disclosure;
[0069] Figure 1A This is a hardware configuration block diagram of a control device 100 according to one or more embodiments of the present disclosure;
[0070] Figure 1A This is a hardware configuration block diagram of a computer device according to one or more embodiments of the present disclosure;
[0071] Figure 1A This is one of the software configuration diagrams of a computer device according to one or more embodiments of the present disclosure;
[0072] Figure 1A This is a second schematic diagram of the software configuration of a computer device according to one or more embodiments of the present disclosure;
[0073] Figure 1A This is a schematic diagram showing an icon control page of an application program in a computer device according to one or more embodiments of the present disclosure;
[0074] Figure 1A This is one of the flowcharts illustrating a video format recognition method provided in this embodiment of the disclosure;
[0075] Figure 1A This is a second schematic flowchart of a video format recognition method provided in an embodiment of this disclosure;
[0076] Figure 1A This is a third schematic flowchart of a video format recognition method provided in this embodiment of the disclosure;
[0077] Figure 1A A fourth schematic flowchart illustrating another video format recognition method provided in this disclosure embodiment;
[0078] Figure 1A This is a schematic diagram of the structure of a computer device provided in an embodiment of this disclosure. Detailed Implementation
[0079] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.
[0080] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.
[0081] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.
[0082] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.
[0083] Terminology Explanation:
[0084] 3D video formats primarily refer to the formats used to transmit 3D video content. These formats present each frame of the video to the viewer's left and right eyes in a specific way, thus creating a stereoscopic visual experience. Common 3D video formats include: continuous frame format, top-bottom format, side-by-side format, and interlaced format.
[0085] In essence, frame-continuous format involves continuously transmitting images. For example, a 60Hz video would transmit each frame at a rate of 120Hz, with each frame displayed alternately for the left and right eyes to receive sequentially. Frame-continuous format requires a display device that supports a minimum refresh rate of 120Hz.
[0086] Top-and-bottom format, also known as frame encapsulation, is the standard output format for 3D Blu-ray. Each frame actually contains two images arranged vertically. After the image signal is transmitted to the display device, the device is responsible for recognizing, processing, and playing the images. In top-and-bottom 3D format, each frame of the video is vertically split into two halves: the upper half contains the image for the left eye, and the lower half contains the image for the right eye. For example, for a 1920x1080 60fps video source, each frame is split into two 1920x540 images.
[0087] Side-by-side format, which arranges two images side-by-side, typically comes in two forms: full-width and half-width. Full-width format merges two full-HD images into a single frame, while half-width format halves the screen width, reducing a 1920x1080 resolution image to 960x1080 to save bandwidth. In side-by-side 3D format, a frame consists of two halves; the entire frame for the left eye is horizontally shrunk to fit the left half, and the entire frame for the right eye is horizontally shrunk to fit the right half. When a television receives the entire 3D side-by-side signal, it segments each frame to extract the frame seen by each eye, then uses a magnification algorithm to re-decompose these frames into full-HD resolution, displaying these magnified individual frames alternately in a frame sequence. The difference between side-by-side (half-width) and side-by-side (full-width) video is illustrated using a 720p (1280*720 resolution) source video as an example. If you select side-by-side (half-width), the output video frames for the left and right eyes will be 640*720 resolution, and the output video resolution will be 1280*720. If you select side-by-side (full-width), the output video frames for the left and right eyes will also be 1280*720 resolution, meaning the output video resolution will be 2560*720. Therefore, before selecting side-by-side (Full) as the output 3D mode, you should first check whether your device supports the output video resolution.
[0088] Interlaced format, a 3D video format, displays images for the left and right eyes alternately in different lines or fields. Interlaced formats are also divided into progressive scan and interlaced scan. The progressive scan interlaced format uses deinterlacing technology, while the interlaced scan interlaced format is a bar-like interlaced format with vertically interlaced scans.
[0089] Anaglyph 3D format, also known as stereoscopic 3D format, uses a color-filtered 3D display method, typically involving red and cyan (or blue) filters. In this way, the left and right eyes see images of different colors, creating a stereoscopic effect. This method does not require special display equipment; only a pair of corresponding 3D glasses is needed.
[0090] When processing 3D video, display devices need to process it according to its actual format. Determining the 3D video format usually requires the source stream or the protocol transmitting the 3D video to contain corresponding format information. For example, after recognizing the 3D video format, the display device will automatically switch to the corresponding mode based on its capabilities. If the 3D format is side-by-side, the monitor will use an algorithm to composite the image into a full-screen mode. However, if the source device does not correctly maintain this information, the TV cannot automatically detect it, requiring manual operation from the user. For instance, if a monitor supports both top-bottom and side-by-side 3D video formats, and the currently playing 3D video is in side-by-side format, but the user manually selects top-bottom mode, the image will be severely distorted and unwatchable.
[0091] Based on the above problems, in this embodiment of the disclosure, a video to be played is received from a signal source device; wherein the video format of the video to be played is a first 3D video format; in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, it is determined whether the video format of the video to be played is identified by a preset video format identification method; if the video format of the video to be played is not identified by the preset video format identification method, a target 3D video format of the video to be played is determined by a preset image feature comparison algorithm; if the video format input by the user is inconsistent with the target 3D video format of the video to be played, a first prompt message is output; wherein the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu. For 3D videos that cannot be identified using a preset recognition method, video format detection is triggered at different times. Specifically, when a video playback command for a video to be played is received, or when a video format setting command for a video to be played is received, the video format of the video to be played is first identified using a preset video format recognition method. By triggering video format detection at different times, the detection frequency can be reduced, thereby reducing the system load. If the preset video format recognition method fails, a preset image feature comparison algorithm is used to determine the target 3D video format of the video to be played. If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, the first prompt message is output, prompting the user to select the setting item corresponding to the target 3D video format in the video format setting menu. This accurately identifies the actual format of the video to be played, automatically guides the user to make the correct settings, and reduces the operational complexity of 3D viewing.
[0092] For example, such as Figure 1A As shown, Figure 1A This is one of the application scenario diagrams of a video format recognition method for a display device provided in this disclosure embodiment. Figure 1A In this configuration, display device 200 is connected to USB flash drive 400. When display device 200 receives a 3D format video sent by USB flash drive 400, it responds to a video playback command for the 3D format video, or a video format setting command for the 3D format video, by determining whether the video format of the 3D format video has been identified using a preset video format recognition method. If the video format of the 3D format video is not identified using the preset video format recognition method, a preset image feature comparison algorithm is used to determine the target 3D video format. If the video format input by the user is inconsistent with the target 3D video format, a first prompt message is output. The first prompt message prompts the user to select the setting item corresponding to the target 3D video format in the video format setting menu. The user can operate display device 200 through control device 100 or terminal device 300. (Refer to...) Figure 1AAs shown, Figure 1A This diagram illustrates a 3D video format setting page provided in an embodiment of the present disclosure. For example, 3D video formats mainly include the following: top-bottom 3D format, side-by-side 3D format, stereoscopic 3D format, frame-encapsulated 3D format, continuous frame 3D format, active shutter 3D format, polarized 3D format, etc. Users select the corresponding option on the 3D video format setting page via the control device 100 or terminal device 300. The display device 200 can be a smart TV, laptop, projector, desktop computer, etc.; the terminal device 300 can be a smartphone, tablet, portable smartwatch, etc.
[0093] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. Figure 1A An exemplary configuration block diagram of the control device 100 is shown. (Refer to...) Figure 1A As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a storage device, and a power supply. The control device 100 can receive user input operation commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. The communication interface 130 is used for external communication and includes at least one of the following: a Wi-Fi chip, a Bluetooth module, NFC (Near Field Communication), or a suitable alternative module. The user input / output interface 140 includes at least one of the following: a microphone, a touchpad, a sensor, buttons, or a suitable alternative module.
[0094] In some embodiments, a terminal device 300 (e.g., a mobile terminal) can also be used to control the display device 200. For example, an application running on the terminal device 300 can be used to control the display device 200. The terminal device 300 can install software applications with the display device 200 to establish a connection and communication via network communication protocols, achieving one-to-one control operations and data communication. Semantic content displayed on the terminal device 300 can also be transmitted to the display device 200 to achieve synchronous display.
[0095] In some embodiments, the display device 200 may receive commands without using the terminal device 300 described above, but instead receive user control via touch or gestures. For example, when the display device 200 is a smart TV, the user accesses the wireless network display interface via touch screen or gesture control.
[0096] The video format recognition method provided in this disclosure can be implemented based on a computer device, or a functional module or functional entity within the computer device.
[0097] The computer equipment can be a personal computer (PC), server, mobile phone, tablet computer, laptop computer, mainframe computer, etc., and this disclosure does not specifically limit it.
[0098] For example, Figure 1A This is a hardware configuration block diagram of a computer device according to one or more embodiments of the present disclosure. Figure 1AAs shown, the computer device includes at least one of the following: a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller 250 includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (Random Access Memory), ROM (Read-Only Memory), a first to nth interface for input / output, and a communication bus. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG audio and video data signals, from multiple wireless or wired broadcast television signals. The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. Computer equipment can establish the transmission and reception of control signals and data signals with a server or local control device through the communicator 220. The detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, the detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, the detector 230 includes a sound acquisition device, such as a microphone, for receiving external sound. The external device interface 240 may include, but is not limited to, one or more of the following: a high-definition multimedia interface (HDMI), an analog or data high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces. The controller 250 and the tuner 210 can be located in different separate devices, that is, the tuner 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0099] In some embodiments, the controller 250 controls the operation of the computer device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the computer device. The user can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0100] In some embodiments, the display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, an assembly for receiving image signals output from a controller, and a user interface (UI) for displaying video content, image content, menu control interface, and user control interface. For example, the display may be at least one of a liquid crystal display (LCD), an OLED (Organic Light-Emitting Diode) display, a touch display, and a projection display, and may also be a projection device and a projection screen. Users can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors. A "user interface" is the medium through which an application or operating system interacts and exchanges information with a user; it realizes the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface, which refers to a user interface related to computer operation displayed graphically. For example, it can be an interface element such as an icon, window, or control displayed on the screen of a computer device. Controls can include visible interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, and navigation bars. The user interface can be used to receive control signals from terminal device 100 (such as an infrared remote control).
[0101] Figure 1A This is a schematic diagram of the software configuration of a computer device according to one or more embodiments of the present disclosure, such as... Figure 1A As shown, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Library Layer"), and the kernel layer.
[0102] In some embodiments, the software framework is described in conjunction with the application scenario of the video format recognition method. Figure 1A This is a second schematic diagram of the software configuration of a computer device according to one or more embodiments of the present disclosure, with reference to... Figure 1A As shown, at the TV application layer, users can see the UI display interface, which responds to user operations such as 3D format settings or 3D video playback. The TV background service layer is background software that continuously monitors the status and executes automated logic after the user performs relevant settings and playback actions, such as 3D format detection, image grayscale data acquisition, and image recognition as described in this proposal. The TV chip driver layer provides related functions, such as processing separated 3D images into a complete image or acquiring grayscale data.
[0103] Figure 1A This is a schematic diagram showing the icon control interface of an application included in a smart device (mainly a smart playback device, such as a smart TV, digital cinema system, or audio-visual server) according to one or more embodiments of this disclosure. Figure 1A As shown, the application layer contains at least one application whose corresponding icon control can be displayed on the screen, such as: live TV application icon control, video-on-demand (VOD) application icon control, media center application icon control, application center icon control, game application icon control, etc. Live TV applications can provide live television from different signal sources. Video-on-demand (VOD) applications can provide video from different storage sources. Unlike live TV applications, video-on-demand provides video display from certain storage sources. Media center applications can provide applications for playing various multimedia content. The application center can provide storage for various applications.
[0104] The video format recognition method provided in this disclosure can be implemented based on the aforementioned computer equipment.
[0105] To illustrate this solution in more detail, the following will use examples to illustrate it. Figure 1A To explain, it is understandable that Figure 1A The steps involved may include more or fewer steps in actual implementation, and the order of these steps may also be different, in order to achieve the video format recognition method for the controlled device side provided in the embodiments of this application.
[0106] Figure 1A This is a flowchart illustrating a video format recognition method provided in an embodiment of this disclosure. Figure 1A As shown, the method specifically includes the following steps:
[0107] S41. Receive the video to be played from the signal source device.
[0108] The video format of the video to be played is a first 3D video format. The signal source device includes, but is not limited to, DVD players, Blu-ray players, etc. The first 3D video format may include, but is not limited to, top-bottom 3D format, side-by-side 3D format, stereoscopic 3D format, frame-encapsulated 3D format, frame-continuous 3D format, active shutter 3D format, polarized 3D format, etc.
[0109] Specifically, the display device's communicator receives the video to be played from the DVD player. Assuming the first 3D video format is a top-and-bottom 3D format, the display device receives the video to be played from the DVD player in a top-and-bottom 3D format.
[0110] In some embodiments, step S41 (receiving the video to be played sent by the signal source device) can be implemented in the following manner:
[0111] The receiving signal source device sends the video to be played via a high-definition multimedia interface in a preset image file format.
[0112] The preset image file format stores the video format information of the video to be played. HDMI (High-Definition Multimedia Interface) is a digital video and audio interface standard used to connect various devices, such as televisions, monitors, computers, game consoles, and audio equipment. HDMI supports 3D video formats, allowing users to view 3D content through compatible 3D display devices. The preset image file format may be, but is not limited to, HVIF (Highly Variable Image Format). HVIF frames are a file format used to store and transmit high-resolution images.
[0113] For example, a television receives 3D video transmitted via HDMI from a DVD player in HVIF format. The HVIF format stores 3D information corresponding to the video to be played.
[0114] S42. In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method.
[0115] Specifically, the display device controller responds to the user's video playback operation for the video to be played, or responds to the user's video format setting operation for the video to be played, and determines whether the video format of the video to be played can be identified through a preset video format recognition method.
[0116] For example, if the controller can identify the video format of the video to be played through a preset video format recognition method, the display device will automatically switch to the corresponding mode according to its own capabilities. For example, when the 3D format is a side-by-side 3D format, the display will use the corresponding algorithm to synthesize the image into a full-screen mode.
[0117] Additionally, it should be noted that if the signal source device does not correctly maintain the video format information, the TV cannot complete the automatic detection. In this case, manual operation by the user is required. For example, if a monitor supports both top-bottom and side-by-side 3D video formats, and the currently playing 3D video is in side-by-side 3D format, but the user selects top-bottom 3D format, the screen will become distorted and unwatchable. In this situation, the target 3D video format is determined through step S43.
[0118] S43. If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm.
[0119] Among them, the preset image feature comparison algorithms include, but are not limited to, pixel-based comparison methods, histogram-based comparison methods, feature extraction and matching methods, and deep learning model-based methods.
[0120] Specifically, pixel-based comparison methods, such as mean squared error and structural similarity index, calculate similarity by comparing the RGB or grayscale values of two images pixel by pixel. Histogram-based comparison methods, for example, evaluate image similarity by comparing the histograms of two images, and are suitable for scenarios where images have similar color distributions but different pixel values. Feature extraction and matching methods, such as using algorithms like SIFT (Scale-invariant feature transform), SURF (Speeded Up Robust Features), and ORB (Oriented FAST and Rotated BRIEF), extract image features and perform matching, and are suitable for images where features such as object shape and texture are important. Deep learning model-based methods use deep learning models such as convolutional neural networks to extract image features and calculate similarity, and are suitable for various types of images that require high-level feature representation.
[0121] In some embodiments, step S43 (if the video format of the video to be played is not identified by the preset video format identification method, then the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm) can be implemented in the following way:
[0122] For each separate 3D video frame, the area is divided into regions according to a preset number;
[0123] Obtain the average brightness of the image in each region;
[0124] The target 3D video format of the video to be played is determined by comparing the average brightness of corresponding areas of each separate 3D video frame.
[0125] Specifically, when the video format of a video to be played cannot be automatically detected through standard protocols, the 3D format can be determined by the video's characteristics. For each separate 3D video frame, it can be divided into specific subdivided square regions. The average brightness of each region can be calculated, and by comparing the brightness values of each region, the target 3D video format of the video to be played can be determined.
[0126] For example, assuming there are two completely identical images on the left and right, by dividing the display screen into specific subdivided square regions, calculating the average brightness of the image in each region, and comparing the brightness values of each region, it can be determined whether the two images on the left and right are symmetrical, and this can be used to determine whether the video to be played is a 3D video in a split-screen format.
[0127] S44. If the video format input by the user is inconsistent with the target 3D video format of the video to be played, output the first prompt message.
[0128] The first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format settings menu.
[0129] Specifically, if the video format selected by the user is inconsistent with the target 3D video format of the video to be played, the first prompt message will be output to prompt the user to select the setting item corresponding to the target 3D video format in the video format settings menu.
[0130] For example, when a user manually selects a 3D video format on the TV, a detection is triggered. At this time, the user intends to set a 3D video format, indicating that the currently playing video is likely to be in 3D video format. This needs to be identified, and the identification result is compared with the settings previously selected by the user. If they do not match, a pop-up window will appear based on the identification result: "The current video may be the target 3D video format. Please select the corresponding settings according to this format."
[0131] In some embodiments, after performing step S44 above, the following steps may also be performed:
[0132] In response to the user's target 3D video format setting, the individual 3D video frames are stitched together into a complete 3D video frame using the target 3D video format.
[0133] Specifically, after the display outputs the first prompt message, the controller responds to the user's target 3D video format setting operation and stitches the individual 3D video frames into a complete 3D video frame in the target 3D video format.
[0134] For example, if the user selects a side-by-side 3D video format via remote control, the controller will respond to the user's operation by stitching the two 3D video frames together to form a complete 3D video frame for display on the monitor.
[0135] In this embodiment of the disclosure, a video to be played is received from a signal source device; wherein the video format of the video to be played is a first 3D video format; in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, it is determined whether the video format of the video to be played is identified by a preset video format identification method; if the video format of the video to be played is not identified by the preset video format identification method, a target 3D video format of the video to be played is determined by a preset image feature comparison algorithm; if the video format input by the user is inconsistent with the target 3D video format of the video to be played, a first prompt message is output; wherein the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu. For 3D videos that cannot be identified using a preset recognition method, video format detection is triggered at different times. Specifically, when a video playback command for a video to be played is received, or when a video format setting command for a video to be played is received, the video format of the video to be played is first identified using a preset video format recognition method. By triggering video format detection at different times, the detection frequency can be reduced, thereby reducing the system load. If the preset video format recognition method fails, a preset image feature comparison algorithm is used to determine the target 3D video format of the video to be played. If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, the first prompt message is output, prompting the user to select the setting item corresponding to the target 3D video format in the video format setting menu. This accurately identifies the actual format of the video to be played, automatically guides the user to make the correct settings, and reduces the operational complexity of 3D viewing.
[0136] Figure 1A This is a flowchart illustrating another video format recognition method provided in this embodiment. Figure 1AFurther expansion and optimization based on this. Optionally, after executing step S42 (determining whether the video format of the video to be played is identified through a preset video format recognition method), the following step S55 can also be executed:
[0137] S51, Receive the video to be played from the signal source device.
[0138] The video format of the video to be played is a first 3D video format.
[0139] S52. In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method.
[0140] S53. If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm.
[0141] S54. If the video format input by the user is inconsistent with the target 3D video format of the video to be played, output the first prompt message.
[0142] The first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format settings menu.
[0143] It should be noted that steps S51-S54 are executed in the same way as steps S41-S44 in the above embodiments, and will not be described again here.
[0144] S55. If the video format of the video to be played is identified as the first 3D video format by the preset video format recognition method, then the second prompt message is output.
[0145] The second prompt message is used to prompt the user that the display should process the video to be played in the first 3D video format.
[0146] Specifically, when the video starts playing, the controller identifies the video format of the video to be played as the first 3D video format through a preset video format recognition method, periodically counts the screen features, and when the symmetry feature is met continuously within a preset time (considering that some video sources have special effects, and may not be 3D videos, they will still be displayed in split-screen format such as top-bottom, left-right, etc.), a pop-up window displays a second prompt message to inform the user that the monitor will soon process the video to be played in the first 3D video format.
[0147] For example, when the video starts playing, the frame features are counted every second. If the vertical symmetry feature is met for 5 consecutive seconds, a pop-up window prompts the user: "The current 3D video is in a vertical format." The controller then automatically stitches the two 3D video frames together according to the horizontal 3D video format for display on the monitor.
[0148] Figure 1A This is a flowchart illustrating another video format recognition method provided in this embodiment. Figure 1A Further expansion and optimization based on this. Optionally, before executing the above step S42 (in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determining whether the video format of the video to be played is identified through a preset video format identification method), the following step S62 can also be executed:
[0149] S61, Receive the video to be played from the signal source device.
[0150] The video format of the video to be played is a first 3D video format.
[0151] The specific execution method of step S61 is the same as that of step S41 in the above embodiment, and will not be described again here.
[0152] S62, Receive video playback command; or, Receive video format setting command.
[0153] The video playback instruction is used to instruct the playback of the video to be played; the video format setting instruction is used to instruct the setting of the video format of the video to be played.
[0154] S63. In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method.
[0155] Specifically, the system can detect 3D video formats when a user clicks to play a video, or it can detect 3D video formats when a user selects a video format in the video format settings menu.
[0156] In this embodiment of the disclosure, the 3D video format is detected when the video starts playing, or when the user sets it. By selecting different times to trigger the detection, the detection frequency can be further reduced, thus reducing the system load.
[0157] S64. If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm.
[0158] S65. If the video format input by the user is inconsistent with the target 3D video format of the video to be played, output the first prompt message.
[0159] The first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format settings menu.
[0160] It should be noted that steps S63-S65 are executed in the same way as steps S42-S44 in the above embodiments, and will not be described again here.
[0161] In this embodiment of the disclosure, for 3D videos without formatted information transmission, the operational complexity of 3D viewing for users is reduced by automatically or guiding users to make correct settings, thereby reducing the operational complexity of 3D viewing.
[0162] Figure 1A This is a flowchart illustrating another video format recognition method provided in this embodiment. Figure 1A Further expansion and optimization based on this. Optionally, a detailed explanation of step S42 (in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determining whether the video format of the video to be played is identified through a preset video format recognition method) is provided.
[0163] S71. Obtain the numerical value corresponding to the video format information of the video to be played.
[0164] S72. If the value corresponding to the video format information belongs to the preset video format value table, then the video format of the video to be played is determined to be the first 3D video format.
[0165] The preset video format value table includes values corresponding to various video formats.
[0166] S73. If the value corresponding to the video format information does not belong to the preset video format value table, then it is determined that the video format of the video to be played has not been identified by the preset video format identification method.
[0167] Specifically, each 3D video format corresponds to a specific value. Each manufacturer configures a different preset video format value table. The corresponding preset video format value table can be found based on the display device model. If the value corresponding to the video format information of the video to be played belongs to the preset video format value table, then the video format of the video to be played is determined to be the first 3D video format; if the value corresponding to the video format information does not belong to the preset video format value table, it means that the video format of the video to be played cannot be identified by this method.
[0168] For example, assuming the video format information of the video to be played corresponds to the value "0000", the preset video format value table finds that the video format corresponding to the value "0000" is "frame-encapsulated 3D video format", thus determining that the video format of the video to be played is frame-encapsulated 3D video format. Similarly, assuming the video format information of the video to be played corresponds to the value "0001", the preset video format value table finds that the video format corresponding to the value "0001" is "continuous-frame 3D video format", thus determining that the video format of the video to be played is continuous-frame 3D video format.
[0169] In this embodiment of the disclosure, a video to be played is received from a signal source device; wherein the video format of the video to be played is a first 3D video format; in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, it is determined whether the video format of the video to be played is identified by a preset video format identification method; if the video format of the video to be played is not identified by the preset video format identification method, a target 3D video format of the video to be played is determined by a preset image feature comparison algorithm; if the video format input by the user is inconsistent with the target 3D video format of the video to be played, a first prompt message is output; wherein the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu. For 3D videos that cannot be identified using a preset recognition method, video format detection is triggered at different times. Specifically, when a video playback command for a video to be played is received, or when a video format setting command for a video to be played is received, the video format of the video to be played is first identified using a preset video format recognition method. By triggering video format detection at different times, the detection frequency can be reduced, thereby reducing the system load. If the preset video format recognition method fails, a preset image feature comparison algorithm is used to determine the target 3D video format of the video to be played. If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, the first prompt message is output, prompting the user to select the setting item corresponding to the target 3D video format in the video format setting menu. This accurately identifies the actual format of the video to be played, automatically guides the user to make the correct settings, and reduces the operational complexity of 3D viewing.
[0170] This disclosure provides a computer device, including: one or more processors; and a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement any of the video format recognition methods described in this disclosure.
[0171] Figure 1A This is a schematic diagram of the structure of a computer device provided in an embodiment of this disclosure. Figure 1AAs shown, the computer device includes a processor 810 and a storage device 820; the number of processors 810 in the computer device can be one or more. Figure 1A Taking a processor 810 as an example; the processor 810 and the storage device 820 in a computer device can be connected via a bus or other means. Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure 1A Figure Taking the example of a connection between China and Israel via a bus.
[0172] Storage device 820, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the video format recognition method in this embodiment of the disclosure. Processor 810 executes various functional applications and data processing of the computer device by running the software programs, instructions, and modules stored in storage device 820, thereby realizing the video format recognition method provided in this embodiment of the disclosure.
[0173] Storage device 820 may primarily include a stored program area and a stored data area. The stored program area may store the operating system and at least one application program required for a given function; the stored data area may store data created based on terminal usage. Furthermore, storage device 820 may include a high-speed random access storage device, and may also include a non-volatile storage device, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, storage device 820 may further include storage devices remotely located relative to processor 810, which can be connected to computer equipment via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
[0174] The computer device provided in this embodiment can be used to execute the video format recognition method provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0175] This disclosure also provides a storage medium containing computer-executable instructions. When executed by a computer processor, the computer-executable instructions implement the various processes of the methods provided in any of the above embodiments and achieve the same technical effects. To avoid repetition, further details are omitted here.
[0176] The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.
[0177] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.
Claims
1. A display device, characterized in that, include: The communicator is configured as follows: Receive the video to be played from the signal source device; The video format of the video to be played is a first 3D video format; The controller is configured as follows: In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method; If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm. The monitor is configured as follows: If the video format input by the user is inconsistent with the target 3D video format of the video to be played, the first prompt message will be output. The first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format settings menu.
2. The display device according to claim 1, characterized in that, The display is also configured to: The step of determining whether the video format of the video to be played has been identified through a preset video format recognition method further includes: If the video format of the video to be played is identified as a first 3D video format by the preset video format recognition method, a second prompt message is output; the second prompt message is used to prompt the user that the display should process the video to be played in the first 3D video format.
3. The display device according to claim 1, characterized in that, The communicator is also configured to: Before determining whether the video format of the video to be played is identified through a preset video format recognition method in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, the method further includes: Receive a video playback instruction; the video playback instruction is used to instruct the playback of the video to be played. or; Receive video format setting instructions; the video format setting instructions are used to instruct the setting of the video format of the video to be played.
4. The display device according to claim 1, characterized in that, The communicator is specifically configured as follows: The video to be played, sent by the receiving signal source device, includes: The receiving signal source device sends a video to be played via a high-definition multimedia interface in a preset image file format; the preset image file format stores the video format information of the video to be played.
5. The display device according to claim 4, characterized in that, The controller is specifically configured as follows: The step of determining whether the video format of the video to be played is identified through a preset video format recognition method in response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, includes: Get the numerical value corresponding to the video format information of the video to be played; If the value corresponding to the video format information belongs to the preset video format value table, then the video format of the video to be played is determined to be the first 3D video format; the preset video format value table includes values corresponding to multiple video formats; If the value corresponding to the video format information does not belong to the preset video format value table, it is determined that the video format of the video to be played has not been identified by the preset video format identification method.
6. The display device according to claim 1, characterized in that, The controller is further specifically configured as follows: The step of determining the target 3D video format of the video to be played using a preset image feature comparison algorithm includes: For each separate 3D video frame, the area is divided into regions according to a preset number; Obtain the average brightness of the image in each region; The target 3D video format of the video to be played is determined by comparing the average brightness of corresponding areas of each separate 3D video frame.
7. The display device according to claim 6, characterized in that, The controller is also configured to: After outputting the first prompt message when the video format input by the user is inconsistent with the target 3D video format of the video to be played, the method further includes: In response to the user's target 3D video format setting, the individual 3D video frames are stitched together into a complete 3D video frame using the target 3D video format.
8. A video format recognition method, characterized in that, The method includes: The system receives a video to be played from a signal source device; the video format of the video to be played is a first 3D video format. In response to a video playback command for the video to be played, or in response to a video format setting command for the video to be played, determine whether the video format of the video to be played is identified through a preset video format recognition method; If the video format of the video to be played is not identified by the preset video format identification method, the target 3D video format of the video to be played is determined by the preset image feature comparison algorithm. If the video format entered by the user is inconsistent with the target 3D video format of the video to be played, a first prompt message is output; the first prompt message is used to prompt the user to select the setting item corresponding to the target 3D video format in the video format setting menu.
9. The method according to claim 8, characterized in that, The step of determining whether the video format of the video to be played has been identified through a preset video format recognition method further includes: If the video format of the video to be played is identified as a first 3D video format by the preset video format recognition method, a second prompt message is output; the second prompt message is used to prompt the user's monitor to process the video to be played in the first 3D video format.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the video format recognition method as described in any one of claims 8-9.
Citation Information
Patent Citations
Automatic 3D content recognition mechanism
CN102281449A
Method and device for displaying 3D (three-dimensional) play modes
CN102724536A
Method and device for selecting three-dimensional (3D) mode on basis of original video
CN102843570A
Method and device for recognizing format of three-dimensional video
CN102957933A
Method and device for regulating 3D (Three-Dimensional) video play mode
CN102970555A