OSD menu full-channel display method and device

Abstract

The embodiment of the invention relates to the technical field of image display technology, and discloses an OSD menu full-channel display method and device, and the method comprises the steps: generating a needed OSD menu through an Android source, and obtaining a generated menu image; and obtaining an output image generated by the HDMI source to be displayed, superposing the menu image on the output image generated by the HDMI source, and using the output image after superposing the menu image as a display image of the HDM I source. According to the OSD menu full-channel display method and device provided by the embodiment of the invention, the OSD menu generated by the Android source can be combined with the input pictures of other HDMI sources, so that the LED display equipment can also check the OSD menu generated by the Android source when displaying the pictures of the non-Android source.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of image display technology, and in particular to a method and device for full-channel display of an OSD menu. Background Art

[0002] In the prior art, the display control of LED display devices such as LED integrated machines is usually performed using Figure 1 The solution of Android + High Definition Multimedia Interface (HDMI) decoding chip is shown. The HDMI decoding chip is the decoding center of the video stream and is responsible for receiving internal or external HDMI or DP input signals. An LED display device can connect multiple links from input to display, and each link is called a channel. For example: HDMI-1 channel refers to the link from the computer signal entering the HDMI decoding chip from the HDMI-1 input interface of the LED display device to the display on the screen. The display of each channel is independent of each other. The Android chip can be used as a built-in signal source in the LED display device, and its output image signal can also be used as a channel of the HDMI decoding chip input signal. At the same time, the LED display device also provides an external signal source provided by an external HDMI interface, such as the HDMI signal access of an external computer. For LED display devices, each built-in or external signal source can be selected and switched through interactive methods such as on-screen display (OSD).

[0003] Since Android chips have powerful computing power, interactive capabilities, rich colors and image processing advantages, the control end of the OSD menu is often designed on the Android chip. At this time, the OSD menu displayed on the LED device is the interactive menu of Android itself. However, Android's own OSD menu can only be displayed on the image output by the Android chip. When the user uses an external HDMI input signal from a non-Android source, the currently displayed image will be switched from the image signal output by the Android chip to the external input signal, and the user will not be able to see the OSD interactive menu of the Android channel, which is very inconvenient.

[0004] In the process of implementing the embodiments of the present invention, the inventors found that there are at least the following problems in the above related technologies: when the LED display device has input sources of multiple channels, the OSD menu can only be seen in the input screen of the Android source. Summary of the invention

[0005] The embodiments of the present application provide a method and device for full-channel display of OSD menus, which can combine the OSD menus generated by the Android source with the input images of other HDMI sources, enabling the LED display device to view the OSD menus generated by the Android source when displaying non-Android source images.

[0006] The objectives of the embodiments of the present invention are achieved through the following technical solutions:

[0007] To solve the above technical problems, in a first aspect, the embodiments of the present invention provide a method for full-channel display of OSD menus, including: the Android source generates the required OSD menus and obtains the generated menu images; obtains the output images generated by the HDMI source to be displayed, superimposes the menu images on the output images generated by the HDMI source, and uses the output images with the superimposed menu images as the display images of the HDMI source.

[0008] In some embodiments, the Android source generates the required OSD menus, specifically including: the Android source receives menu instructions, generates corresponding OSD menus on the secondary screen image of the HDMI according to the received menu instructions, and outputs the secondary screen image and menu coordinates through a communication link; where the menu coordinates include menu position coordinates and / or menu size coordinates.

[0009] In some embodiments, obtaining the generated menu images specifically includes: receiving the secondary screen image and menu coordinates output by the Android source, obtaining the display area of the menu image according to the menu coordinates, collecting the image of the corresponding display area on the secondary screen image, and using the collected image as the menu image.

[0010] In some embodiments, collecting the image of the corresponding display area on the secondary screen image and using the collected image as the menu image specifically includes: caching the image of the corresponding display area collected in pixels according to any one of the size of the display area, the size of the output image of the HDMI source, and the size of the display image of the HDMI source, and using the cached image as the menu image.

[0011] In some embodiments, obtaining the output images generated by the HDMI source to be displayed specifically includes: decoding the image data of the to-be-displayed image generated by the HDMI source, outputting the decoded to-be-displayed image data through an image interface, and collecting the output to-be-displayed image data as the output image.

[0012] In some embodiments, superimposing the menu images on the output images generated by the HDMI source specifically includes: according to the menu coordinates output by the Android source, superimposing the layer of the menu image on the corresponding coordinate position of the output image generated by the HDMI source, so as to merge the menu image and the output image generated by the HDMI source into one image.

[0013] In some embodiments, using the output image after the superimposed menu image as the display image of the HDMI source specifically includes: outputting the output image after the superimposed menu image to the screen of the LED display device to be displayed, and displaying the superimposed image on each screen as required.

[0014] To solve the above technical problems, in a second aspect, an embodiment of the present invention provides a device for full-channel display of an OSD menu, including: an Android device, an HDMI decoding device, and an image processing device. Specifically, the first output interface of the Android device is connected to the HDMI decoding device, the second output interface of the Android device is connected to the image processing device, and the output interface of the HDMI decoding device is connected to the image processing device; wherein, the Android device is used to generate an OSD menu according to the method described in the first aspect; the HDMI decoding device is used to decode the output image generated by the HDMI source according to the method described in the first aspect; the image processing device is used to superimpose the OSD menu generated by the Android device and the image generated by the HDMI source according to the method described in the first aspect.

[0015] In some embodiments, the connection between the first output interface of the Android device and the HDMI decoding device specifically includes: using the HDMI output interface and / or DP output interface of the Android device as the first output interface; connecting the HDMI output interface of the Android device to the HDMI signal input port of the HDMI decoding device; and / or connecting the DP output interface of the Android device to the DP signal input port of the HDMI decoding device.

[0016] In some embodiments, the connection between the first output interface of the Android device and the HDMI decoding device further includes: using the Android device as the built-in signal source of the display device, and permanently connecting the first output interface of the Android device to the corresponding interface of the HDMI decoding device.

[0017] In some embodiments, the device for full-channel display of the OSD menu further includes a UART interface, specifically including: the UART interface is connected between the first output interface of the Android device and the HDMI decoding device, and is used for data communication between the first output interface of the Android device and the HDMI decoding device.

[0018] In some embodiments, the connection between the second output interface of the Android device and the image processing device specifically includes: using the HDMI OUT2 output interface of the Android device as the second output interface, and connecting the second output interface to the HDMI RX interface of the image processing device.

[0019] In some embodiments, the device for full-channel display of the OSD menu further includes an SPI interface, specifically including: The SPI interface is connected between the second output interface of the Android device and the image processing device, and is used for data communication between the second output interface of the Android device and the image processing device.

[0020] In some embodiments, the output interface of the HDMI decoding device is connected to the image processing device, specifically including: Between the HDMI decoding device and the image processing device, they are connected through the VB1 and / or LVDS interface.

[0021] In some embodiments, the device further includes: The HDMI decoding device includes one or more external interfaces, and each external interface is connected to an external HDMI source, where the external interface is an HDMI interface and / or a DP interface.

[0022] In some embodiments, the device further includes a signal format conversion device, specifically including: The signal format conversion device is connected between the Android device and the image processing device, and is used to convert the output signal of the Android device into a format matching the output interface of the image processor.

[0023] Compared with the prior art, the beneficial effects of the present invention are: Different from the prior art, in the embodiments of the present invention, a method for full-channel display of the OSD menu is provided. This method obtains the OSD menu image generated by the Android source, and then superimposes the obtained menu image on the output image generated by the HDMI source, combines the OSD menu generated by the Android source with the input screen of other HDMI sources, so that when the LED display device displays the screen of a non-Android source, it can simultaneously display the OSD menu image generated by the Android source. Thus, when the user uses the HDMI source as the image input source, they can view the OSD menu image generated by the Android source at any time without switching the input source of the LED display device to the Android source. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In one or more embodiments, exemplary illustrations are provided through the pictures in the corresponding drawings. These exemplary illustrations do not limit the embodiments. Elements / modules and steps with the same reference numerals in the drawings represent similar elements / modules and steps. Unless otherwise stated, the drawings in the figures do not constitute a proportional limitation.

[0025] Figure 1 It is a schematic diagram of the display method of the OSD menu on the LED display device in the prior art;

[0026] Figure 2 It is a schematic diagram of the display device of the OSD menu on the LED display device in the prior art;

[0027] Figure 3It is a schematic flowchart of a method for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0028] Figure 4 It is a schematic diagram of the display effect of a method for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0029] Figure 5 It is a schematic diagram of the hardware structure of a device for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0030] Figure 6 It is a schematic diagram of the hardware structure of another device for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0031] Figure 7 It is a schematic diagram of the hardware structure of another device for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0032] Figure 8 It is a schematic diagram of the hardware structure of another device for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0033] Figure 9 It is a schematic diagram of the hardware structure of another device for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0034] Figure 10 It is a schematic diagram of the hardware structure of another device for full-channel display of an OSD menu provided in the first embodiment of the present invention;

[0035] Figure 11 It is a schematic diagram of the hardware structure of an image processing device in a device for full-channel display of an OSD menu provided in the second embodiment of the present invention. Detailed implementation manners

[0036] The present invention will be described in detail below with reference to specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those of ordinary skill in the art can make several modifications and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0037] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0038] It should be noted that if there is no conflict, the various features in the embodiments of the present invention can be combined with each other, and all are within the protection scope of the present application. In addition, although functional modules are divided in the device schematic diagram and the logical sequence is shown in the flowchart, in some cases, it may be different from the module division in the device or the sequence in the flowchart to execute the steps shown or described.

[0039] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by those skilled in the technical field to which the present invention belongs. The terms used in this specification in the description of the present invention are only for the purpose of describing specific embodiments and are not used to limit the present invention. In addition, the technical features involved in the following various embodiments of the present invention can be combined with each other as long as they do not conflict with each other.

[0040] To solve the problem that when a current LED display device has multiple input sources, the OSD menu can only be seen in the input screen of the Android source, the embodiments of the present invention provide a method and a device for full-channel display of the OSD menu. This method can combine the OSD menu generated by the Android source with the input screens of other HDMI sources, so that the LED display device can also view the OSD menu generated by the Android source when displaying non-Android source pictures.

[0041] Specifically, the embodiments of the present invention will be further described below with reference to the accompanying drawings.

[0042] In the display control of an LED device, the display channel of the device can be switched through the OSD menu, and the color, mode, geometry, etc. can also be adjusted, so as to achieve the best use state or working indicators for adjustment. The OSD menu can be evoked through the Menu key of the LED device or an external signal source, etc., and a rectangular menu of the adjustment item information of each display item of the display is popped up on the screen of the LED device, so that the user can switch the display channel of the display through this menu, or adjust various working indicators such as the brightness and contrast of the display device.

[0043] In the prior art, the OSD menu control method of an LED device is usually implemented by using a device as shown in Figure 2 the device shown.

[0044] 1. The output signal of the DP or HDMI output port of the Android chip can be used as an independent signal source, occupying a certain DP or HDMI input port of the HDMI decoding chip. This HDMI input port has the same receiving ability as the HDMI1 / 2 / 3 input port for receiving image signals, and they are independent of each other, and are respectively used as an independent input channel.

[0045] 2. The HDMI1 / 2 / 3 of the HDMI decoding chip can receive different input signals respectively. For example, HDMI1 can be connected to the HDMI signal output interface of a camera, HDMI2 can be connected to the HDMI signal output interface of another computer host, and HDMI3 can be connected to the HDMI signal output interface of a monitoring device. When the user needs to display the image generated by the Android chip on the LED device, the HDMI decoding chip needs to be switched to the channel corresponding to the input signal of the Android chip through the OSD menu. At this time, the user cannot see the display content of HDMI1 / 2 / 3. Similarly, when the user needs to display the content of HDMI1 / 2 / 3, the user cannot see the image content input from the Android channel either.

[0046] 3. Since the OSD menu for controlling the LED display device is implemented on the Android chip, when the user selects the HDMI1 / 2 / 3 channel for display, the input signal of the LED display device has been switched to a non-Android channel. Even if the Android menu is displayed on the Android screen through an instruction, the user cannot see the OSD menu displayed on the screen according to the image.

[0047] Embodiment 1

[0048] The embodiment of the present invention provides an OSD menu full-channel display method, which can be applied to the display control of a multi-channel LED device.

[0049] Please refer to Figure 3 , which shows the flow of an OSD menu full-channel display method provided by the embodiment of the present invention. The method includes but is not limited to the following steps.

[0050] Step 101: The Android source generates the required OSD menu and obtains the generated menu image.

[0051] In the method provided in this embodiment, in order to facilitate the combination with the existing system, the Android source is still used as the generation and control end of the OSD menu. In actual implementation, the Android source can use a dedicated Android chip and an Android operating system platform, or other software and hardware platforms that can run the Android operating system or the OSD menu APK.

[0052] After receiving the menu display instruction or menu control instruction, the Android source creates a menu according to the instruction, or makes corresponding changes to the menu display, such as changing the selected item, changing the status text of the menu item, expanding or collapsing the menu, etc. After generating the menu, the Android source outputs an image with a specified resolution through its HDMI channel. The image contains the menu image that needs to be displayed currently. If the menu is not opened, no image output is performed. By collecting the image output by the Android source, the menu image generated by the Android source can be obtained.

[0053] Step 102: Obtain the output image generated by the HDMI source to be displayed, superimpose the menu image on the output image generated by the HDMI source, and use the output image after superimposing the menu image as the display image of the HDMI source.

[0054] In some scenarios, when the HDMI source to be displayed on the LED display device is not an Android source, the LED display device only uses the image data of the HDMI source and does not use the image data of the Android channel. If the existing technology is directly used for display, only the image of the HDMI source can be displayed, and the OSD menu image generated on the Android source cannot be displayed.

[0055] In the method provided by the present invention, in order to simultaneously display the output image provided by the HDMI source of the non-Android source and the menu image generated by the Android source on the LED display device, instead of directly displaying the output image of the HDMI source as in the prior art, the output image of the HDMI source is collected and superimposed with the menu image generated by the Android source collected in Step 101, so as to generate an output image containing the menu image, so that the image displayed on the LED display device also contains the menu image. In a specific implementation, various methods can be used to superimpose the output images. For example, the layer of the menu image can be directly superimposed on the layer of the output image in an opaque manner, or menu images with various shapes, sizes, transparencies, colors, and display effects can be used.

[0056] After Steps 101 - 102 provided in this embodiment, the OSD menu image generated by the Android source can be superimposed on the display images of all channels of the LED display, so that the OSD menu generated by the Android source is always displayed above the picture content, so that the OSD menu is visible to the user whether it is the input source of the external computer signal or the Android source. The display effect after superimposition is as Figure 4 shown.

[0057] When the user needs to adjust the display channel or working indicators of the LED display, they can send instructions to open or control the menu to the Android source through a remote control, host, or mobile peripheral. The Android source receives the menu instructions, starts the OSD menu APK, generates the corresponding OSD menu on the secondary screen image of HDMI according to the received menu instructions, and outputs the secondary screen image and menu coordinates through the communication link; among them, the menu coordinates include the menu position coordinates and / or menu size coordinates. Further, when the user sends instructions to perform operations such as selecting, folding, confirming, and closing the menu, the Android source will respond to the user operation to refresh the menu screen and output the refreshed menu screen and menu coordinates. Specifically, when the Android source opens the OSD menu, it outputs the coordinates of the OSD menu displayed on the secondary screen and the current display width and height through the Serial Peripheral Interface (SPI) communication link. When the user operates on the menu, causing dynamic changes in the image, length, width, position, etc. of the menu, the Android source will re-send the captured secondary screen image and menu coordinate information such as the position and width and height of the menu through the SPI communication link.

[0058] In actual implementation, when there are multiple LED display devices, the Android source can create an independent menu thread for each LED display device, and each menu thread creates an independent menu, so as to perform different menu displays and controls on each LED display respectively, enabling different LED displays to select different HDMI sources or use different working parameters for display. When performing menu control, different menu threads can also be corresponded to different signal sending ends or different user permissions, so as to realize menu display and menu control of multiple LED devices through one Android source.

[0059] Since there may be other images on the secondary screen image output by the Android source besides the menu image, such as the screen background color, etc., and only the menu image is needed for overlay, it is necessary to collect the menu image on the secondary screen image according to the menu coordinates. Receive the secondary screen image and menu coordinates output by the Android source, obtain the display area of the menu image according to the menu coordinates, collect the image of the corresponding display area on the secondary screen image, and use the collected image as the menu image. After collection, the OSD menu image generated by the Android source can be obtained for display on the HDMI image of the current source in the subsequent process.

[0060] To facilitate subsequent image overlay and improve the efficiency of image processing, the captured menu image can also be cached. According to any one of the size of the display area, the output image size of the HDMI source, and the display image size of the HDMI source, the image of the corresponding display area captured is cached in pixels, and the cached image is used as the menu image. After caching the menu image, when performing image overlay, if the menu image has not changed, the cached menu image can be directly used for overlay without re-capturing the menu image. To further reduce the cache quantity and improve the efficiency of image capture, the menu images in each state can be cached. For example, a certain menu is used to select the input channel, including three channel menu options of HDMI1, HDMI2, and HDMI3. Correspondingly, there are three menu states of HDMI1 selected, HDMI2 selected, and HDMI3 selected. When the user initially selects a certain channel for the first time, the corresponding menu image can be cached. When the user does not change the option or selects it again, the cached menu image can be used for display without re-capturing the menu image. Since the display effect of the menu will change only after receiving the corresponding control instruction, the caching of the menu image can be triggered by the menu control instruction. Different menu images are cached for different control instructions, and after receiving the same control instruction again, the corresponding cached image can be used as the menu image.

[0061] On the other hand, to be able to normally display the image of the HDMI source, it is also necessary to obtain the output image generated by the HDMI source to be displayed. The data of the output image to be displayed generated by the HDMI source is decoded, and the decoded data of the output image to be displayed is output through the image interface, and the output data of the output image to be displayed is captured as the output image. Further, to facilitate subsequent image processing and reduce unnecessary repeated processing, the captured output image can also be cached. When the image to be displayed remains unchanged, image capture is not performed, but the cached image is used for overlay.

[0062] After obtaining the menu image generated by the Android source and the output image of the HDMI source, the menu image can be superimposed on the output image generated by the HDMI source to generate an output image containing the menu. When performing the superimposition, the original captured image can be directly used for layer superimposition. According to the menu coordinates output by the Android source, the layer of the menu image is superimposed on the corresponding coordinate position of the output image generated by the HDMI source, thereby combining the menu image and the output image generated by the HDMI source into one image. In different implementation scenarios, the captured menu image can also be pre-processed before superimposition as needed. For example, making the menu image semi-transparent, generating an appropriate background color or border color for the menu image according to the color of the HDMI source image, hiding or disabling some menu items according to the permission requirements of the HDMI source, etc. The size and position of the menu image can also be adjusted as needed. For example, adjusting the size of the menu image according to the size of the HDMI image, adjusting the size of the menu image according to the resolution of the HDMI image, placing the menu image in a suitable display area according to the content of the HDMI image, etc.

[0063] In actual implementation, the menu image and the output image will change. Therefore, the acquisition and superimposition of the images need to be repeated multiple times to ensure that the displayed image is synchronized with the menu image and the output image. In actual implementation, the above-mentioned acquisition of the menu image and the output image, and the superimposition of the images can be performed at appropriate times and intervals according to actual needs. In occasions with high real-time requirements, frame-by-frame acquisition and superimposition can be performed; in occasions with low real-time requirements, acquisition and superimposition can be performed at specified frame intervals; in the case where both the menu image and the output image change less, image caching can be combined and acquisition and superimposition are only performed when the image changes.

[0064] After obtaining the output image with the menu image superimposed, the superimposed image is immediately used as the image of the HDMI source, and the output image with the menu image superimposed is output to the screen of the LED display device to be displayed as required. In actual implementation, according to different needs, the same image can be displayed on all LED devices, or different images can be displayed on different LED devices.

[0065] The method for full-channel display of the OSD menu provided in this embodiment superimposes the menu image generated by the Android source on the output image of the HDMI source, thereby displaying the menu image on the output images of all channels, and solving the pain point that the OSD menu of the Android channel cannot be displayed on other channels.

[0066] Embodiment 2

[0067] In some implementation scenarios, the method for full-channel display of the OSD menu provided in the first embodiment can also be adjusted or extended according to needs. The following briefly provides some available extension methods. The following methods can be used simultaneously or alternatively when there is no conflict, or can be further extended in combination with other requirements.

[0068] In the method provided in the first embodiment, it is possible to support image input from multiple external HDMI sources. In some scenarios, the LED display device may not be able to recognize the correspondence between the input image and the HDMI source. For example, in a certain scenario, there are 3 external HDMI sources, namely PC1, PC2, and PC3, but the user cannot view the wiring situation, so it is impossible to determine which PC the corresponding HDMI source of each external HDMI source is. In this scenario, when the user selects the display image, it is necessary to view the input images of the HDMI sources of each channel to determine the HDMI channel to be selected. However, in the existing menu control method, it is necessary to select a certain HDMI channel in the menu item and confirm it before switching to the newly selected HDMI source on the LED display device; if the selection is incorrect, it is necessary to select and confirm again, and the operation is relatively cumbersome.

[0069] In the method provided in the first embodiment, since in step 102, it is possible to obtain the output image generated by the HDMI source to be displayed, and the obtained output image is processed and then provided to the LED display device for display. Therefore, when obtaining the output image generated by the HDMI source to be displayed, it is possible to poll all possible selected HDMI sources and obtain the images of all HDMI sources. When the user moves the selection cursor to a certain HDMI channel in the menu, there is no need to confirm, and the image of the selected HDMI channel is directly displayed on the LED display device. After the user confirms, only the image of the confirmed HDMI channel is collected, and the images of other channels are no longer collected.

[0070] In specific implementation, according to the number of channels, screen size, user habits, etc., a suitable method can be adopted to display the image of the selected HDMI channel on the LED display device. The following lists some common methods. In actual implementation, it is not limited to the following display methods.

[0071] (1) Obtain the menu item selection instruction, obtain the corresponding HDMI channel number according to the menu item where the current cursor is located. When the user changes the selected menu item, synchronously switch the image displayed on the LED display device to the corresponding HDMI channel output image after superimposing the menu image. Using this method, the user does not need to click to confirm, and can directly view whether the HDMI channel where the current cursor is located is the HDMI channel he needs to use, reducing the waiting time during user operation and switching.

[0072] (2) When the user invokes the menu, the images of each HDMI channel are displayed on the LED display device in turn. The user determines the HDMI channel they need to use based on the images displayed in turn. This method eliminates the need for the user to switch options, further reducing the complexity of user operations.

[0073] (3) When the user invokes the menu, the images of all HDMI channels are displayed in different areas of the LED display device screen. For example, when there are 3 HDMI channels, the LED display device screen is divided into 3 parts, and each part displays the picture of one HDMI channel. This method enables the user to view the pictures of all HDMI channels simultaneously, further reducing the waiting time when the user makes a selection.

[0074] In actual implementation, the above display methods can be used alone or in combination. For example, when the user invokes the menu, the picture of the HDMI channel corresponding to the current cursor is displayed in most areas of the LED display device, and the pictures of other HDMI channels are displayed in turn or in partitions in a small area.

[0075] When displaying according to the above display method, corresponding text descriptions such as channel numbers, input device names, characteristic values of input devices, etc. can also be superimposed on the pictures of each HDMI channel, further facilitating the user's selection.

[0076] Furthermore, in actual implementation, the working parameters of the LED display device can also be adjusted according to the cursor position instead of being adjusted after confirmation as in the existing method. Specifically: the output image of the HDMI source obtained is processed according to the working parameters corresponding to the user cursor position to make it conform to the display effect corresponding to the working parameters.

[0077] Embodiment 3

[0078] Based on the OSD menu full-channel display method provided in Embodiment 1, the present invention embodiment also provides an OSD menu full-channel display device. Please refer to Figure 5 , which shows the hardware structure capable of executing Figure 1 the OSD menu full-channel display method described above.

[0079] The device provided in this embodiment includes an Android device, an HDMI decoding device, and an image processing device.

[0080] In the device provided in this embodiment, the Android device, the HDMI decoding device, and the image processing device can all select specific device types and models according to needs. For example: The Android device can use various dedicated Android chips or general-purpose devices that can support the Android system; the HDMI decoding device can use a dedicated decoding chip or a general-purpose device that can perform HDMI decoding; the image processing device can use a dedicated image processing chip or a general-purpose device that can perform image processing. Among them, the general-purpose device can use a general-purpose CPU, a general-purpose chip or circuit module that can support the corresponding function, a Field Programmable Gate Array (FPGA) chip that can support the corresponding function, etc.

[0081] In a specific implementation scenario, for the convenience of control and system simplification, an Android chip is used as the Android device, an HDMI decoding chip is used as the HDMI decoding device, and an FPGA is used as the image processing device. It can be understood that the specific model selection of each device, the working parameters of the device, as well as the image processing method and parameters, etc. in this example are only an optional implementation method of the device in this embodiment and do not constitute a specific limitation on the protection scope of the present invention.

[0082] The first output interface of the Android device is connected to the HDMI decoding device, and the second output interface of the Android device is connected to the image processing device. Figure 5 Among them, the Android chip has the signal output ability of more than 2 channels. The first output interface (main screen) is a Digital Visual Interface Standard (Display Port, abbreviated as DP) or an HDMI output interface, which is used to output the normal Android source image to the HDMI decoding chip; the second output interface (sub-screen) is an HDMI OUT2 interface, which is used to output the menu image and menu coordinates to the FPGA chip. The output interface of the HDMI decoding device is connected to the image processing device, which is used to output the HDMI source image decoded by the HDMI decoding chip to the FPGA chip.

[0083] In order to enable the user to view the menu of the Android channel on each channel of the HDMI decoding chip, each device in the device needs to perform image acquisition and overlay according to the method in Embodiment 1.

[0084] The Android device is used to generate an OSD menu according to the method in Embodiment 1. For example, according to the method in step 101, in response to the menu generation instruction and the operation instruction, an OSD menu is generated on the sub-screen, and the generated OSD menu is cached and preprocessed, and the sub-screen image and menu coordinates are output. For example, as Figure 6As shown in the figure, the second output interface channel HDMIOUT2 (secondary screen) signal of the Android chip is connected to the FPGA chip. The Android chip will output a secondary screen image with a fixed resolution from HDMIOUT 2 to the FPGA chip. For example, it outputs a secondary screen image with a resolution of 1920X1080. Since the hardware interface is always in a connected state, the FPGA chip can collect the secondary screen image in real time and obtain the corresponding menu coordinates. For example, in the menu coordinates, the position coordinates of the upper left corner of the menu are the (0,0) point in the screen coordinate system, and the pixel coordinates corresponding to the menu size are 1920X1080. Then the collected menu image is the image content in the secondary screen image with the (0,0) point as the upper left corner and a pixel range of 1920X1080. To reduce the amount of image processing, if the user does not activate the OSD menu or the current menu image has been cached, the collection is not performed.

[0085] The HDMI decoding device is used to decode the output image generated by the HDMI source according to the method of Embodiment 1. For example, according to the method in step 102, collect the output image generated by the HDMI source, and cache and preprocess the obtained output image. For example, as Figure 6 As shown in the figure, the HDMI decoding chip is connected to the FPGA chip through VB1 or LVDS, and outputs the decoded HDMI output image to the FPGA chip. The output resolution of VB1 or LVDS of the HDMI decoding chip is determined by the program of the HDMI decoding chip. For example, if the HDMI decoding chip is configured with a 4K specification, then the display data specification collected by the FPGA chip is also 4K resolution, and the output VB1 or LVDS signal is the image signal for the LED device to display.

[0086] The image processing device is used to superimpose the OSD menu generated by the Android device and the image generated by the HDMI source according to the method of Embodiment 1. For example, according to the method in step 102, use the FPGA to collect the menu image output from the HDMIOUT2 interface of the Android chip and the output image decoded by the HDMI decoding chip according to the HDMI source image, superimpose the menu image and the output image, and process the superimposed image as needed. For example, the FPGA chip collects the signal of the HDMIOUT 2 channel of the Android chip in real time as the menu image, and collects the signal output from VB1 or LVDS of the HDMI decoding chip in real time as the output image, and superimposes and integrates the two images to obtain an output image containing the menu image.

[0087] In actual implementation, the interfaces and devices used in the apparatus can also be selected and adjusted according to the actual situation. The following briefly lists the available interface types or device adjustment methods. The following technical solutions can be used alone, or combined without conflict, or combined with other available interfaces or devices.

[0088] In actual use, the output image signal of the Android source first output interface can be a DP signal or an HDMI signal. As Figure 7 shown, use the HDMI output interface and / or DP output interface of the Android device as the first output interface; connect the HDMI output interface of the Android device to the HDMI signal input port of the HDMI decoding device; and / or, connect the DP output interface of the Android device to the DP signal input port of the HDMI decoding device to adapt to different output signals.

[0089] To reduce the connection complexity during user use, use the Android device as the built-in signal source of the display device, and permanently connect the first output interface of the Android device to the corresponding interface of the HDMI decoding device. When performing hardware design, the first output interface of the Android chip can be permanently connected to the HDMI or DP signal input port of the HDMI decoding chip through various circuit connection methods, so that the output signal of the Android chip serves as the built-in signal source of the LED display device, eliminating the need for users to make additional line connections when using the LED display device.

[0090] The Android chip and the HDMI decoding chip can be connected using a Universal Asynchronous Receiver / Transmitter (UART) interface. As Figure 8 shown, the UART interface is connected between the first output interface of the Android device and the HDMI decoding device for data communication between the first output interface of the Android device and the HDMI decoding device. Using the UART interface can directly implement functions such as full-duplex transmission and reception, data verification, and data caching through the hardware protocol of the interface, reducing the complexity of software and hardware design and improving the efficiency and security of data transmission.

[0091] To enable the image processing device to collect the HDMI format menu image output by the Android device, use the HDMIOUT2 output interface of the Android device as the second output interface, connect the second output interface to the HDMIRX interface of the image processing device, and implement image collection through the HDMI RX interface to simplify the signal processing and control complexity of image collection.

[0092] As Figure 8As shown in the figure, a Serial Peripheral Interface (SPI) can be used to connect an Android device and an image processing device. The SPI interface is connected between the second output interface of the Android device and the image processing device and is used for data communication between the second output interface of the Android device and the image processing device. The SPI interface is a high-speed, full-duplex, synchronous communication bus that only occupies four wires on the chip's pins, saving the chip's pins and also saving space in the PCB layout.

[0093] The display data of the HDMI decoding chip can be output using a digital interface standard developed for image transmission (V-by-One, abbreviated as VB1) or a Low-Voltage Differential Signaling (LVDS) interface. Between the HDMI decoding device and the image processing device, they are connected through the VB1 and / or LVDS interface, and the VB1 or LVDS interface of the HDMI decoding device is connected to the corresponding VB1 or LVDS data acquisition port of the FPGA chip. In actual implementation, whether it is a built-in Android signal source or a user-connected HDMI signal source, after being decoded by the HDMI decoding device, it can be sent to the FPGA chip through the VB1 or LVDS interface.

[0094] In the device provided in this embodiment, as Figure 9 shown, the HDMI decoding device supports the input of multiple HDMI sources. The HDMI decoding device includes one or more external interfaces, and each external interface is connected to an external HDMI source, where the external interface is an HDMI interface and / or a DP interface. The HDMI decoding chip can support the ability to access multiple HDMI or DP signals. For example: Figure 9 In [example], 3 of the input channels of the HDMI decoding chip are designed as user-accessible external interfaces HDMI1 / 2 / 3, and each interface inputs an HDMI source image. After being processed by the device provided in this embodiment, no matter which HDMI source the LED display device uses for display, the corresponding menu image can be seen on the displayed image.

[0095] In a specific scenario, as Figure 10 shown, the above-mentioned devices and interface combinations are used in the device. The various devices provided in this embodiment are used, data processing is performed according to the method in Embodiment 1, and data transmission is performed through the interfaces provided in this embodiment. Finally, a to-be-displayed image including a menu image and a source HDMI image is generated, and the to-be-displayed image is output from the FPAG chip to the LED display device for display, so that the OSD menu generated by the Android source can be viewed on all channels of the LED display device.

[0096] In actual implementation, the signal formats between different devices may be different. To match the signals between different devices, the device provided in this embodiment further includes a signal format conversion device, which is connected between the Android device and the image processing device and is used to convert the output signal of the Android device into a format that matches the output interface of the image processor. In specific implementation, the specific signal format conversion device is selected according to the specific signal format, or a signal format conversion device can also be set between other devices as needed.

[0097] To cache and process the collected menu images and output images, in the device provided in this embodiment, as Figure 11 shown, the image processing device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to superimpose the OSD menu generated by the Android device and the image generated by the HDMI source according to the method of Embodiment 1.

[0098] Figure 11 Taking one processor 11 as an example. The memory 12 stores instructions executable by the at least one processor 11, and the instructions are executed by the at least one processor 11 to enable the at least one processor 11 to execute the above-mentioned Figure 1 OSD menu full-channel display method. The processor 11 and the memory 12 can be connected through a bus or other means, Figure 11 taking the connection through a bus as an example.

[0099] The memory 12, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules, such as the program instructions / modules corresponding to the OSD menu full-channel display method in this application embodiment. The processor 11 executes various functional applications and data processing of the server by running the non-volatile software programs, instructions, and modules stored in the memory 12, that is, to implement the methods provided in Embodiment 1 and Embodiment 2 of the above method.

[0100] The memory 12 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the device with full-channel display of the OSD menu, etc. In addition, the memory 12 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some embodiments, the memory 12 optionally includes a memory remotely provided with respect to the processor 11, and these remote memories can be connected to the device with full-channel display of the OSD menu through a network. Examples of the above network include but are not limited to the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0101] The one or more modules are stored in the memory 12 and, when executed by the one or more processors 11, execute the method for full-channel display of the OSD menu in any of the above method embodiments. For example, execute the Figure 1 method steps described above.

[0102] The above product can execute the method provided in the embodiments of the present application, and has corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in this embodiment, reference can be made to the method provided in the embodiments of the present application.

[0103] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit them; under the concept of the present invention, the technical features in the above embodiments or different embodiments can also be combined, and the steps can be implemented in any order, and there are many other variations in different aspects of the present invention as described above. For the sake of brevity, they are not provided in detail; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for full-channel display of an OSD menu, characterized in that, it includes: The Android source generates the required OSD menu and obtains the generated menu image; Obtain the output image generated by the HDMI source to be displayed, superimpose the menu image on the output image generated by the HDMI source, and use the output image with the superimposed menu image as the display image of the HDMI source.

2. The method for full-channel display of an OSD menu according to claim 1, characterized in that, The Android source generates the required OSD menu, specifically including: The Android source receives a menu instruction, generates a corresponding OSD menu on the secondary screen image of the HDMI according to the received menu instruction, and outputs the secondary screen image and menu coordinates through a communication link; wherein, the menu coordinates include menu position coordinates and / or menu size coordinates.

3. The method for full-channel display of an OSD menu according to claim 2, characterized in that, The obtaining of the generated menu image specifically includes: Receive the secondary screen image and menu coordinates output by the Android source, obtain the display area of the menu image according to the menu coordinates, collect the image of the corresponding display area on the secondary screen image, and use the collected image as the menu image.

4. The method for full-channel display of an OSD menu according to claim 3, characterized in that, The collecting of the image of the corresponding display area on the secondary screen image and using the collected image as the menu image specifically includes: According to any one of the size of the display area, the size of the output image of the HDMI source, and the size of the display image of the HDMI source, cache the image of the corresponding display area collected in pixels, and use the cached image as the menu image.

5. The method for full-channel display of an OSD menu according to claim 1, characterized in that, The obtaining of the output image generated by the HDMI source to be displayed specifically includes: Decode the image data to be displayed generated by the HDMI source, output the decoded image data to be displayed through an image interface, and collect the output image data to be displayed as the output image.

6. The method for full-channel display of an OSD menu according to claim 1, characterized in that, The superimposing of the menu image on the output image generated by the HDMI source specifically includes: According to the menu coordinates output by the Android source, superimpose the layer of the menu image on the corresponding coordinate position of the output image generated by the HDMI source, so as to merge the menu image and the output image generated by the HDMI source into one image.

7. The method for full-channel display of an OSD menu according to claim 1, characterized in that, The using of the output image with the superimposed menu image as the display image of the HDMI source specifically includes: Output the output image with the superimposed menu image to the screen of the required LED display device, and display the superimposed image on each screen as needed.

8. An apparatus for full-channel display of an OSD menu, characterized in that, it includes: An Android device, an HDMI decoding device, and an image processing device, specifically including: The first output interface of the Android device is connected to the HDMI decoding device, the second output interface of the Android device is connected to the image processing device, and the output interface of the HDMI decoding device is connected to the image processing device; Among them, the Android device is used to generate an OSD menu according to the method described in any one of claims 1-7; The HDMI decoding device is used to decode the output image generated by the HDMI source according to the method described in any one of claims 1-7; The image processing device is used to superimpose the OSD menu generated by the Android device and the image generated by the HDMI source according to the method described in any one of claims 1-7.

9. The device for full-channel display of the OSD menu according to claim 8, characterized in that, The connection of the first output interface of the Android device to the HDMI decoding device specifically includes: Using the HDMI output interface and / or DP output interface of the Android device as the first output interface; Connecting the HDMI output interface of the Android device to the HDMI signal input port of the HDMI decoding device; And / or, connecting the DP output interface of the Android device to the DP signal input port of the HDMI decoding device.

10. The device for full-channel display of the OSD menu according to claim 9, characterized in that, The connection of the first output interface of the Android device to the HDMI decoding device further includes: Regarding the Android device as the built-in signal source of the display device, and permanently connecting the first output interface of the Android device to the corresponding interface of the HDMI decoding device.

11. The device for full-channel display of the OSD menu according to claim 9, characterized in that, The device for full-channel display of the OSD menu further includes a UART interface, specifically including: The UART interface is connected between the first output interface of the Android device and the HDMI decoding device, and is used for data communication between the first output interface of the Android device and the HDMI decoding device.

12. The device for full-channel display of the OSD menu according to claim 8, characterized in that, The connection of the second output interface of the Android device to the image processing device specifically includes: Using the HDMIOUT2 output interface of the Android device as the second output interface, and connecting the second output interface to the HDMI RX interface of the image processing device.

13. The device for full-channel display of the OSD menu according to claim 12, characterized in that, The device for full-channel display of the OSD menu further includes an SPI interface, specifically including: The SPI interface is connected between the second output interface of the Android device and the image processing device, and is used for data communication between the second output interface of the Android device and the image processing device.

14. The device for full-channel display of the OSD menu according to claim 8, characterized in that, The connection of the output interface of the HDMI decoding device to the image processing device specifically includes: Between the HDMI decoding device and the image processing device, they are connected through VB1 and / or LVDS interfaces.

15. The device for full-channel display of the OSD menu according to claim 8, characterized in that, The device further includes: The HDMI decoding device includes one or more external interfaces, and each external interface is connected to an external HDMI source, wherein the external interface is an HDMI interface and / or a DP interface.

16. The device for full-channel display of the OSD menu according to claim 8, characterized in that, the device further includes a signal format conversion device, specifically including: the signal format conversion device is connected between the Android device and the image processing device, and is used to convert the output signal of the Android device into a format matching the output interface of the image processor.

Images