Display processing method and device, equipment and storage medium

Abstract

The invention provides a display processing method and device, equipment and a storage medium, and the display processing method comprises the steps: obtaining target image data of target display equipment in response to an atmosphere display request; performing image color picking on target image areas in the target image data according to a preset color picking strategy, and determining target color data corresponding to each target image area; and sending the target color data of the target image area to target light equipment based on a preset transmission link, and driving the target light equipment to perform atmosphere display according to the target color data. The light picture synchronous display of the lamp equipment and the display equipment is realized, so that the display immersion effect of the target display equipment is improved, and the user experience is optimized.

Description

Technical Field

[0001] The present application relates to the field of display control technology, and in particular to a display processing method, device, equipment and storage medium. Background Art

[0002] At present, with the rapid development of display devices such as smart TVs and the smart lighting industry, display devices can support more and more functions. For example, smart TVs can play games, immersive video playback, image display, etc. In addition, more and more smart TV shells can be installed with corresponding light strips and other lighting equipment for atmosphere adjustment. However, existing atmosphere adjustment lamps require manual color adjustment or execute fixed color conversion programs, and can only display a single color at the same time, resulting in poor atmosphere setting effect. Summary of the invention

[0003] The embodiments of the present application provide a display processing method, apparatus, device and storage medium, which are intended to solve the technical problem in the prior art that the lighting equipment of the smart display device has a poor atmosphere setting effect.

[0004] On the one hand, an embodiment of the present application provides a display processing method, the display processing method comprising the following steps:

[0005] In response to the atmosphere display request, acquiring target image data of the target display device;

[0006] Performing image color picking on target image areas in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area;

[0007] The target color data of the target image area is sent to the target lighting device based on a preset transmission link, and the target lighting device is driven to perform atmosphere display according to the target color data.

[0008] In a possible implementation of the present application, obtaining target image data of a target display device includes:

[0009] Acquire initial display image data of the target display device and an initial resolution corresponding to the initial display image data;

[0010] If the initial resolution is greater than the target image resolution, the initial display image data is scaled according to a preset image acquisition interface and the target image resolution to obtain the target image data corresponding to the initial display image data.

[0011] In a possible implementation of the present application, performing image color picking on a target image area in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area includes:

[0012] Acquire the initial color space attribute of the target image data;

[0013] If the initial color space attribute is different from the preset target color space attribute, performing color space conversion on the target image data to obtain converted image data;

[0014] Performing image segmentation on the converted image data according to a preset segmentation strategy to obtain a target image region in the converted image data;

[0015] The target image area is subjected to image color picking using a preset color picking strategy to determine target color data corresponding to each target image area.

[0016] In a possible implementation of the present application, the step of performing image color picking on the target image area by using a preset color picking strategy to determine target color data corresponding to each target image area includes:

[0017] Acquire pixel points in each region of the target image region, as well as pixel brightness and pixel saturation of the pixel points in the region;

[0018] The pixel points in the area whose pixel brightness is lower than a preset brightness threshold are set as first filtering pixel points;

[0019] Counting low saturation ratio information of the first pixel in each area pixel in the target image area, and determining the second filtering pixel in the area pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold;

[0020] The first filtered pixel points and the second filtered pixel points in the filter area pixels are obtained to obtain the target area pixels, and image color is extracted for the target area pixels to determine the target color data corresponding to each of the target image areas.

[0021] In a possible implementation of the present application, the preset saturation threshold includes a first saturation threshold and a second saturation threshold;

[0022] The counting of low saturation ratio information of the first pixel in each area pixel in the target image area, and determining the second filtering pixel in the area pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold, includes:

[0023] Setting a pixel point in a region of the target image region whose pixel saturation is lower than the first saturation threshold as a first pixel point;

[0024] Counting the proportion information of the first pixel points in the target image area to obtain low saturation proportion information in the target image area;

[0025] If the low saturation ratio information is lower than the second saturation threshold, the first pixel point in the target image area is set as the second filtering pixel point.

[0026] In a possible implementation of the present application, the step of performing image color extraction on the pixel points of the target area to determine the target color data corresponding to each target image area includes:

[0027] Performing color gamut classification on the target area pixel points to determine the pixel color gamut corresponding to each of the target area pixel points;

[0028] Compare the target area pixel percentages in each pixel color domain to obtain the target pixel color domain;

[0029] The target color data corresponding to the target image area is determined according to the color domain pixel brightness, the color domain pixel saturation and the color domain pixel hue in the target pixel color domain.

[0030] In a possible implementation of the present application, sending the target color data of the target image area to the target lighting device based on a preset transmission link, and driving the target lighting device to display the atmosphere according to the target color data, includes:

[0031] Determine a target lighting device corresponding to the target image area in a preset Bluetooth network;

[0032] Transmitting the target color data to the target lighting device using a preset transmission link;

[0033] The target lighting device is driven to perform atmosphere collaborative display according to the target color data.

[0034] On the other hand, the present application provides a display processing device, the display processing device comprising:

[0035] An image acquisition module is configured to respond to an atmosphere display request and acquire target image data of a target display device;

[0036] A color recognition module is configured to perform image color extraction on a target image area in the target image data according to a preset color extraction strategy, and determine target color data corresponding to each target image area;

[0037] The collaborative display module is configured to send the target color data of the target image area to the target lighting device based on a preset transmission link, and drive the target lighting device to perform atmosphere display according to the target color data.

[0038] On the other hand, the present application also provides a display processing device, the display processing device comprising:

[0039] one or more processors;

[0040] Memory; and

[0041] One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the steps of the display processing method.

[0042] On the other hand, the present application also provides a computer-readable storage medium on which a computer program is stored. The computer program is loaded by a processor to execute the steps in the display processing method.

[0043] In this application, the target image data of the target display device is obtained by responding to the atmosphere display request; the target image area in the target image data is image-picked according to the preset color-picking strategy to determine the target color data corresponding to each target image area; the target color data of the target image area is sent to the target lighting device based on the preset transmission link, and the target lighting device is driven to display the atmosphere according to the target color data. The target color data of the specified display area is determined by color-picking a specific area of ​​the target image data of the target display device, and the target color area is transmitted to the target lighting device corresponding to the target image area through the preset transmission link of the Bluetooth mesh network, and the target lighting device is driven to display the corresponding atmosphere light according to the target color data for atmosphere display, thereby realizing the synchronous display of the lighting equipment and the light painting of the display device, so as to improve the display immersion effect of the target display device and optimize the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 A schematic diagram of a scenario showing a processing method in an embodiment of the present application;

[0046] Figure 2 A schematic diagram showing a flow chart of an embodiment of a processing method in an embodiment of the present application;

[0047] Figure 3 A schematic diagram of an embodiment of performing image segmentation on an image in a display processing method provided in an embodiment of the present application;

[0048] Figure 4 A schematic diagram of a flow chart of an embodiment of performing regional image color extraction in a display processing method provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of a flow chart of an embodiment of color selection of pixel points in a target area in a target image area in a display processing method provided in an embodiment of the present application;

[0050] Figure 6 A schematic diagram of the structure of an embodiment of a display processing device provided in an embodiment of the present application;

[0051] Figure 7 A schematic diagram of the structure of an embodiment of a display processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0053] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0054] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as being preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the invention can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0055] At present, with the rapid development of display devices such as smart TVs and the smart lighting industry, display devices can support more and more functions. For example, smart TVs can play games, immersive video playback, image display, etc. In addition, more and more smart TV shells can be installed with corresponding light strips and other lighting equipment for atmosphere adjustment. However, existing atmosphere adjustment lamps require manual color adjustment or execute fixed color conversion programs, and can only display a single color at the same time, resulting in poor atmosphere setting effect.

[0056] Based on this, the present application proposes a display processing method, device, equipment and computer-readable storage medium to solve the technical problem that the lighting equipment of the smart display device in the prior art has a poor atmosphere setting effect.

[0057] The display processing method in the embodiment of the present invention is applied to a display processing device, and the display processing device is arranged in a display processing device, and one or more processors, a memory, and one or more application programs are arranged in the display processing device, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the display processing method; wherein the display processing device can be an intelligent terminal, such as a mobile phone, a tablet computer, a display, a smart TV, and a smart computer, etc.; optionally, the display processing device can also be a server, or a service cluster composed of multiple servers.

[0058] like Figure 1 As shown, Figure 1 The following is a schematic diagram of a scene of the display processing method of the embodiment of the present application. The display processing scene in the embodiment of the present invention includes a display processing device 100 (a display processing device is integrated in the display processing device 100) and a target lighting device 200. A computer-readable storage medium corresponding to the display processing method is run in the display processing device 100 to execute the steps of the display processing method. The target lighting device 200 is a lighting device that is connected to the display processing device 100 for communication and can perform coordinated atmosphere display according to target color data.

[0059] Understandably, Figure 1 The display processing device in the display processing method scenario shown, or the devices included in the display processing device, does not constitute a limitation on the embodiments of the present invention, that is, the number of devices and types of devices of the display processing devices included in the display processing method scenario, or the number of devices and types of devices included in each device, do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution claimed to be protected in the embodiments of the present invention.

[0060] The display processing device 100 in the embodiment of the present invention is mainly used to: respond to an atmosphere display request and obtain target image data of a target display device;

[0061] Performing image color picking on target image areas in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area;

[0062] The target color data of the target image area is sent to the target lighting device based on a preset transmission link, and the target lighting device is driven to perform atmosphere display according to the target color data.

[0063] The display processing device 100 in the embodiment of the present invention can be an independent display processing device, such as a smart display terminal such as a mobile phone, a tablet computer, a monitor, a smart TV, and a smart computer, or it can be a display processing network or display processing cluster composed of multiple display processing devices.

[0064] The embodiments of the present application provide a display processing method, apparatus, device, and computer-readable storage medium, which are described in detail below.

[0065] It can be understood by those skilled in the art that Figure 1 The application environment shown in is only one of the application scenarios related to the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer display processing devices are shown, or the display processing network connection relationship is shown, for example Figure 1 Only one display processing device is shown. It can be understood that the scenario of the display processing method can also include one or more display processing devices, which is not specifically limited here. The display processing device 100 can also include a memory for storing target color data and other data.

[0066] It should be noted that Figure 1The scene diagram of the display processing method shown is only an example. The scene of the display processing method described in the embodiment of the present invention is to more clearly illustrate the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention.

[0067] Based on the scenario of the above display processing method, various embodiments of the display processing method disclosed in the present invention are proposed.

[0068] like Figure 2 As shown, Figure 2 This is a flow chart of an embodiment of a display processing method in an embodiment of the present application. The display processing method includes the following steps 201 to 203:

[0069] 201. Respond to an atmosphere display request and obtain target image data of a target display device;

[0070] The display processing method in this embodiment is applied to a display processing device, and the type and number of the display processing device are not specifically limited, that is, the display processing device can be one or more intelligent terminals or servers. In a specific embodiment, the display processing device can be a target display device or an intelligent terminal independent of the target display device. Wherein, the housing of the target display device or the surrounding area of ​​the target display device is also provided with a target lighting device. Wherein, the target lighting device is a lighting device that is connected to the target display device or the display processing device through a preset transmission link, and can respond to the coordinated display instruction to display lights corresponding to different color data. For example, the target lighting device can be a lighting device such as an RGB light strip. Optionally, in another specific embodiment, the target lighting device can also be a lighting module set on a peripheral device (such as a handle, a mouse, a keyboard, and a speaker, etc.) that is connected to the target display device or the display processing device. Wherein, the target display device can be a display device such as a smart TV, a smart display, a smart curtain, and a smart computer. In a specific embodiment, the preset transmission link can be a Bluetooth Mesh networking link.

[0071] Specifically, since the application scenarios of the target display device are becoming more and more extensive, and users pursue a more immersive sensory experience when using the target display device for entertainment and other activities, the terminal responds to the atmosphere display request during operation, wherein the atmosphere display request is an operation instruction for driving the terminal to control the target lighting device to perform a collaborative atmosphere display according to the target image data displayed by the target display device. Among them, the triggering method of the atmosphere display request is not specifically limited here. That is, the atmosphere display request can be actively triggered by the user, for example, the user actively triggers the atmosphere display request by clicking the atmosphere display button on the mobile terminal (such as a remote control, a mobile terminal with a remote control application installed, and other peripheral terminals) that is connected to the target display device or display processing device. In addition, the atmosphere display request can also be automatically triggered by the target display device or display processing device, wherein the display processing device is provided with an atmosphere display process, and when it is detected that the target display device is in a specific display mode (such as an immersive viewing mode and a game mode), the atmosphere display request is automatically triggered.

[0072] Specifically, after receiving the atmosphere display request, the terminal also obtains the target image data of the target display device, wherein the target image data may be the currently displayed screen frame of the target display device, and / or the processed image data corresponding to the next screen frame to be displayed by the target display device.

[0073] Specifically, after receiving the atmosphere display request, the terminal obtains the initial display image data of the target display device and reads the initial resolution corresponding to the initial display image data, wherein the initial display image data is the current display frame of the target display device and / or the next frame to be displayed by the target display device.

[0074] Specifically, after the terminal obtains the initial display image data of the target display device using the preset image acquisition interface, it also obtains the initial resolution corresponding to the initial display image data, and compares the initial resolution with the target image resolution to determine whether to adjust the initial display image data to improve subsequent computing efficiency. Optionally, in a specific embodiment, the target image resolution is 640*360. In other embodiments, the target image resolution can also be customized according to the computing power configuration of the terminal, which is not specifically limited in this embodiment.

[0075] Optionally, if the initial resolution is greater than the target image resolution, it is determined that the initial display image data needs to be scaled, and the terminal performs image scaling on the initial display image data according to the image acquisition interface and the target image resolution, thereby scaling the initial display image data to target image data having a resolution corresponding to the target image resolution.

[0076] Optionally, in other embodiments, after acquiring the target image data with a resolution corresponding to the target image resolution, the terminal further scales the target image data, thereby scaling the target image data to a resolution range corresponding to the target scaled resolution, thereby further improving the subsequent color picking efficiency. The target scaled resolution is 160*90.

[0077] That is, in a specific embodiment, the terminal uses the image acquisition interface and the target image resolution to scale the initial display image data into target image data corresponding to the target image resolution. At this time, the target image data is an RGB image with a resolution of 640*360. In order to further improve the subsequent calculation efficiency, the terminal further scales the target image data to obtain target image data with an image resolution of the target scaled resolution. At this time, the target image data is an RGB image with a resolution of 160*90.

[0078] 202. Perform image color picking on target image areas in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area;

[0079] Specifically, after acquiring the target image data corresponding to the target display device, the terminal further performs image color picking on the target image area in the target image data according to a preset color picking strategy, thereby determining the target color data corresponding to each target image area.

[0080] Specifically, after acquiring the target image data, the terminal also needs to extract the color data that is eye-catching to the human eye in each display partition of the target image data. Therefore, the terminal needs to filter the color data with unclear colors and gray color data in the target image data, so as to determine the target color data that needs to be displayed collaboratively later. However, since the RGB color space cannot filter pixels, after acquiring the target image data, the terminal also acquires the initial color space attributes of the target image data, and compares the initial color space attributes with the preset target color space attributes, so as to determine whether the target image data is image data that can be pixel filtered. In a specific embodiment, the target color space is the HSV color space.

[0081] Optionally, if the initial color space attribute is different from the target color space attribute, the terminal determines that the target image data is image data that cannot perform pixel filtering, and the terminal performs color space conversion on the target image data, converting the target image data from the initial color space attribute to the target color space attribute, thereby obtaining converted image data that can filter pixels.

[0082] Specifically, after obtaining the converted image data, the terminal also performs image segmentation on the converted image data according to a preset segmentation strategy, thereby obtaining a target image area in the converted image data. The preset segmentation strategy is an image segmentation strategy that includes performing a specific number of segmentations on the image. In a specific embodiment, the number of segmentations in the preset segmentation strategy can be a 2*2 segmentation number, a 3*2 segmentation number, a 3*3 segmentation number, a 4*3 segmentation number, or a 4 segmentation number.

[0083] Specifically, Figure 3 As shown, Figure 3 This is a schematic diagram of an embodiment of image segmentation in the display processing method provided in the embodiment of the present application. Figure 3 As shown, the terminal can divide the converted image data into a number of image regions according to a preset segmentation strategy, and set the image region in the boundary region of the converted image data as the target image region. That is, Figure 3 The gray marked area in the converted image data is the target image area.

[0084] Specifically, after acquiring each target image area, the terminal also uses a preset color picking strategy to pick the image color of the target image area, so as to determine the target color data corresponding to each target image area.

[0085] Optionally, before performing image color extraction on the target image area, the terminal also pre-filters the first filter pixel points and the second filter pixel points in the target image area, and performs image color extraction on the filtered target image area, thereby achieving the goal of highlighting and extracting target color data that is eye-catching to the human eye.

[0086] 203. Send the target color data of the target image area to the target lighting device based on a preset transmission link, and drive the target lighting device to perform atmosphere display according to the target color data.

[0087] Specifically, after determining the target color data corresponding to each target image area, the terminal also sends the target color data of the target image area to the target lighting device corresponding to the target image area based on a preset transmission link, and drives the target lighting device to display the atmosphere according to the target color data.

[0088] Specifically, the target display device can be used as a gateway device in a preset Bluetooth network, and each lighting device can be used as a networking sub-device in the preset Bluetooth network. After determining the target color data of each target image area, the terminal also determines the target lighting device corresponding to the target image area in the preset Bluetooth network, and uses the preset transmission link to transmit the target color data of the target image area to the target lighting device. That is, the terminal controls the target display device to connect to the proxy node in the preset Bluetooth network through the GATT (Generic Attri ibute Profile) protocol and send the target color data, and transmits the target color data to the target lighting device through the proxy node through the preset transmission link, thereby driving the target lighting device to perform atmosphere collaborative display according to the target color data, thereby achieving light and picture synchronization, and a colorful atmosphere collaborative display effect.

[0089] In this embodiment, the display processing device obtains the target image data of the target display device by responding to the atmosphere display request; performs image color extraction on the target image area in the target image data according to the preset color extraction strategy to determine the target color data corresponding to each target image area; sends the target color data of the target image area to the target lighting device based on the preset transmission link, and drives the target lighting device to display the atmosphere according to the target color data. The target color data of the specified display area is determined by performing color extraction on the target image data of the target display device in a specific area, and the target color area is transmitted to the target lighting device corresponding to the target image area through the preset transmission link of the Bluetooth mesh network, and the target lighting device is driven to display the corresponding atmosphere light according to the target color data for atmosphere display, thereby realizing the synchronous display of the lighting device and the light painting of the display device, so as to improve the display immersion effect of the target display device and optimize the user experience.

[0090] like Figure 4 As shown, Figure 4 This is a flow chart of an embodiment of performing regional image color extraction in the display processing method provided in the embodiment of the present application. Specifically, in this embodiment, the display processing method further includes steps 301 to 304:

[0091] 301. Obtain pixel points in each region of the target image region, as well as pixel brightness and pixel saturation of the pixel points in the region;

[0092] 302. Setting the pixel points in the area whose pixel brightness is lower than a preset brightness threshold as first filtering pixel points;

[0093] 303. Counting low saturation ratio information of the first pixel in each regional pixel in the target image region, and determining the second filtering pixel in the regional pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold;

[0094] 304. Filter the first filtered pixel points and the second filtered pixel points in the area pixels to obtain the target area pixels, perform image color extraction on the target area pixels, and determine the target color data corresponding to each of the target image areas.

[0095] Based on the above embodiments, in this embodiment, before the terminal performs image color extraction on the target image area, it also pre-filters the first filter pixel points and the second filter pixel points in the target image area, and performs image color extraction on the filtered target image area, thereby realizing the prominent extraction of target color data that is eye-catching to the human eye.

[0096] Specifically, the terminal obtains the pixel points of each region in the target image region, as well as the pixel brightness and pixel saturation of the pixel points of the region, wherein the pixel points of the region are display pixels located in the target image region.

[0097] Specifically, after acquiring the pixel brightness of the regional pixel point, the terminal further compares the pixel brightness with a preset brightness threshold, so as to determine whether the regional pixel point is a pixel point with lower brightness.

[0098] Optionally, if the pixel brightness of any area pixel is lower than a preset brightness threshold, the terminal determines that the area pixel is a pixel with lower brightness and sets the area pixel as a first filtering pixel, wherein the first filtering pixel is a area pixel with lower brightness and presents black or dark gray.

[0099] Specifically, after obtaining the pixel saturation of the regional pixel point, the terminal also determines the first pixel point in the regional pixel point according to the pixel saturation and the first saturation threshold in the preset saturation threshold. The first saturation threshold is used to detect whether the regional pixel point is the first pixel point that is white or grayish white.

[0100] Optionally, if the pixel saturation is lower than the preset saturation threshold, the terminal determines that the regional pixel point corresponding to the pixel saturation is the first pixel point.

[0101] Specifically, after the terminal divides the regional pixel points in the target image area by saturation, it further counts the proportion information of each first pixel point in the target image area, that is, the terminal divides the number of first pixel points in the target image area by the total number of pixels in the target image area to obtain the low saturation proportion information of the first pixel points in the target image area, and judges whether the target image area is a low saturation image area through the low saturation proportion information of the first pixel points and the second saturation threshold. Among them, the second saturation threshold is a low saturation proportion threshold for judging whether the target image area is a low saturation image area. In a specific embodiment, the second saturation threshold is 90%.

[0102] Optionally, if the low saturation proportion information is greater than the second saturation threshold, the terminal determines that the target image area corresponding to the low saturation proportion information is a low saturation image area that only contains grayish white pixels, and the terminal determines grayish white as the target color data of the low saturation image area.

[0103] Optionally, if the low saturation ratio information is less than the second saturation threshold, the terminal determines that the target image area corresponding to the low saturation ratio information is a non-low saturation image area, and sets the first pixel point in the target image area as the second filtering pixel point.

[0104] Specifically, after determining the first filtering pixel point and the second filtering pixel point, the terminal filters the first filtering pixel point and the second filtering pixel point in the target image area to obtain the remaining target area pixel points in the target image area, and performs image color extraction on the target area pixel points to determine the target color data corresponding to each target image area. In this way, the target color data that is eye-catching to the human eye can be highlighted and extracted.

[0105] In this embodiment, the display processing device obtains the pixel points of each region in the target image area, as well as the pixel brightness and pixel saturation of the pixel points of the region; sets the pixel points of the region whose pixel brightness is lower than the preset brightness threshold as the first filtering pixel points; counts the low saturation ratio information of the first pixel points in the pixel points of each region in the target image area, and determines the second filtering pixel points in the regional pixel points according to the low saturation ratio information, the pixel saturation and the preset saturation threshold; filters the first filtering pixel points and the second filtering pixel points in the regional pixel points to obtain the target region pixel points, performs image color extraction on the target region pixel points, and determines the target color data corresponding to each of the target image regions. The low brightness pixel points and the first pixel points in the target image area are filtered, thereby improving the accuracy of subsequent color extraction and realizing the extraction of the target color data that is eye-catching to the human eye.

[0106] like Figure 5 As shown, Figure 5This is a flow chart of an embodiment of coloring a pixel point in a target area in a target image area in a display processing method provided in an embodiment of the present application. Specifically, the display processing method further includes steps 401 to 403:

[0107] 401. Perform color gamut classification on the target area pixel points to determine the pixel color gamut corresponding to each of the target area pixel points;

[0108] 402. Compare the percentages of target area pixels in each pixel color domain to obtain a target pixel color domain;

[0109] 403. Determine target color data corresponding to the target image area according to the color domain pixel brightness, the color domain pixel saturation, and the color domain pixel hue in the target pixel color domain.

[0110] Based on the above embodiments, in this embodiment, after acquiring each target image area, the terminal also uses a preset color picking strategy to pick the image color of the target image area, so as to determine the target color data corresponding to each target image area.

[0111] Specifically, after acquiring the target area pixel points corresponding to the target image area, the terminal also performs color gamut classification according to the pixel hue of each target area pixel point, thereby determining the pixel color domain into which each target area pixel point falls. Among them, the pixel color domain is the color domain obtained by categorizing the target area pixel points according to the hue value. In a specific embodiment, the pixel color and includes a red color domain, an orange color domain, a yellow color domain, a green color domain, a cyan color domain, a blue color domain, a purple color domain and a red color domain. The color gamut hue intervals corresponding to different color domains are different. The terminal determines the pixel color domain corresponding to the target area pixel point by comparing the color gamut hue interval with the pixel hue.

[0112] Specifically, after obtaining the pixel color domain corresponding to the target image area, the terminal also compares the proportion of target area pixels in each pixel color domain, that is, the terminal counts the ratio of the number of target area pixels in each pixel color domain to the total number of target area pixels in the target image area, obtains the target area pixel proportion, and determines the pixel color area with the largest target area pixel proportion as the target pixel color domain.

[0113] Specifically, after obtaining the target pixel color domain corresponding to the target image area, the terminal also calculates the color domain pixel brightness, color domain pixel saturation and color domain pixel hue in the target pixel color domain. Among them, the color domain pixel brightness is the sum of the pixel brightness of all target pixels in the target color domain. The color domain pixel saturation is the sum of the pixel saturation of all target pixels in the target color domain. The color domain pixel hue is the sum of the pixel hues of all target pixels in the target color domain.

[0114] Specifically, after obtaining the color domain pixel brightness, color domain pixel saturation, and color domain pixel hue, the terminal also calculates the average pixel brightness according to the color domain pixel brightness and the target color domain pixel number, calculates the average pixel saturation according to the color domain pixel saturation and the target color domain pixel number, and calculates the average pixel hue according to the color domain pixel hue and the target color domain pixel number. The average pixel hue, average pixel saturation, and average pixel brightness are determined as the target color data corresponding to the target image area.

[0115] Specifically, after determining the target color data corresponding to each target image area, the terminal also sends the target color data of the target image area to the target lighting device corresponding to the target image area based on a preset transmission link, and drives the target lighting device to display the atmosphere according to the target color data.

[0116] In this embodiment, the display processing device determines the pixel color domain corresponding to each pixel point in the target area by color domain classification of the pixel points in the target area; compares the proportion of the pixel points in the target area in each pixel color domain to obtain the target pixel color domain; and determines the target color data corresponding to the target image area according to the color domain pixel brightness, color domain pixel saturation and color domain pixel hue in the target pixel color domain. The target color domain corresponding to the target image area is determined, and the target color data corresponding to the target image area is determined using the color domain pixel brightness, color domain pixel saturation and color domain pixel hue in the target pixel color domain, thereby accurately determining the color data corresponding to the target image area, providing a data basis for the subsequent collaborative atmosphere display.

[0117] In order to better implement the display processing method in the embodiment of the present application, based on the display processing method, the embodiment of the present application also provides a display processing device, such as Figure 6 As shown, Figure 6 The structure diagram of the display processing device provided in the embodiment of the present application is as follows. Specifically, the display processing device 500 includes:

[0118] The image acquisition module 501 is configured to respond to the atmosphere display request and acquire target image data of the target display device;

[0119] The color recognition module 502 is configured to perform image color extraction on the target image areas in the target image data according to a preset color extraction strategy, and determine the target color data corresponding to each target image area;

[0120] The collaborative display module 503 is configured to send the target color data of the target image area to the target lighting device based on a preset transmission link, and drive the target lighting device to perform atmosphere display according to the target color data.

[0121] In a possible implementation of this embodiment, the display processing device obtains target image data of the target display device, including:

[0122] Acquire initial display image data of the target display device and an initial resolution corresponding to the initial display image data;

[0123] If the initial resolution is greater than the target image resolution, the initial display image data is scaled according to a preset image acquisition interface and the target image resolution to obtain the target image data corresponding to the initial display image data.

[0124] In a possible implementation of this embodiment, the display processing device performs image color picking on the target image area in the target image data according to a preset color picking strategy to determine the target color data corresponding to each target image area, including:

[0125] Acquire the initial color space attribute of the target image data;

[0126] If the initial color space attribute is different from the preset target color space attribute, performing color space conversion on the target image data to obtain converted image data;

[0127] Performing image segmentation on the converted image data according to a preset segmentation strategy to obtain a target image region in the converted image data;

[0128] The target image area is subjected to image color picking using a preset color picking strategy to determine target color data corresponding to each target image area.

[0129] In a possible implementation of this embodiment, the display processing device uses a preset color picking strategy to pick colors for the target image areas and determines target color data corresponding to each target image area, including:

[0130] Acquire pixel points in each region of the target image region, as well as pixel brightness and pixel saturation of the pixel points in the region;

[0131] The pixel points in the area whose pixel brightness is lower than a preset brightness threshold are set as first filtering pixel points;

[0132] Counting low saturation ratio information of the first pixel in each area pixel in the target image area, and determining the second filtering pixel in the area pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold;

[0133] The first filtered pixel points and the second filtered pixel points in the filter area pixels are obtained to obtain the target area pixels, and image color is extracted for the target area pixels to determine the target color data corresponding to each of the target image areas.

[0134] In a possible implementation of this embodiment, the display processing device determines that the preset saturation threshold includes a first saturation threshold and a second saturation threshold;

[0135] The counting of low saturation ratio information of the first pixel in each area pixel in the target image area, and determining the second filtering pixel in the area pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold, includes:

[0136] Setting a pixel point in a region of the target image region whose pixel saturation is lower than the first saturation threshold as a first pixel point;

[0137] Counting the proportion information of the first pixel points in the target image area to obtain low saturation proportion information in the target image area;

[0138] If the low saturation ratio information is lower than the second saturation threshold, the first pixel point in the target image area is set as the second filtering pixel point.

[0139] In a possible implementation of this embodiment, the display processing device performs image color extraction on the pixel points of the target area to determine the target color data corresponding to each target image area, including:

[0140] Performing color gamut classification on the target area pixel points to determine the pixel color gamut corresponding to each of the target area pixel points;

[0141] Compare the target area pixel percentages in each pixel color domain to obtain the target pixel color domain;

[0142] The target color data corresponding to the target image area is determined according to the color domain pixel brightness, the color domain pixel saturation and the color domain pixel hue in the target pixel color domain.

[0143] In a possible implementation of this embodiment, the display processing device sends the target color data of the target image area to the target lighting device based on a preset transmission link, and drives the target lighting device to perform atmosphere display according to the target color data, including:

[0144] Determine a target lighting device corresponding to the target image area in a preset Bluetooth network;

[0145] Transmitting the target color data to the target lighting device using a preset transmission link;

[0146] The target lighting device is driven to perform atmosphere collaborative display according to the target color data.

[0147] In this embodiment, the display processing device obtains the target image data of the target display device by responding to the atmosphere display request; performs image color extraction on the target image area in the target image data according to the preset color extraction strategy to determine the target color data corresponding to each target image area; sends the target color data of the target image area to the target lighting device based on the preset transmission link, and drives the target lighting device to display the atmosphere according to the target color data. The target color data of the specified display area is determined by performing color extraction on the target image data of the target display device in a specific area, and the target color area is transmitted to the target lighting device corresponding to the target image area through the preset transmission link of the Bluetooth mesh network, and the target lighting device is driven to display the corresponding atmosphere light according to the target color data for atmosphere display, thereby realizing the synchronous display of the lighting device and the light painting of the display device, so as to improve the display immersion effect of the target display device and optimize the user experience.

[0148] The embodiment of the present invention also provides a display processing device, such as Figure 7 As shown, Figure 7 A schematic diagram of the structure of an embodiment of a display processing device provided in an embodiment of the present application.

[0149] The display processing device integrates any one of the display processing devices provided by the embodiments of the present invention, and the display processing device includes:

[0150] one or more processors;

[0151] Memory; and

[0152] One or more applications, wherein the one or more applications are stored in the memory and are configured so that the processor executes the steps of the display processing method described in any of the above display processing method embodiments.

[0153] Specifically, the display processing device may include a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, an input unit 604, and other components. Those skilled in the art will appreciate that Figure 7The display processing device structure shown in the figure does not constitute a limitation on the display processing device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0154] The processor 601 is the control center of the display processing device. It uses various interfaces and lines to connect various parts of the entire display processing device. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it executes various functions of the display processing device and processes data, thereby monitoring the display processing device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.

[0155] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and display processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the display processing device, etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0156] The display processing device also includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 603 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0157] The display processing device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0158] Although not shown, the display processing device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 601 in the display processing device will load the executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 will run the application programs stored in the memory 602, thereby realizing various functions, as follows:

[0159] In response to the atmosphere display request, acquiring target image data of the target display device;

[0160] Performing image color picking on target image areas in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area;

[0161] The target color data of the target image area is sent to the target lighting device based on a preset transmission link, and the target lighting device is driven to perform atmosphere display according to the target color data.

[0162] To this end, an embodiment of the present invention provides a computer-readable storage medium, which may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any display processing method provided in the embodiment of the present invention. For example, the computer program can be loaded by the processor to execute the following steps:

[0163] In response to the atmosphere display request, acquiring target image data of the target display device;

[0164] Performing image color picking on target image areas in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area;

[0165] The target color data of the target image area is sent to the target lighting device based on a preset transmission link, and the target lighting device is driven to perform atmosphere display according to the target color data.

[0166] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above, and will not be repeated here.

[0167] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments, which will not be repeated here.

[0168] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0169] The above is a detailed introduction to a display processing method provided in an embodiment of the present application. Specific embodiments are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A display processing method, characterized in that: The display processing method comprises: In response to the atmosphere display request, acquiring target image data of the target display device; Performing image color picking on target image areas in the target image data according to a preset color picking strategy to determine target color data corresponding to each target image area; The target color data of the target image area is sent to the target lighting device based on a preset transmission link, and the target lighting device is driven to perform atmosphere display according to the target color data.

2. The display processing method according to claim 1, characterized in that: The step of acquiring target image data of a target display device comprises: Acquire initial display image data of the target display device and an initial resolution corresponding to the initial display image data; If the initial resolution is greater than the target image resolution, the initial display image data is scaled according to a preset image acquisition interface and the target image resolution to obtain the target image data corresponding to the initial display image data.

3. The display processing method according to claim 1, characterized in that: The step of performing image color picking on the target image areas in the target image data according to the preset color picking strategy to determine the target color data corresponding to each target image area includes: Acquire the initial color space attribute of the target image data; If the initial color space attribute is different from the preset target color space attribute, performing color space conversion on the target image data to obtain converted image data; Performing image segmentation on the converted image data according to a preset segmentation strategy to obtain a target image region in the converted image data; The target image area is subjected to image color picking using a preset color picking strategy to determine target color data corresponding to each target image area.

4. The display processing method according to claim 3, characterized in that: The method of performing image color picking on the target image area by using a preset color picking strategy to determine target color data corresponding to each target image area includes: Acquire pixel points in each region of the target image region, as well as pixel brightness and pixel saturation of the pixel points in the region; The pixel points in the area whose pixel brightness is lower than a preset brightness threshold are set as first filtering pixel points; Counting low saturation ratio information of the first pixel in each area pixel in the target image area, and determining the second filtering pixel in the area pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold; The first filtered pixel points and the second filtered pixel points in the filter area pixels are obtained to obtain the target area pixels, and image color is extracted for the target area pixels to determine the target color data corresponding to each of the target image areas.

5. The display processing method according to claim 4, characterized in that: The preset saturation threshold includes a first saturation threshold and a second saturation threshold; The counting of low saturation ratio information of the first pixel in each area pixel in the target image area, and determining the second filtering pixel in the area pixel according to the low saturation ratio information, the pixel saturation and a preset saturation threshold, comprises: Setting a pixel point in a region of the target image region whose pixel saturation is lower than the first saturation threshold as a first pixel point; Counting the proportion information of the first pixel points in the target image area to obtain low saturation proportion information in the target image area; If the low saturation ratio information is lower than the second saturation threshold, the first pixel point in the target image area is set as the second filtering pixel point.

6. The display processing method according to claim 4, characterized in that: The step of performing image color extraction on the pixel points of the target area to determine the target color data corresponding to each target image area includes: Performing color gamut classification on the target area pixel points to determine the pixel color gamut corresponding to each of the target area pixel points; Compare the target area pixel percentages in each pixel color domain to obtain the target pixel color domain; The target color data corresponding to the target image area is determined according to the color domain pixel brightness, the color domain pixel saturation and the color domain pixel hue in the target pixel color domain.

7. The display processing method according to any one of claims 1 to 6, characterized in that: The step of sending the target color data of the target image area to the target lighting device based on the preset transmission link, and driving the target lighting device to display the atmosphere according to the target color data, comprises: Determine a target lighting device corresponding to the target image area in a preset Bluetooth network; Transmitting the target color data to the target lighting device using a preset transmission link; The target lighting device is driven to perform atmosphere collaborative display according to the target color data.

8. A display processing device, characterized in that: The display processing device comprises: An image acquisition module is configured to respond to an atmosphere display request and acquire target image data of a target display device; A color recognition module is configured to perform image color extraction on a target image area in the target image data according to a preset color extraction strategy, and determine target color data corresponding to each target image area; The collaborative display module is configured to send the target color data of the target image area to the target lighting device based on a preset transmission link, and drive the target lighting device to perform atmosphere display according to the target color data.

9. A display processing device, characterized in that: The display processing device comprises: one or more processors; Memory; and One or more application programs, wherein the one or more application programs are stored in the memory and are configured to be executed by the processor to implement the steps of the display processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the display processing method according to any one of claims 1 to 7.

Images