A display control method, device and computer storage medium

Abstract

The present disclosure provides a display control method, device and computer storage medium. The display control method may include: acquiring color information corresponding to a target display image; and when displaying the target display image, controlling the display color of a vehicle atmosphere adjustment system based on the color information.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of vehicle control technology, and more particularly to a display control method, device, and computer storage medium. Background Art

[0002] In modern automotive technology, creating an in-car atmosphere has become an important aspect of improving the driving experience. With the rapid development of in-car infotainment systems, in-car display technology has continued to advance, providing users with a rich visual experience. However, existing display control technologies are mostly focused on the display of images and information, and are still insufficient for dynamic adjustment and personalized settings of the in-car atmosphere.

[0003] Traditional in-car atmosphere systems usually use preset color modes and lack real-time interaction with displayed content. When users watch videos, check navigation, or perform other visual interactions in the car, the fixed light color cannot provide an atmosphere effect that matches the content, limiting the immersiveness and personalized needs of the user experience.

[0004] In addition, some existing technologies attempt to adjust the atmosphere light through simple ambient light sensing or user manual settings, but these methods cannot achieve truly intelligent atmosphere control and have a low degree of intelligence. Summary of the invention

[0005] In view of this, the embodiments of the present disclosure are intended to provide a display control method, device and computer storage medium, which can solve the technical problem of low intelligence level of atmosphere adjustment systems in the prior art.

[0006] The technical solution of the embodiment of the present disclosure is implemented as follows:

[0007] In a first aspect, an embodiment of the present disclosure provides a display control method, characterized by comprising:

[0008] Get the color information corresponding to the target display image;

[0009] When displaying the target display image, the display color of the vehicle atmosphere adjustment system is controlled based on the color information.

[0010] In a second aspect, an embodiment of the present disclosure provides a display control device, including:

[0011] An acquisition module is used to acquire color information corresponding to a target display image;

[0012] The display module controls the display color of the vehicle atmosphere adjustment system based on the color information when displaying the target display image.

[0013] In a third aspect, an embodiment of the present disclosure provides a display control device, comprising: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the display control method described in the first aspect.

[0014] In a fourth aspect, an embodiment of the present disclosure provides a computer storage medium, wherein the storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method as described in the first aspect.

[0015] The disclosed embodiments provide a display control method, device and computer storage medium; by acquiring the color information of the target display image, the vehicle atmosphere adjustment system can achieve color synchronization with the image content and enhance visual consistency. By adjusting the atmosphere based on the image color information, an environmental atmosphere matching the image content can be provided for the driver and passengers, thereby enhancing the immersive experience and improving the intelligent control of the vehicle atmosphere adjustment system. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic diagram of the composition of a vehicle-mounted system provided in an embodiment of the present disclosure.

[0017] Figure 2 An exemplary top view of a vehicle provided for the present disclosure.

[0018] Figure 3 An exemplary perspective view from the driver's seat of a vehicle is provided for the present disclosure.

[0019] Figure 4 This is an example diagram of a display area in an atmosphere adjustment system provided in an embodiment of the present disclosure.

[0020] Figure 5 A flow chart of a display control method provided by an embodiment of the present disclosure.

[0021] Figure 6 A schematic diagram of a hue wheel provided in an embodiment of the present disclosure.

[0022] Figure 7 A schematic diagram of a candidate pixel point combination displayed on a graphical user interface provided by an embodiment of the present disclosure.

[0023] Figure 8 A schematic diagram of a pixel point screening rule provided in an embodiment of the present disclosure.

[0024] Fig. 9 A schematic diagram showing a target pixel combination provided in an embodiment of the present disclosure.

[0025] Fig.10 A schematic diagram of a default display mode provided in an embodiment of the present disclosure.

[0026] Fig.11 A schematic diagram of the mapping relationship between sound types and display elements provided in an embodiment of the present disclosure.

[0027] Fig.12 A schematic diagram of the effect of frequency on display provided in an embodiment of the present disclosure.

[0028] Fig.13 A schematic diagram of the effect of amplitude on display provided in an embodiment of the present disclosure.

[0029] Fig.14 A schematic diagram of a display graphic provided for an embodiment of the present disclosure.

[0030] Fig.15 Another schematic diagram of the effect of frequency on display provided in an embodiment of the present disclosure.

[0031] Fig.16 Another schematic diagram of the effect of amplitude on display provided in an embodiment of the present disclosure.

[0032] Fig.17 A color display schematic diagram provided for an embodiment of the present disclosure.

[0033] Fig.18 A schematic diagram displayed on a continuous screen is provided for an embodiment of the present disclosure.

[0034] Fig.19 Another schematic diagram displayed on a continuous screen is provided for an embodiment of the present disclosure.

[0035] Fig. 20 A schematic diagram of another display control method provided by an embodiment of the present disclosure.

[0036] Fig.21 A schematic diagram of the structure of a display control device provided in an embodiment of the present disclosure.

[0037] Fig. 22 A schematic diagram of the structure of a display control device provided in an embodiment of the present disclosure.

[0038] The above drawings show clear embodiments of the present disclosure, which will be described in more detail below. These drawings and text descriptions are not intended to limit the scope of the present disclosure in any way, but to illustrate the concepts of the present disclosure to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0039] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0040] like Figure 1 As shown, the vehicle-mounted system 100 includes: a navigation subsystem 110, an environment detection device group 120 for obtaining the vehicle's environment during the vehicle's driving, a vehicle driving state detection device group 130, a data processing unit 140, a display control unit 150, and a display unit 160. The above components or device groups are coupled together through a communication bus 12. In some examples, the communication bus 12 is used for connection and communication between the above components or device groups. It should be noted that Figure 1 Only a portion of the in-vehicle system 100 is shown, not all of the components of the in-vehicle system 100 .

[0041] exist Figure 1 In the navigation subsystem 110, a positioning device 111 and a map information storage device 112 are included. The positioning device 111 can locate the position of the vehicle based on the global positioning system (GPS), China's Beidou system, Russia's GLONASS system, Europe's Galileo system, Japan's Quasi-Zenith Satellite System (QZSS), India's Indian Regional Navigation Satellite System (IRNSS) and other positioning systems to obtain the position information of the vehicle. The map information storage device 112 stores map information, and can obtain a navigation path leading to the destination according to the position information obtained from the positioning device 111, and display the position information and the navigation path in the map application.

[0042] exist Figure 1 In the embodiment, the environment detection device group 120 may include an on-vehicle communication device 121, a radar 122, a laser rangefinder 123, and a camera 124. These devices can acquire environmental data representing the surrounding environment of the vehicle.

[0043] The vehicle-mounted communication device 121 can communicate wirelessly with one or more devices directly or via a communication network. These devices that can communicate with the vehicle-mounted communication device 121 can be other vehicles, roadside machines or roadside stations, or mobile terminal devices used by the occupants of the vehicle. In some examples, the vehicle-mounted communication device 121 can use 3G cellular communication, such as code division multiple access (CDMA), EVDO, global system for mobile communications (GSM) / general packet radio service (GPRS), or 4G cellular communication, such as long term evolution (LTE), or 5G cellular communication. In some examples, the vehicle-mounted communication device 121 can also communicate with a wireless local area network (WLAN) using WiFi. In some embodiments, the vehicle-mounted communication device 121 can also communicate directly with the device using an infrared link, Bluetooth or ZigBee. In some examples, the vehicle-mounted communication device 121 can also communicate with the device using other wireless protocols.

[0044] Radar 122 is used to sense objects in the surrounding environment of the vehicle, and can also be used to sense the speed and / or direction of these objects. In some examples, radar 122 can use electromagnetic waves or lasers as a medium to detect objects based on time of flight (TOF) or phase-shift methods, and detect the position of the detected object, the distance to the detected object, and the relative speed. In some examples, in order to be able to detect objects located in front of, behind, or to the side of the vehicle, radar 122 can be configured at an appropriate position outside the vehicle.

[0045] The laser rangefinder 123 may utilize laser light to sense objects in the environment in which the host vehicle is located. In some embodiments, the laser rangefinder 123 may include one or more laser sources, a laser scanner, and one or more detectors, among other system components.

[0046] The camera 124 can be used to capture multiple images of the surrounding environment of the vehicle. The camera 124 can be a static camera or a video camera. In some examples, in order to obtain the external image of the vehicle, the camera 124 can be located at an appropriate position outside the vehicle. For example, in order to obtain the image in front of the vehicle, the camera 124 can be configured in the interior of the vehicle close to the front windshield. Alternatively, the camera 124 can be configured around the front bumper or radiator grille. In some examples, in order to obtain the image behind the vehicle, the camera 124 can be configured in the interior of the vehicle close to the rear window glass. Alternatively, the camera 124 can be configured around the rear bumper, trunk or tailgate. In some examples, in order to obtain the image of the side of the vehicle, the camera 124 can be configured in the interior of the vehicle close to at least one of the side windows. Alternatively, the camera 124 can be configured around the side mirrors, fenders or doors.

[0047] exist Figure 1 In the embodiment, the vehicle driving state detection device group 130 may include: a steering angle sensor 131 for detecting the steering angle of the vehicle, a vehicle speed sensor 132 for detecting the driving speed of the vehicle, and an acceleration sensor 133 for detecting the acceleration applied to the vehicle. In some examples, as shown in the dotted box, an inertial sensor 134 for detecting the position and orientation change of the vehicle based on inertial acceleration may also be included. The inertial sensor 134 may be a combination of the acceleration sensor 133 and a gyroscope in a specific implementation process.

[0048] exist Figure 1 In the embodiment, the data processing unit 140 can be implemented as a computing system having a memory, a processor, an input / output interface, and a bus connected to these. In some examples, the data processing unit 140 causes the processor to execute multiple commands through program instructions stored in the memory to process the data obtained by the navigation subsystem 110, the environment detection device group 120, and the vehicle driving state detection device group 130. In some examples, the data processing unit 140 can also partially or completely control the driving of the vehicle based on the processed data.

[0049] exist Figure 1 The display control unit 150 is used to control multiple display units 160. The display control unit 150 can be used to transmit images to the display unit for display. The display unit 160 can be a display screen, projection equipment, etc. inside the vehicle, or it can be a display screen of a HUD display device in the vehicle, such as a windshield.

[0050] exist Figure 1In the embodiment, the data processing unit 140, the display control unit 150 and the display unit 160 can serve as the main body of the head-up display (HUD) device. The display control unit 150 can process the received data processed by the data processing unit 140, or after receiving the data obtained by the navigation subsystem 110, the environment detection device group 120 and the vehicle driving state detection device group 130, to obtain display information to be displayed, and project the display information onto the windshield of the vehicle through the display unit 160 for display.

[0051] The Head Up Display (HUD) device projects the light of the display image output by the image source onto an imaging window (e.g., an imaging board, a windshield, etc.) through, for example, a reflective optical design, so as to display vehicle status information such as vehicle speed and fuel level, as well as indication information such as navigation and hazard warnings, at an appropriate position in front of the driver. This allows the driver to obtain relevant information such as vehicle speed and fuel level without shifting his line of sight away from the road ahead, thereby improving the driving safety factor and driving experience.

[0052] Specifically, refer to Figure 2 and Figure 3 The head-up display device can be arranged on a vehicle, and the vehicle includes a windshield 204 located at the front of the vehicle. The driver and passengers in the vehicle cabin 208 can see the front of the vehicle through the windshield 204.

[0053] exist Figure 3 In the embodiment of the present invention, the windshield 204 is visually located above the vehicle dashboard 206. The driver can turn the steering wheel 210 in the passenger cabin 208 to steer the vehicle, such as changing lanes, merging and parking the vehicle. In some embodiments, the steering wheel 210 can be retracted or omitted.

[0054] Reference Figure 4 , the display unit 160 may include Figure 2 and Figure 3 The display area corresponding to the HUD shown, wherein the HUD may include a panoramic head-up display (PHUD, Panorama-Head-up-Display) device, and its display area may include a portion of the windshield between the two A-pillars of the vehicle. Specifically, it may be the windshield at a preset distance close to the side of the center console. The preset distance may be 20 cm, 30 cm, etc. The specific value may be customized based on user needs and is not specifically limited in this example implementation.

[0055] The display unit 160 may also include display areas corresponding to other parts in the vehicle. The display area may be an area where images are projected by a projection device, or a display device, such as an LCD display screen, an LED display screen, etc. Specifically, it may be arranged in the center of the vehicle's central control console, or on both sides of the rear seats, behind the driver's seat and the co-pilot seat, etc., which is not specifically limited in this example implementation.

[0056] The screen of a vehicle is generally used as an information display device of a multimedia control system, which can display basic information such as audio and video, and is controlled by an intelligent cockpit controller. When adjusting the interior atmosphere of a vehicle, the display control unit 150 in the related art usually adopts a static color change, that is, a fixed color expression rule is set to adjust the atmosphere in the vehicle, and the consistency of the vehicle atmosphere to the vehicle display content is not considered, and the intelligent control of the vehicle atmosphere adjustment system is low.

[0057] It should be noted that the vehicle atmosphere adjustment system may include an atmosphere display area and atmosphere lights. The atmosphere display area may include a specific area in the display screen, including but not limited to the edge areas of all display screens of the vehicle, and other areas of the HUD display area in addition to displaying the original display content, and may also include areas in the vehicle dashboard where the vehicle driving information is not displayed.

[0058] In some examples, the display area in the vehicle may include a content display area 42 and an atmosphere display area 41. Figure 4 , the content display area 42 can be used to display vehicle information, navigation information and other content, and the atmosphere display area 41 is used to display the display graphics obtained by the display control method of the present disclosure. Specifically, the atmosphere display area 41 can be a display area at a preset distance from the edge of the display screen, wherein the preset distance can be 3 cm, 3.5 cm, etc., and can also be customized based on user needs, which is not specifically limited in this example implementation.

[0059] In some examples, the atmosphere display area 41 and the content display area 42 can be different display screens. For example, the HUD display area and the display screen set on the center console of the vehicle can be used as the content display area, and the display area of ​​the display screen at other locations of the vehicle can be used as the atmosphere display area 41. No specific limitation is made in this example implementation.

[0060] Based on this, the present disclosure first provides a display control method. Figure 5 The flowchart of the display control method is shown, which can be applied to the display control unit 150, wherein the display control method may include steps S510 to S520.

[0061] In step S510, color information corresponding to the target display image is obtained.

[0062] In some example implementations of the present disclosure, the display control unit 150 may obtain color information of a target display image. Specifically, it may obtain video data, use each frame of the video data as the target display image, and obtain color information corresponding to the target display image.

[0063] The target display image may be a frame of video data such as a movie, TV program, or live sports event, or an image in a map displayed in a vehicle navigation system, which may include different color codes to distinguish geographical features such as roads, waters, and green spaces. It may also be an image corresponding to a menu, icon, button, or other UI element in a vehicle infotainment system, which may have a specific color theme or style. The specific type can also be customized according to user needs, which will not be described in detail in this example implementation.

[0064] It should be noted that the above color information is a color represented by RGB pixel values, and the specific color is determined according to the target display image, which will not be elaborated here.

[0065] In step S520 , when displaying the target display image, the display color of the vehicle atmosphere adjustment system is controlled based on the color information.

[0066] In some example embodiments of the present disclosure, when the display control unit 150 controls the display unit to display the target display image, the display color of the vehicle atmosphere adjustment system is controlled using color information in the target display image.

[0067] The disclosed embodiment provides a display control method. By acquiring the color information of the target display image, the vehicle atmosphere adjustment system can achieve color synchronization with the image content and enhance visual consistency. By adjusting the atmosphere based on the image color information, an environmental atmosphere matching the image content can be provided for the driver and passengers, thereby enhancing the immersive experience and improving the intelligent control of the vehicle atmosphere adjustment system.

[0068] In some example embodiments, when acquiring color information of a target display image, the target display image may be acquired first. The target display image may be the current display image, the next frame image of the current display image, or other subsequent images to be displayed, which are not specifically limited in this example embodiment.

[0069] When the target display image is another subsequent image to be displayed, by obtaining the color information of the target display image in advance, the color information can be directly obtained when the target display image is displayed, without the need to extract the color information, thereby reducing the response time.

[0070] When extracting color information corresponding to the target display image, the display area corresponding to each display color in the target display image can be first determined, and the display color with a display area greater than a preset value can be used as the color information; for example, if the above-mentioned target display image includes 5 colors, namely red, yellow, green, blue and purple, a preset value of the display area can be determined, wherein the above-mentioned preset value can be determined according to the size of the above-mentioned display screen, specifically, it can be 10% of the size of the display screen, and the specific value can also be customized based on user needs.

[0071] If the display area corresponding to the red and green colors is larger than a preset value, the red and green colors are used as the color information corresponding to the target display image.

[0072] In some examples, each of the display colors may be a color corresponding to an area in a color wheel. When determining the display area corresponding to each display color, the HSV pixel value of each pixel in the target display image may be first extracted. If the target display image is an RGB image, the RGB pixel value of each pixel in the target display image may be converted into an HSV pixel value.

[0073] Specifically, a conversion formula may be used to convert RGB pixel values ​​into HSV pixel values.

[0074] Let the values ​​of (R, G, B) be real numbers between 0 and 1.

[0075] Let MAX be equal to the maximum of R, G, and B.

[0076] Let MIN be equal to the minimum of R, G, and B.

[0077] Then, the above conversion formula can be:

[0078]

[0079] V=MAX / 255

[0080] The above formula can be used to convert the RGB pixel value of the target display image into the HSV pixel value.

[0081] After obtaining the above HSV pixel values, refer to Figure 6 At least one initial pixel combination can be determined according to the hue component in the HSV pixel value, and each pixel in the initial pixel combination corresponds to a display color.

[0082] Specifically, the hue circle can be determined first according to the H value. The hue circle can include 24 groups, each group of 15 degrees, or 20 groups, each group of 18 degrees. The division method of the hue circle can be customized according to user needs and will not be repeated in this example implementation.

[0083] After getting the color wheel, refer to Figure 7 , according to the H value in HSV and the hue ring, each pixel in the target display image is divided into multiple candidate pixel combinations, that is, the group in the hue ring corresponding to each pixel is determined, and the group including the pixel is determined as the above candidate pixel combination.

[0084] For example, assuming that the target display image includes 20,000 pixels, the covered color wheel includes 322.5 degrees to 337.5 degrees, 277.5 degrees to 292.5 degrees, 217.5 degrees to 232.5 degrees, 202.5 degrees to 217.5 degrees, 97.5 degrees to 112.5 degrees, and 37.5 degrees to 52.5 degrees.

[0085] Among them, the hue ring of 322.5 degrees to 337.5 degrees includes 5000 pixels; the hue ring of 277.5 degrees to 292.5 degrees includes 5000 pixels; the hue ring of 217.5 degrees to 232.5 degrees includes 6000 pixels; the hue ring of 202.5 degrees to 217.5 degrees includes 4000 pixels; the hue ring of 97.5 degrees to 112.5 degrees includes 3000 pixels; the hue ring of 37.5 degrees to 52.5 degrees includes 2000 pixels. At this time, the hue ring involved includes 5 areas, and 5 candidate pixel combinations can be included. In some examples, the number of candidate pixel points in the candidate pixel combination can be used to characterize the display area corresponding to each display color, and the candidate pixel combination with a display area greater than a preset value can be used as the initial pixel combination. For example, the preset value corresponding to the above display area can be represented by the number of pixels. Assuming that the preset value of the display area is 3500 pixels, 4 initial pixel combinations can be determined from the above candidate pixel combinations.

[0086] In some example implementations, the candidate priority of the candidate pixel combination may also be determined according to the number of pixels in the candidate pixel combination. Specifically, a candidate pixel combination having more pixels has a higher candidate priority.

[0087] In some examples, a preset number of initial pixel combinations to be determined may be set, and then a preset number of candidate pixel combinations with higher priority may be used as the initial pixel combinations. The preset number may be a positive integer such as 3 or 4, and the specific value may be customized according to user needs, which will not be described in detail in this example.

[0088] For example, assuming that the above preset number is 3, the candidate pixel combination corresponding to the hue circle of 217.5 degrees to 232.5 degrees, the candidate pixel combination corresponding to the hue circle of 202.5 degrees to 217.5 degrees, and the candidate pixel combination corresponding to the hue circle of 277.5 degrees to 292.5 degrees are used as the above initial pixel combination.

[0089] In some examples, the brightness information and saturation information in the target display image can be used to update the display area. Specifically, pixels whose brightness information is not within the set brightness range can be deleted, and pixels whose saturation information is not within the set saturation range can be deleted to update the display area.

[0090] It should be noted that when the number of pixels in the initial pixel combination is used to represent the display area, the pixels in the initial pixel combination can be screened based on the brightness information and saturation information of the pixels in the initial pixel combination. The initial pixel combination after the pixel selection is used as the target pixel combination, and the number of pixels in the target pixel combination is used to represent the updated display area.

[0091] Specifically, after the initial pixel combination is obtained, the pixel points in the initial pixel combination may be screened based on the saturation component and the brightness component in the HSV pixel value to obtain the target pixel combination.

[0092] Specifically, the saturation S of each pixel in the initial pixel combination is first determined, and then the pixels in the initial pixel combination are screened according to the saturation S. Specifically, a saturation threshold can be set to delete pixels that are not within the saturation threshold.

[0093] For example, refer to Figure 8 , the saturation can be divided into 10 levels, namely 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9 and 1. The saturation division can also be customized according to user needs, which is not described in detail in this example implementation. The saturation threshold can be greater than 0.5 and less than or equal to 0.9.

[0094] Similarly, refer to Figure 8 First, the brightness V of each pixel in the initial pixel combination is determined, and then the pixel in the initial pixel combination is screened according to the brightness V. Specifically, a brightness threshold can be set to screen the pixel in the above initial pixel combination. For example, the brightness can be 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9 and 1 respectively. The brightness division can also be customized according to user needs, which is not described in detail in this example implementation. The brightness threshold can also be greater than 0.5 and less than or equal to 0.9.

[0095] After the pixel points in the initial pixel combination are screened based on the brightness and saturation, the target pixel combination is obtained.

[0096] Reference Fig. 9 After obtaining the above target pixel combinations, the RGB pixel value of each pixel in each target pixel combination can be obtained, and then the average value of the RGB pixel values ​​of all the pixels in the target pixel combination is used as the color information corresponding to the target pixel combination.

[0097] It should be noted that each target pixel combination corresponds to a piece of color information, that is, the number of target pixel combinations and color information is the same.

[0098] In some examples, when the target display image is not the first frame image, the similarity between the target display image and the previous frame image can be determined. When the similarity is greater than a preset value, the color information of the previous frame image can be used as the color information of the target display image, wherein the preset value can be 90%, 95%, etc. The specific value can be customized based on the user's requirements for accuracy, which is not elaborated in this example implementation.

[0099] In some examples, the number of pixels in each target pixel combination may be obtained, and the ratio of the number of pixels in each target pixel combination may be determined, and the proportion of display colors in the atmosphere control system may be determined based on the ratio.

[0100] After obtaining the above-mentioned target pixel combination, that is, determining the number of pixels in the above-mentioned target pixel combination, the proportional relationship of the display area corresponding to the above-mentioned color information can be determined, that is, the proportional relationship of the number of pixels in the above-mentioned target pixel combination, and then the display color of the vehicle atmosphere adjustment system can be controlled according to the color information and the proportional relationship.

[0101] For example, if the above-mentioned target pixel combinations include three, namely A, B, and C, and the ratio of the number of pixels in the three target pixel combinations is 3:2:1, if the color corresponding to A is red, the color corresponding to B is blue, and the color corresponding to C is purple, then when controlling the display color in the atmosphere adjustment system, the ratio of the display color is red: blue: purple, which is equal to 3:2:1.

[0102] This embodiment can accurately identify and quantify the color components in the image by extracting the HSV value of each pixel in the image, thereby providing an accurate data basis for subsequent color processing and atmosphere adjustment.

[0103] In some examples, it is also possible to determine whether the vehicle is playing audio data. If not, a default display graphic can be displayed on the display screen when controlling the display color of the vehicle atmosphere adjustment system. At the same time, the color of the atmosphere light in the vehicle atmosphere adjustment system can also be adjusted according to the above display color.

[0104] In some examples, the default display image may be a waveform such as a sine wave, a wave shape, a rectangle, etc. Taking a rectangle as an example, when there is no audio data, the display graphic may be as follows: Fig.10 As shown, the specific shape of the displayed graphics can also be customized according to user needs, which will not be described in detail in this example implementation.

[0105] In some examples, if the vehicle is playing audio data, the sound type of the audio data can be determined first, where the sound type includes but is not limited to music, game background, film and television, etc. The specific sound type can be adjusted based on demand and will not be elaborated here.

[0106] It should be noted that when the sound type of audio data is identified, a machine learning model can be used to implement it. Specifically, an audio data classification model can be used to determine the sound type of the above audio data.

[0107] Optionally, the above-mentioned audio data classification model is obtained through training, and the audio data classification model is mainly a neural network model based on deep learning. For example, the audio data classification model can be based on a feedforward neural network. The feedforward network can be implemented as an acyclic graph, in which nodes are arranged in layers. Generally, the feedforward network topology includes an input layer and an output layer, and the input layer and the output layer are separated by at least one hidden layer. The hidden layer transforms the input received by the input layer into a representation useful for generating output in the output layer. The network nodes are fully connected to the nodes in the adjacent layers via edges, but there are no edges between the nodes in each layer. The data received at the nodes of the input layer of the feedforward network are propagated (i.e., "feedforward") to the nodes of the output layer via an activation function, and the activation function calculates the state of the nodes of each continuous layer in the network based on coefficients ("weights"), and the coefficients are respectively associated with each of the edges connecting these layers. The output of the audio data classification model can take various forms, and the present disclosure is not limited to this. The audio data classification model may also include other neural network models, such as a convolutional neural network (CNN) model, a recurrent neural network (RNN) model, and a generative adversarial network (GAN) model, but is not limited thereto. Other neural network models known to those skilled in the art may also be used.

[0108] The corresponding sample data may be first obtained, and then the audio data classification model may be trained using the sample data, which may specifically include the following steps: selecting a network topology; using a set of training data representing the problem being modeled by the network; and adjusting the weights until the network model exhibits the minimum error for all instances of the training data set. For example, during a supervised learning training process for a neural network, the output generated by the network in response to an input representing an instance in the training data set is compared with the "correct" labeled output of the instance; an error signal representing the difference between the output and the labeled output is calculated; and when the error signal is propagated backward through the layers of the network, the weights associated with the connection are adjusted to minimize the error. The model when the error of each output generated from an instance of the training data set is minimized is defined as an audio data classification model.

[0109] After determining the sound type corresponding to the audio data, the display graphic may be determined according to the sound type. Specifically, the display element in the display image may be determined. For example, referring to Fig.11 When the sound type is music, the display element can be multiple rectangles arranged in a certain pattern. When the sound type is game background music, the display element can be multiple superimposed triangles. When the sound type is film and television vocals, the display element can be an irregular image composed of smooth curves and straight lines. The specific correspondence can also be set according to user needs, which will not be elaborated here.

[0110] It should be noted that the mapping relationship between the sound type and the reality element is preset and exists in the storage space that can be located by the display control unit.

[0111] In some examples, the frequency and amplitude of the audio data may also be determined, and then the display area and arrangement of the display elements in the ambience display area may be determined based on the frequency and amplitude.

[0112] Specifically, the frequency of the audio data is positively correlated with the arrangement density of the display elements in the arrangement mode, and the amplitude of the audio data may be positively correlated with the display area of ​​the display elements.

[0113] Reference Fig.12 When the frequency of the audio increases, the number of display elements in the display image increases, that is, the display density of the display elements increases. Fig.13 When the amplitude in the above audio data becomes larger, the display area of ​​the above display element becomes larger, specifically, the display height becomes higher.

[0114] In some examples, when controlling the display graphics of the atmosphere adjustment system according to the audio data, the atmosphere display area may be divided into N+1 segments. Fig.14The atmosphere display area can be divided into N+1 segments in chronological order, which can specifically include the current time T, T-1 seconds, T-2 seconds, T-3 seconds, T-4 seconds, ..., TN seconds, and the display graphics of different atmosphere display areas can be controlled according to the audio data at different times.

[0115] For example, refer to Fig.15 , the frequencies of the audio data at different times are different, so the arrangement density between the display elements in the display graphics displayed at different times is also different. Fig.16 The amplitude of the audio data at different times is different, so the display area of ​​the display image in the corresponding atmosphere display area at different times is also different.

[0116] In some examples, reference Fig.17 As shown, after obtaining the display graphic, the display graphic can be rendered based on the color information obtained above. Specifically, the display graphic can be rendered according to the color ratio, and the display graphic can be rendered along the first direction according to the color ratio. The first direction can be a direction parallel to the border of the display area, or a direction set by the user according to preference. In some examples, the user can modify the first direction through the graphical user interface. The first direction is not specifically limited in this example implementation.

[0117] In some examples, when the vehicle atmosphere adjustment system includes a plurality of continuous atmosphere display areas, referring to Fig.18 As shown, the same display element can be displayed in each of the above-mentioned areas, and the display areas and arrangement methods of the multiple display elements in the multiple atmosphere display areas are the same.

[0118] In some example embodiments, reference Fig.19 As shown, the display area and arrangement of the display elements in the multiple atmosphere display areas can be determined according to the display areas in the multiple atmosphere display areas. It can be understood that multiple continuous atmosphere display areas are displayed as the same complete atmosphere display area, that is, when the atmosphere display area is divided, the multiple continuous atmosphere display areas are divided into N+1 segments as one atmosphere display area.

[0119] Refer to the following Fig. 20 The above display control method is described. Specifically, the above display control method may include steps S2001 to S2011.

[0120] In step S2001, it is determined whether multimedia is turned on.

[0121] If yes, then step S2002 and step S2003 are executed. If no, then the atmosphere effect is not displayed.

[0122] In step S2002, it is determined whether the multimedia includes video data.

[0123] If yes, execute step S2004, if no, display the default color.

[0124] In step S2004, the HSV pixel value of each pixel in the target display image in the video data is extracted.

[0125] In step S2005, at least one group of initial pixel combinations is determined according to the hue component in the HSV pixel value.

[0126] In step S2006, the pixel points in the initial pixel combination are screened based on the saturation component and the brightness component in the HSV pixel value to obtain the target pixel combination.

[0127] In step S2007, the RGB pixel value of each pixel in the target pixel combination is obtained.

[0128] In step S2008, the average value of the RGB pixel values ​​of all pixels in the target pixel combination is taken as the color information.

[0129] In step S2009, the display color of the vehicle atmosphere adjustment system is controlled based on the color information.

[0130] In step S2003, it is determined whether the multimedia includes audio data.

[0131] If yes, then step S2010 and step S2011 are executed. If no, then a default graphic is displayed.

[0132] In step S2012, the sound type of the audio data is obtained.

[0133] In step S2013, the display elements in the display graphics are determined according to the sound type.

[0134] In step S2014, the frequency and amplitude of the audio data are acquired.

[0135] In step S2015, the arrangement of display elements is determined according to the frequency;

[0136] In step S2016, the display area of ​​the display element is determined according to the amplitude.

[0137] In step S2017, the display graphics of the vehicle atmosphere adjustment system are controlled according to the display elements, arrangement and display area.

[0138] It should be noted that the specific details in step S2001 to step S2017 have been described in detail above, so they will not be repeated here.

[0139] The disclosed embodiment provides a display control method. By acquiring the color information of the target display image, the vehicle atmosphere adjustment system can achieve color synchronization with the image content and enhance visual consistency. By adjusting the atmosphere based on the image color information, the driver and passengers can be provided with an environmental atmosphere that matches the image content, thereby enhancing the immersive experience and improving the intelligent control of the vehicle atmosphere adjustment system. Further, the display graphics are controlled based on audio data, and the display elements are dynamically adjusted by the sound type, frequency and amplitude, so that the vehicle atmosphere is synchronized with the music rhythm, providing a richer audio-visual experience. According to the frequency and amplitude of the audio data, the display area and arrangement of the display elements are dynamically adjusted to make the display effect more vivid and varied. By acquiring the proportional relationship between each color information and determining the display color of the display element based on this proportional relationship, the color coordination and balance are achieved. In multiple continuous display areas, the display elements can be displayed uniformly or differentially according to the frequency and amplitude, which increases the sense of hierarchy of the visual effect. By acquiring the similarity between the target display image and the previous frame image, and using the color information of the previous frame image when the similarity is greater than the preset value, the amount of calculation is reduced and the continuity of the display is maintained.

[0140] Furthermore, the present disclosure also provides a display control device, referring to Fig.21 As shown, the display control device 2100 may include an acquisition module 2110 and a display module 2120. Among them:

[0141] The acquisition module 2110 may be used to acquire color information corresponding to a target display image.

[0142] The display module 2120 may be configured to control the display color of the vehicle atmosphere adjustment system based on the color information when displaying the target display image.

[0143] In some examples, the acquisition module 2110 may also be used to determine the display area corresponding to each display color in the target display image, and use the display color with a display area greater than a preset value as color information.

[0144] In some examples, the acquisition module 2110 may also be used to acquire brightness information and saturation information of the target display image, and update the display area according to the brightness information and the saturation information.

[0145] In some examples, the acquisition module 2110 can also be used to delete pixel points whose brightness information is not within a set brightness range, and delete pixel points whose saturation information is not within a set saturation range, so as to update the display area.

[0146] In some examples, the display module 2120 may also be used to determine the display area of ​​each color information in the target display image and determine the proportional relationship between the display areas;

[0147] The display color of the vehicle atmosphere adjustment system is controlled according to the color information based on the proportional relationship.

[0148] In some examples, the display module 2120 may also be used to control display graphics of a vehicle ambience adjustment system based on the audio data.

[0149] In some examples, the display module 2120 may also be used to determine the sound type of the audio data; and determine the display elements in the display graphics according to the sound type.

[0150] In some examples, the display module 2120 may also be used to determine the frequency and amplitude of the audio data; and determine the display area and arrangement of the display elements in the display region according to the frequency and amplitude.

[0151] In some examples, the display module 2120 may also be used to obtain a proportional relationship between each piece of color information, and determine a display color of a display element based on the proportional relationship and the color information.

[0152] In some examples, the display module 2120 may also be used to render the color of the display element along the first direction based on the color information and the proportional relationship to determine the display color of the display element.

[0153] In some examples, the vehicle atmosphere adjustment system includes multiple continuous display areas, and the display module 2120 can also be used to display the same display elements in each display area, and the display area and arrangement of each display element in the multiple display areas are the same.

[0154] In some examples, the vehicle atmosphere adjustment system includes multiple continuous display areas, and the display module 2120 can also be used to determine the display area and arrangement of display elements based on the frequency and amplitude, including: determining the display area and arrangement of display elements in multiple display areas based on the frequency and amplitude according to the total display area of ​​the multiple display areas.

[0155] In some examples, the acquisition module 2110 can also be used to obtain the similarity between the previous frame image of the target display image and the target display image; when the similarity is greater than a preset value, the color information of the previous frame image of the target display image is used as the color information of the target display image.

[0156] It should be understood that the above-mentioned device embodiments are only illustrative, and the device of the present disclosure can also be implemented in other ways. For example, the division of units / modules in the above-mentioned embodiments is only a logical function division, and there may be other division methods in actual implementation. For example, multiple units, modules or components can be combined, or can be integrated into another system, or some features can be ignored or not executed.

[0157] In addition, unless otherwise specified, each functional unit / module in each embodiment of the present disclosure may be integrated into one unit / module, or each unit / module may exist physically separately, or two or more units / modules may be integrated together. The above-mentioned integrated unit / module may be implemented in the form of hardware or in the form of a software program module.

[0158] If the integrated unit / module is implemented in the form of hardware, the hardware may be a digital circuit, an analog circuit, etc. The physical implementation of the hardware structure includes but is not limited to transistors, memristors, etc. If not specifically stated, the processor may be any appropriate hardware processor, such as a CPU, a GPU, an FPGA, a DSP, an ASIC, etc. If not specifically stated, the storage unit may be any appropriate magnetic storage medium or magneto-optical storage medium, such as a resistive random access memory RRAM (Resistive Random Access Memory), a dynamic random access memory DRAM (Dynamic Random Access Memory), a static random access memory SRAM (Static Random-Access Memory), an enhanced dynamic random access memory EDRAM (Enhanced Dynamic Random Access Memory), a high-bandwidth memory HBM (High-Bandwidth Memory), a hybrid memory cube HMC (Hybrid Memory Cube), etc.

[0159] If the integrated unit / module is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a memory and includes several instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the various embodiments of the present disclosure. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk, etc. Various media that can store program codes.

[0160] Please refer to Fig. 22, which shows a structural block diagram of a display control device provided by an exemplary embodiment of the present disclosure. In some examples, the display control device can be at least one of a smart phone, a smart watch, a desktop computer, a laptop, a virtual reality terminal, an augmented reality terminal, a wireless terminal, and a laptop portable computer. The display control device has a communication function and can access a wired network or a wireless network. The display control device may generally refer to one of a plurality of terminals, and those skilled in the art may know that the number of the above terminals may be more or less. It can be understood that the display control device undertakes the calculation and processing work of the technical solution of the present disclosure, and the embodiments of the present disclosure are not limited to this.

[0161] like Fig. 22 As shown, the display control device 2200 may include: at least one processor 2210 , a memory 2220 , and a communication interface 2230 .

[0162] The memory 2220 is used to store programs. Specifically, the programs may include program codes, and the program codes include computer operation instructions.

[0163] The memory 2220 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0164] The processor 2210 is used to execute the computer-executable instructions stored in the memory 2220 to implement the display control method described in the above method embodiment. The processor 2210 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present disclosure.

[0165] The display control device 2200 may also include a communication interface 2230, so that it can communicate and interact with external devices through the communication interface 2230. In a specific implementation, if the communication interface 2230, the memory 2220 and the processor 2210 are implemented independently, the communication interface 2230, the memory 2220 and the processor 2210 can be connected to each other through a bus and complete the communication between each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc., but it does not mean that there is only one bus or one type of bus.

[0166] Optionally, in a specific implementation, if the communication interface 2230, the memory 2220 and the processor 2210 are integrated on a chip, the communication interface 2230, the memory 2220 and the processor 2210 can complete communication through an internal interface.

[0167] The present disclosure also provides a computer-readable storage medium, which may include: a U disk, a mobile hard disk, a read-only memory, a random access memory, a disk or an optical disk, and other media that can store program codes. Specifically, the computer-readable storage medium stores program instructions, and the program instructions are used for the display control method in the above-mentioned embodiment.

[0168] An embodiment of the present disclosure also provides a computer program product, which includes computer instructions, which are stored in a computer-readable storage medium; a processor of a display control device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the display control device executes to implement the display control methods of the above-mentioned embodiments.

[0169] Those skilled in the art should be aware that in one or more of the above examples, the functions described in the embodiments of the present disclosure can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. Storage media can be any available media that can be accessed by general or special-purpose computers.

[0170] In the above embodiments, the description of each embodiment has its own emphasis. For the part not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0171] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the inventions claimed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not claimed in the present disclosure.

[0172] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A display control method, characterized in that: include: Get the color information corresponding to the target display image; When displaying the target display image, controlling the display color of the vehicle atmosphere adjustment system based on the color information; controlling a display graphic of the vehicle atmosphere adjustment system according to the audio data; Wherein, controlling the display graphics of the vehicle atmosphere adjustment system according to the audio data includes: controlling display elements in a display graphic of the vehicle atmosphere adjustment system according to a sound type of the audio data; Determining the display density of the display elements in the display graphics according to the frequency of the audio data; Determining a display area of ​​a display element in the display image according to the amplitude of the audio data; Wherein, when displaying the target display image, controlling the display color of the vehicle atmosphere adjustment system based on the color information includes: Acquire a proportional relationship between display areas of each piece of color information, and determine a display color of the display element based on the proportional relationship and the color information; The vehicle atmosphere adjustment system includes a plurality of continuous display areas; the same display element is displayed in each display area, and the display area and arrangement of the display elements in the plurality of display areas are the same; or According to the total display area of ​​the multiple display areas, the display area and arrangement of the display elements in the multiple display areas are determined based on the frequency, amplitude and total display area.

2. The display control method according to claim 1, characterized in that: The step of obtaining color information corresponding to the target display image includes: The display area corresponding to each display color in the target display image is determined, and the display color having a display area greater than a preset value is used as the color information.

3. The display control method according to claim 2, characterized in that: Before using the display color whose display area is larger than the preset value as the color information, the method further includes: The brightness information and the saturation information of the target display image are acquired, and the display area is updated according to the brightness information and the saturation information.

4. The display control method according to claim 3, characterized in that: The updating of the display area according to the brightness information and the saturation information includes: Pixels whose brightness information is not within a set brightness range are deleted, and pixels whose saturation information is not within a set saturation range are deleted to update the display area.

5. The display control method according to claim 1, characterized in that: The method further comprises: Obtaining the similarity between the previous frame image of the target display image and the target display image; When the similarity is greater than a preset value, the color information of the previous frame image of the target display image is used as the color information of the target display image.

6. A display control device, characterized in that: include: An acquisition module is used to acquire color information corresponding to a target display image; a display module, which controls the display color of the vehicle atmosphere adjustment system based on the color information when displaying the target display image; controlling a display graphic of the vehicle atmosphere adjustment system according to the audio data; Wherein, controlling the display graphics of the vehicle atmosphere adjustment system according to the audio data includes: controlling display elements in a display graphic of the vehicle atmosphere adjustment system according to a sound type of the audio data; Determining the display density of the display elements in the display graphics according to the frequency of the audio data; Determining a display area of ​​a display element in the display image according to the amplitude of the audio data; Wherein, when displaying the target display image, controlling the display color of the vehicle atmosphere adjustment system based on the color information includes: Acquire a proportional relationship between display areas of each piece of color information, and determine a display color of the display element based on the proportional relationship and the color information; The vehicle atmosphere adjustment system includes a plurality of continuous display areas; the same display element is displayed in each display area, and the display area and arrangement of the display elements in the plurality of display areas are the same; or According to the total display area of ​​the multiple display areas, the display area and arrangement of the display elements in the multiple display areas are determined based on the frequency, amplitude and total display area.

7. A display control device, characterized in that: The display control device comprises: a processor and a memory; the processor is used to execute instructions stored in the memory to implement the display control method according to any one of claims 1 to 5.

8. A computer storage medium, characterized in that: The storage medium stores at least one instruction, and the at least one instruction is used to be executed by a processor to implement the display control method according to any one of claims 1 to 5.

Images