Display control method and apparatus, and computer storage medium

Abstract

The present disclosure relates to the technical field of vehicle control. Provided are a display control method and apparatus, and a computer storage medium. The display control method may comprise: acquiring color information corresponding to a target display image; and when the target display image is displayed, controlling the display color of a vehicle atmosphere adjustment system on the basis of the color information. The technical solution provided in the present disclosure can provide to drivers and passengers an environmental atmosphere which matches image content, thereby improving the immersive experience and the degree of intelligence for controlling a vehicle atmosphere adjustment system.

Description

A display control method, device, and computer storage medium Cross-reference of related solutions

[0001] This disclosure claims priority to Chinese Patent Application No. 202410908848.8, filed on July 8, 2024, entitled “A Display Control Method, Apparatus and Computer Storage Medium”, the contents of which are incorporated herein by reference. Technical Field

[0002] This disclosure relates to the field of vehicle control technology, and in particular to a display control method, device, and computer storage medium. Background Technology

[0003] In modern automotive technology, creating a pleasant in-car atmosphere has become a crucial aspect of enhancing the driving and riding experience. With the rapid development of in-vehicle infotainment systems and continuous advancements in in-vehicle display technology, users are provided with a rich visual experience. However, existing display control technologies primarily focus on displaying images and information, and are still insufficient for dynamically adjusting and personalizing the in-vehicle atmosphere.

[0004] Traditional in-car ambient lighting systems typically use preset color modes, lacking real-time interaction with the displayed content. When users watch videos, check navigation, or engage in other visual interactions inside the car, the fixed lighting colors cannot provide an ambiance that matches the content, limiting the user's immersion and personalization needs.

[0005] In addition, some existing technologies attempt to adjust ambient lighting through simple ambient light sensing or manual user settings, but these methods cannot achieve true intelligent ambient control and have a low level of intelligence. Summary of the Invention

[0006] This disclosure aims to provide a display control method, apparatus, and computer storage medium; which can solve the technical problem of low intelligence level in existing atmosphere control systems.

[0007] The technical solution of this disclosure embodiment is implemented as follows:

[0008] In a first aspect, embodiments of this disclosure provide a display control method, characterized in that it includes:

[0009] Obtain the color information corresponding to the target display image;

[0010] When displaying the target image, the display color of the vehicle ambient adjustment system is controlled based on the color information.

[0011] Secondly, embodiments of this disclosure provide a display control device, including:

[0012] The acquisition module acquires the color information corresponding to the target display image;

[0013] The display module controls the display color of the vehicle ambient lighting system based on the color information when displaying the target display image.

[0014] Thirdly, embodiments of this disclosure provide a display control device, the display control device comprising: a processor and a memory; the processor is configured to execute instructions stored in the memory to implement the display control method described in the first aspect.

[0015] Fourthly, embodiments of this disclosure provide a computer storage medium storing at least one instruction, which is executed by a processor to implement the display control method as described in the first aspect.

[0016] This disclosure provides a display control method, apparatus, and computer storage medium. By acquiring the color information of the target display image, the vehicle atmosphere adjustment system can achieve color synchronization with the image content, enhancing visual consistency. Adjusting the atmosphere based on image color information can provide drivers and passengers with an environmental atmosphere that matches the image content, thereby enhancing the immersive experience and improving the intelligence of the vehicle atmosphere adjustment system control. Brief description of the attached figures

[0017] To more clearly illustrate the technical solutions in the embodiments of this disclosure, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 is a schematic diagram of the composition of an in-vehicle system provided in an embodiment of this disclosure.

[0019] Figure 2 is an exemplary top view of the vehicle provided in this disclosure.

[0020] Figure 3 is an exemplary perspective view of a vehicle driver's seat provided in this disclosure.

[0021] Figure 4 is an example diagram of the display area in an atmosphere adjustment system provided in an embodiment of this disclosure.

[0022] Figure 5 is a flowchart of a display control method provided in an embodiment of this disclosure.

[0023] Figure 6 is a schematic diagram of a color wheel provided in an embodiment of this disclosure.

[0024] Figure 7 is a schematic diagram of a candidate pixel combination displayed in a graphical user interface according to an embodiment of this disclosure.

[0025] Figure 8 is a schematic diagram of a pixel filtering rule provided in an embodiment of this disclosure.

[0026] Figure 9 is a schematic diagram illustrating a target pixel combination provided in an embodiment of this disclosure.

[0027] Figure 10 is a schematic diagram of a default display mode provided in an embodiment of this disclosure.

[0028] Figure 11 is a schematic diagram of the mapping relationship between sound type and display element provided in an embodiment of this disclosure.

[0029] Figure 12 is a schematic diagram illustrating the effect of frequency on display according to an embodiment of this disclosure.

[0030] Figure 13 is a schematic diagram illustrating the effect of amplitude on display according to an embodiment of this disclosure.

[0031] Figure 14 is a schematic diagram of a display graphic provided in an embodiment of this disclosure.

[0032] Figure 15 is a schematic diagram illustrating the effect of another frequency on the display according to an embodiment of this disclosure.

[0033] Figure 16 is a schematic diagram illustrating the effect of another amplitude on the display provided in an embodiment of this disclosure.

[0034] Figure 17 is a schematic diagram of a color display provided in an embodiment of this disclosure.

[0035] Figure 18 is a schematic diagram of a display on a continuous screen provided by an embodiment of this disclosure.

[0036] Figure 19 is a schematic diagram of another display on a continuous screen provided by an embodiment of this disclosure.

[0037] Figure 20 is a schematic diagram of another display control method provided in an embodiment of this disclosure.

[0038] Figure 21 is a schematic diagram of the structure of a display control device provided in an embodiment of this disclosure.

[0039] Figure 22 is a schematic diagram of the structure of a display control device provided in an embodiment of this disclosure.

[0040] The accompanying drawings have illustrated specific embodiments of this disclosure, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concepts of this disclosure to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0041] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0042] As shown in Figure 1, the vehicle system 100 includes: a navigation subsystem 110, an environmental detection device group 120 for acquiring the vehicle's environment during vehicle operation, a vehicle driving status detection device group 130, a data processing unit 140, a display control unit 150, and a display unit 160. These components or device groups are coupled together via a communication bus 12. In some examples, the communication bus 12 is used for communication between these components or device groups. It should be noted that Figure 1 only shows a portion of the vehicle system 100, and not all of its components.

[0043] In Figure 1, the navigation subsystem 110 includes a positioning device 111 and a map information storage device 112. The positioning device 111 can determine the vehicle's location based on various positioning systems, including the Global Positioning System (GPS), China's BeiDou system, Russia's GLONASS system, Europe's Galileo system, Japan's Quasi-Zenith Satellite System (QZSS), and India's Indian Regional Navigation Satellite System (IRNSS), thus obtaining the vehicle's location information. The map information storage device 112 stores map information and can retrieve a navigation path to the destination based on the location information obtained from the positioning device 111, displaying the location information and navigation path in a map application.

[0044] In Figure 1, the environmental monitoring equipment group 120 may include an in-vehicle communication device 121, a radar 122, a laser rangefinder 123, and a camera 124. These devices are capable of acquiring environmental data representing the surrounding environment of the vehicle.

[0045] The vehicle-mounted communication device 121 can wirelessly communicate with one or more devices, either directly or via a communication network. These devices can communicate with the vehicle-mounted communication device 121, including other vehicles, roadside vehicles or roadside stations, and mobile terminal devices used by occupants of the vehicle. In some examples, the vehicle-mounted communication device 121 can use 3G cellular communication, such as code division multiple access (CDMA), EVDO, Global System for Mobile Communications (GSM) / General Packet Radio Service (GPRS), or 4G cellular communication, such as long term evolution (LTE), or 5G cellular communication. In some examples, the vehicle-mounted communication device 121 can also communicate using WiFi and a wireless local area network (WLAN). In some embodiments, the vehicle-mounted communication device 121 can also communicate directly with devices using an infrared link, Bluetooth, or ZigBee. In some examples, the vehicle-mounted communication device 121 can also communicate with devices using other wireless protocols.

[0046] Radar 122 is used to sense objects in the vehicle's surrounding environment, and can also be used to sense the speed and / or direction of travel of these objects. In some examples, radar 122 can use electromagnetic waves or lasers as a medium to detect objects based on time-of-flight (TOF) or phase-shift methods, and detect the position of the detected object, the distance to the detected object, and the relative speed. In some examples, in order to detect objects located in front of, behind, or to the side of the vehicle, radar 122 can be configured at an appropriate location outside the vehicle.

[0047] The laser rangefinder 123 can use lasers to sense objects in the environment in which the vehicle is located. In some embodiments, the laser rangefinder 123 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components.

[0048] Camera 124 can be used to capture multiple images of the vehicle's surrounding environment. Camera 124 can be a still camera or a video camera. In some examples, to acquire images of the vehicle's exterior, camera 124 can be positioned appropriately outside the vehicle. For example, to acquire images of the front of the vehicle, camera 124 can be positioned inside the vehicle's interior close to the windshield. Alternatively, camera 124 can be positioned around the front bumper or radiator grille. In some examples, to acquire images of the rear of the vehicle, camera 124 can be positioned inside the vehicle's interior close to the rear window. Alternatively, camera 124 can be positioned around the rear bumper, trunk, or tailgate. In some examples, to acquire images of the sides of the vehicle, camera 124 can be positioned inside the vehicle's interior close to at least one of the side windows. Alternatively, camera 124 can be positioned around a side mirror, fender, or door.

[0049] In Figure 1, the vehicle driving state detection device group 130 may include: a steering angle sensor 131 for detecting the vehicle's steering angle, a vehicle speed sensor 132 for detecting the vehicle's speed, and an acceleration sensor 133 for detecting the acceleration applied to the vehicle. In some examples, as shown in the dashed box, it may also include an inertial sensor 134 for detecting changes in the vehicle's position and orientation based on inertial acceleration. In specific implementations, the inertial sensor 134 may be a combination of the acceleration sensor 133 and a gyroscope.

[0050] In Figure 1, the data processing unit 140 can be implemented as a computing system including a memory, a processor, input / output interfaces, and buses connecting these components. In some examples, the data processing unit 140 causes the processor to execute multiple commands via program instructions stored in the memory to process data obtained from the navigation subsystem 110, the environmental detection device group 120, and the vehicle driving status detection device group 130. In some examples, the data processing unit 140 can also partially or completely control the driving of the vehicle based on the processed data.

[0051] In Figure 1, the display control unit 150 is used to control multiple display units 160. The display control unit 150 can transmit images to the display units for display. The display units 160 can be displays or projection devices inside the vehicle, or the display screen of a HUD display device inside the vehicle, such as the windshield.

[0052] In Figure 1, the data processing unit 140, the display control unit 150, and the display unit 160 can serve as the main body of a head-up display (HUD) device. The display control unit 150 can receive data processed by the data processing unit 140, or data obtained from the navigation subsystem 110, the environmental detection equipment group 120, and the vehicle driving status detection equipment group 130, process the received data to obtain the display information to be displayed, and then project the display information onto the windshield of the vehicle through the display unit 160 for display.

[0053] Head-up display (HUD) devices project the light from the image output from the image source onto an imaging window (e.g., an imaging panel, windshield, etc.) through reflective optical designs, to display vehicle status information such as speed and fuel level, as well as navigation and hazard warning information, at an appropriate position in front of the driver. This allows the driver to obtain relevant information such as speed and fuel level without taking their eyes off the road, thereby improving driving safety and driving experience.

[0054] Specifically, referring to Figures 2 and 3, the head-up display device can be installed on the vehicle, which includes a windshield 204 located at the front of the vehicle. The driver and passengers in the vehicle's passenger cabin 208 can see the front of the vehicle through the windshield 204.

[0055] In Figure 3, the windshield 204 is visually positioned above the vehicle's dashboard 206. The driver can turn the steering wheel 210 within the passenger cabin 208 to steer the vehicle, for example, to change lanes, merge, and park. In some embodiments, the steering wheel 210 may be retracted or omitted.

[0056] Referring to Figure 4, the display unit 160 may include the display area corresponding to the HUD shown in Figures 2 and 3. The HUD may include a panoramic head-up display (PHUD) device, and its display area may include part of the windshield between the two A-pillars of the vehicle. Specifically, it may be the windshield at a preset distance from the side near the center console. The preset distance may be 20 cm, 30 cm, etc., and the specific value may be customized based on user needs. In this example embodiment, no specific limitation is made.

[0057] The display unit 160 may also include display areas corresponding to other parts of the vehicle. The display area may be an area where images are projected by a projection device, or it may be a display device, such as an LCD screen or an LED screen. Specifically, it may be located in the center of the vehicle's center console, or on both sides of the rear seats, or behind the driver's seat and the front passenger seat, etc. In this example embodiment, no specific limitation is made.

[0058] Vehicle screens typically serve as information display devices for multimedia control systems, displaying basic information such as audio and video, and are controlled by a smart cockpit controller. In related technologies, the display control unit 150, when adjusting the vehicle's interior atmosphere, usually employs static color changes, meaning it sets fixed color representation rules to adjust the atmosphere without considering the consistency between the vehicle's atmosphere and the displayed content. This results in a low level of intelligence in controlling the vehicle's atmosphere adjustment system.

[0059] It should be noted that the vehicle ambient lighting system may include an ambient display area and ambient lighting. The ambient display area may include a specific area on the display screen, including but not limited to the edge areas of all display screens in the vehicle, as well as other areas of the HUD display area besides displaying the original content, and may also include areas in the vehicle's instrument panel that do not display vehicle driving information.

[0060] In some examples, the display area in the vehicle may include a content display area 42 and an ambient display area 41. Referring to Figure 4, the content display area 42 can be used to display vehicle information, navigation information, and other content, while the ambient display area 41 is used to display graphics obtained through the display control method of this disclosure. Specifically, the ambient display area 41 can be a display area at a preset distance from the edge of the display screen. The preset distance can be 3 cm, 3.5 cm, etc., and can also be customized based on user needs. In this example embodiment, no specific limitation is made.

[0061] In some examples, the ambient display area 41 and the content display area 42 can be different display screens. For example, the HUD display area and the display screen set on the center console of the vehicle can be used as the content display area, and the display area of ​​the display screen in other locations of the vehicle can be used as the ambient display area 41. In this example embodiment, no specific limitation is made.

[0062] Based on this, the present disclosure first provides a display control method. FIG5 shows a flowchart of the display control method, which can be applied to the above-mentioned display control unit 150. The display control method may include steps S510 to S520.

[0063] In step S510, the color information corresponding to the target display image is obtained.

[0064] In some example embodiments of this disclosure, the display control unit 150 can acquire color information of the target display image. Specifically, it can acquire video data, use each frame of the video data as the target display image, and acquire the color information corresponding to the target display image.

[0065] The target image mentioned above can be a frame from video data such as movies, TV programs, or live sports events, or it can be an image from a map displayed in a vehicle navigation system. It may contain different color codes to distinguish geographical features such as roads, waterways, and green areas. It can also be images corresponding to UI elements such as menus, icons, and buttons within the vehicle's infotainment system, which may have specific color themes or styles. Specific types can also be customized according to user needs, which will not be elaborated upon in this example implementation.

[0066] It should be noted that the color information mentioned above is represented by RGB pixel values. The specific color is determined based on the target display image, which will not be elaborated here.

[0067] In step S520, when displaying the target display image, the display color of the vehicle ambient adjustment system is controlled based on the color information.

[0068] In some example embodiments of this disclosure, when the display control unit 150 controls the display unit to display the target display image, the display color of the vehicle ambient adjustment system is controlled using the color information in the target display image.

[0069] This disclosure provides a display control method that, by acquiring the color information of the target display image, enables the vehicle atmosphere adjustment system to achieve color synchronization with the image content, enhancing visual consistency. Adjusting the atmosphere based on image color information can provide drivers and passengers with an environmental atmosphere that matches the image content, thereby enhancing the immersive experience and improving the intelligence of the vehicle atmosphere adjustment system control.

[0070] In some example implementations, when obtaining the color information of the target display image, the target display image can be obtained first. The target display image can be the currently displayed image, the next frame image of the currently displayed image, or other subsequent images to be displayed. In this example implementation, no specific limitation is made.

[0071] When the target image is another image to be displayed later, by obtaining the color information of the target image in advance, the color information can be obtained directly when the target image is displayed, without the need for a separate color information extraction process, thus reducing response time.

[0072] When extracting color information corresponding to the target display image, the display area corresponding to each display color in the target display image can be determined first, and the display color with a display area greater than a preset value can be used as the color information. For example, if the target display image includes 5 colors, namely red, yellow, green, blue and purple, a preset value for the display area can be determined. The preset value can be determined according to the size of the display screen. Specifically, it can be 10% of the display screen size, and the specific value can also be customized based on user needs.

[0073] If the display area corresponding to the red and green colors is greater than the preset value, then the red and green colors will be used as the color information corresponding to the target display image.

[0074] In some examples, the aforementioned display colors may be colors corresponding to one of the regions on the color wheel. When determining the display area corresponding to each display color, the HSV pixel values ​​of each pixel in the target display image can be extracted first. If the target display image is an RGB image, the RGB pixel values ​​of each pixel in the target display image can be converted into HSV pixel values.

[0075] Specifically, a conversion formula can be used to convert RGB pixel values ​​to HSV pixel values.

[0076] Let the value of (R, G, B) be a real number between 0 and 1.

[0077] Let MAX be equal to the largest of R, G, and B.

[0078] Let MIN be equal to the smallest of R, G, and B.

[0079] Therefore, the above conversion formula can be:

[0080]

[0081]

[0082]

[0083] The above formula can be used to convert the RGB pixel values ​​of the target display image into HSV pixel values.

[0084] After obtaining the HSV pixel values, referring to Figure 6, at least one initial pixel combination can be determined based on the hue components in the HSV pixel values, and each pixel in the initial pixel combination corresponds to a display color.

[0085] Specifically, the color wheel can be determined first based on the H value. The color wheel can include 24 groups, each with a degree of 15, or 20 groups, each with a degree of 18. The division method of the color wheel can be customized according to user needs, which will not be elaborated in this example implementation.

[0086] After obtaining the color wheel, referring to Figure 7, each pixel in the target display image is divided into multiple candidate pixel combinations based on the H value in HSV and the color wheel. That is, the group in the color wheel corresponding to each pixel is determined, and the group including the pixel is determined as the above-mentioned candidate pixel combination.

[0087] For example, suppose the target display image mentioned above includes 20,000 pixels, and the color wheel it covers includes 322.5 degrees to 337.5 degrees, 277.5 degrees to 292.5 degrees, 217.5 degrees to 232.5 degrees, 202.5 degrees to 217.5 degrees, 97.5 degrees to 112.5 degrees, and 37.5 degrees to 52.5 degrees.

[0088] The color wheel from 322.5 degrees to 337.5 degrees includes 5000 pixels; the color wheel from 277.5 degrees to 292.5 degrees includes 5000 pixels; the color wheel from 217.5 degrees to 232.5 degrees includes 6000 pixels; the color wheel from 202.5 degrees to 217.5 degrees includes 4000 pixels; the color wheel from 97.5 degrees to 112.5 degrees includes 3000 pixels; and the color wheel from 37.5 degrees to 52.5 degrees includes 2000 pixels. Since the color wheel involves five regions, there can be five candidate pixel combinations. In some examples, the number of candidate pixels in a candidate pixel combination can be used to characterize the display area corresponding to each display color. Candidate pixel combinations with a display area greater than a preset value can be used as the initial pixel combination. For example, the preset value corresponding to the above display area can be represented by the number of pixels. Assuming that the preset value of the display area is 3500 pixels, four initial pixel combinations can be determined from the above candidate pixel combinations.

[0089] In some example implementations, the candidate priority of a candidate pixel combination can also be determined based on the number of pixels in the combination. Specifically, a candidate pixel combination that includes more pixels has a higher candidate priority.

[0090] In some examples, a preset number of initial pixel combinations can be set, and then candidate pixel combinations with a higher priority preset number can be used as the initial pixel combinations. The preset number can be a positive integer such as 3 or 4; the specific value can be customized according to user needs, and will not be elaborated upon in this example.

[0091] For example, assuming the preset quantity is 3, the candidate pixel combinations corresponding to the color wheel from 217.5 degrees to 232.5 degrees, the candidate pixel combinations corresponding to the color wheel from 202.5 degrees to 217.5 degrees, and the candidate pixel combinations corresponding to the color wheel from 277.5 degrees to 292.5 degrees are used as the initial pixel combinations.

[0092] In some examples, the display area can be updated using brightness and saturation information from the target display image. Specifically, pixels whose brightness information is outside the set brightness range and pixels whose saturation information is outside the set saturation range can be deleted to update the display area.

[0093] It should be noted that when using the number of pixels in the initial pixel combination to represent the display area, the pixels in the initial pixel combination can be filtered based on the brightness and saturation information of the pixels in the initial pixel combination. The initial pixel combination after filtering the pixels is then used as the target pixel combination, and the number of pixels in the target pixel combination is used to represent the updated display area.

[0094] Specifically, after obtaining the initial pixel combination, the pixels in the initial pixel combination can be filtered based on the saturation and luminance components in the HSV pixel values ​​to obtain the target pixel combination.

[0095] Specifically, first determine the saturation S of each pixel in the initial pixel combination, and then filter the pixels in the initial pixel combination according to the saturation S. Specifically, a saturation threshold can be set to delete pixels that are not in the saturation threshold.

[0096] For example, referring to Figure 8, saturation can be divided into 10 levels: 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, and 1. The saturation level can also be customized according to user needs, which will not be elaborated in this example implementation. The saturation threshold can be greater than 0.5 and less than or equal to 0.9.

[0097] Similarly, referring to Figure 8, the brightness V of each pixel in the initial pixel combination is first determined. Then, the pixels in the initial pixel combination are filtered according to the brightness V. Specifically, a brightness threshold can be set to filter the pixels in the initial pixel combination. For example, the brightness can be set to 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, and 1. The brightness division can also be customized according to user needs, which will not be elaborated in this example implementation. The brightness threshold can also be greater than 0.5 and less than or equal to 0.9.

[0098] After filtering the pixels in the initial pixel combination based on the above brightness and saturation, the target pixel combination is obtained.

[0099] Referring to Figure 9, after obtaining the above target pixel combination, the RGB pixel values ​​of each pixel in each target pixel combination can be obtained, and then the average value of the RGB pixel values ​​of all pixels in the target pixel combination can be used as the color information corresponding to the target pixel combination.

[0100] It should be noted that each target pixel combination corresponds to one color information, meaning that the number of target pixel combinations and color information are the same.

[0101] In some examples, when the target display image is not the first frame image, the similarity between the target display image and the previous frame image can be determined. When the similarity is greater than a preset value, the color information of the previous frame image can be used as the color information of the target display image. The preset value can be 90%, 95%, etc. The specific value can be customized based on the user's requirements for accuracy, which will not be elaborated in this example implementation.

[0102] In some examples, the number of pixels in each target pixel combination can also be obtained, the ratio of the number of pixels in each target pixel combination can be determined, and the proportion of display colors in the control atmosphere adjustment system can be determined based on the ratio.

[0103] After obtaining the target pixel combination, i.e., determining the number of pixels in the target pixel combination, the display color of the vehicle ambient adjustment system can be controlled based on the proportional relationship of the display area corresponding to the determined color information, i.e. the proportional relationship of the number of pixels in the target pixel combination.

[0104] For example, if the above target pixel combination includes three, namely A, B, and C, and the ratio of the number of pixels in the three target pixel combinations is 3:2:1, and if the color corresponding to A is red, the color corresponding to B is blue, and the color corresponding to C is purple, then when controlling the display color in the atmosphere adjustment system, the ratio of the display color is red:blue:purple equal to 3:2:1.

[0105] This embodiment extracts the HSV value of each pixel in the image, which can accurately identify and quantify the color components in the image, providing an accurate data foundation for subsequent color processing and atmosphere adjustment.

[0106] In some examples, it can also be determined whether the vehicle is playing audio data. If not, a default display graphic can be displayed on the display screen when controlling the display color of the vehicle atmosphere adjustment system. At the same time, the color of the ambient light in the vehicle atmosphere adjustment system can also be adjusted according to the display color.

[0107] In some examples, the default displayed image can be a waveform such as a sine wave, a wave shape, a rectangle, etc. Taking a rectangle as an example, when there is no audio data, the displayed graphic can be as shown in Figure 10. The specific shape of the displayed graphic can also be customized according to user needs, which will not be elaborated in this example implementation.

[0108] In some examples, if the vehicle is playing audio data, the sound type of the audio data can be determined first. The sound type includes, but is not limited to, music, game background, and movies. The specific type can be adjusted according to the needs, which will not be elaborated here.

[0109] It should be noted that machine learning models can be used to identify the sound type of audio data. Specifically, an audio data classification model can be used to determine the sound type of the audio data.

[0110] In some examples, the audio data classification model described above is trained primarily on a deep learning neural network model. For instance, the audio data classification model could be based on a feedforward neural network. A feedforward network can be implemented as an acyclic graph, where nodes are arranged in layers. Typically, the feedforward network topology includes an input layer and an output layer, separated by at least one hidden layer. The hidden layer transforms the input received by the input layer into a representation useful for generating the output in the output layer. Network nodes are fully connected to nodes in adjacent layers via edges, but there are no edges between nodes within a single layer. Data received at the nodes in the input layer of the feedforward network is propagated (i.e., “feedforward”) to the nodes in the output layer via an activation function that calculates the state of nodes in each consecutive layer of the network based on coefficients (“weights”), each coefficient being associated with each of the edges connecting these layers. The output of the audio data classification model can take various forms, and this disclosure does not limit this. Audio data classification models may also include other neural network models, such as convolutional neural network (CNN) models, recurrent neural network (RNN) models, and generative adversarial network (GAN) models, but are not limited to these, and may also employ other neural network models known to those skilled in the art.

[0111] First, corresponding sample data can be obtained, and then the audio data classification model can be trained using this sample data. Specifically, this can include the following steps: selecting a network topology; using a set of training data representing the problem being modeled by the network; and adjusting the weights until the network model exhibits minimum error for all instances in the training dataset. For example, during supervised learning training for a neural network, the output generated by the network in response to inputs representing instances in the training dataset is compared to the "correct" labeled output of that instance; an error signal representing the difference between the output and the labeled output is calculated; and the weights associated with the connections are adjusted to minimize the error as the error signal is backpropagated through the layers of the network. The model in which the error of each output generated from the instances in the training dataset is minimized is defined as the audio data classification model.

[0112] After determining the sound type corresponding to the above audio data, the display graphics can be determined based on the sound type. Specifically, the display elements in the display image can be determined. For example, referring to Figure 11, when the sound type is music, the display elements can be multiple rectangles arranged according to a certain pattern. When the sound type is game background music, the display elements can be multiple overlapping triangles. When the sound type is movie vocals, the display elements can be irregular images composed of smooth curves and straight lines. The specific correspondence can also be set according to user needs, which will not be elaborated here.

[0113] It should be noted that the mapping relationship between sound type and real-world elements is pre-configured and exists in the storage space that the display control unit can locate.

[0114] In some examples, the frequency and amplitude of the aforementioned audio data can also be determined, and then the display area and arrangement of the aforementioned display elements within the ambient display area can be determined based on the frequency and amplitude.

[0115] Specifically, the frequency of the aforementioned audio data is positively correlated with the arrangement density of the display elements in the arrangement, and the amplitude of the audio data is positively correlated with the display area of ​​the aforementioned display elements.

[0116] Referring to Figure 12, as the frequency of the audio increases, the number of display elements in the displayed image increases, that is, the display density of the display elements increases. Referring to Figure 13, as the amplitude of the audio data increases, the display area of ​​the display elements increases, specifically, the display height increases.

[0117] In some examples, when controlling the display graphics of the atmosphere adjustment system based on the audio data, the atmosphere display area can be divided into N+1 segments. Specifically, referring to Figure 14, the atmosphere display area can be divided into N+1 segments according to time sequence, which may include the current time T, T-1 seconds, T-2 seconds, T-3 seconds, T-4 seconds, ..., TN seconds. The display graphics of different atmosphere display areas are controlled according to the audio data at different times.

[0118] For example, referring to Figure 15, the frequency of the audio data varies at different times, therefore the arrangement density between display elements in the displayed graphics at different times also varies. Referring to Figure 16, the amplitude of the audio data varies at different times, so the display area of ​​the displayed image in the corresponding ambient display area at different times also varies.

[0119] In some examples, referring to FIG17, after obtaining the display graphic, the display graphic can be rendered based on the obtained color information. Specifically, the display graphic can be rendered according to the color ratio, and can be rendered along a first direction according to the color ratio. The first direction can be a direction parallel to the border of the display area, or a direction set by the user according to preference. In some examples, the user can modify the first direction through the graphical user interface. In this example embodiment, the first direction is not specifically limited.

[0120] In some examples, when the vehicle atmosphere adjustment system includes multiple consecutive atmosphere display areas, as shown in FIG18, the same display elements can be displayed in each of the above areas, and the display area and arrangement of the multiple display elements in the multiple atmosphere display areas are the same.

[0121] In some example implementations, referring to FIG19, the display area and arrangement of the display elements in the multiple ambient display areas can be determined based on the display area in the multiple ambient display areas. It is understood that multiple consecutive ambient display areas are displayed as a single, complete ambient display area; that is, when dividing the ambient display areas, multiple consecutive ambient display areas are divided into N+1 segments as a single ambient display area.

[0122] The above display control method will be described below with reference to FIG20. Specifically, the above display control method may include steps S2001 to S2011.

[0123] In step S2001, it is determined whether the multimedia is turned on.

[0124] If yes, then proceed with steps S2002 and S2003. If no, then the ambient effect will not be displayed.

[0125] In step S2002, it is determined whether the multimedia includes video data.

[0126] If yes, proceed to step S2004; otherwise, display the default color.

[0127] In step S2004, the HSV pixel values ​​of each pixel in the target display image in the video data are extracted.

[0128] In step S2005, at least one initial pixel combination is determined based on the hue components in the HSV pixel values.

[0129] In step S2006, the pixels in the initial pixel combination are filtered based on the saturation and luminance components in the HSV pixel values ​​to obtain the target pixel combination.

[0130] In step S2007, the RGB pixel values ​​of each pixel in the target pixel combination are obtained.

[0131] In step S2008, the average RGB pixel value of all pixels in the target pixel combination is used as color information.

[0132] In step S2009, the display color of the vehicle ambient adjustment system is controlled based on color information.

[0133] In step S2003, it is determined whether the multimedia includes audio data.

[0134] If yes, proceed to steps S2010 and S2011. If no, display the default graphic.

[0135] In step S2012, the sound type of the audio data is obtained.

[0136] In step S2013, the display elements in the display graphic are determined according to the sound type.

[0137] In step S2014, the frequency and amplitude of the audio data are acquired.

[0138] In step S2015, the arrangement of the display elements is determined according to the frequency;

[0139] In step S2016, the display area of ​​the display element is determined based on the amplitude.

[0140] In step S2017, the display graphics of the vehicle atmosphere adjustment system are controlled according to the display elements, arrangement, and display area.

[0141] It should be noted that the specific details of steps S2001 to S2017 have been explained in detail above, so they will not be repeated here.

[0142] This disclosure provides a display control method. By acquiring the color information of the target display image, the vehicle atmosphere adjustment system can achieve color synchronization with the image content, enhancing visual consistency. Adjusting the atmosphere based on image color information can provide drivers and passengers with an environmental atmosphere that matches the image content, thereby enhancing the immersive experience and improving the intelligence of the vehicle atmosphere adjustment system control. Furthermore, controlling the display graphics based on audio data, dynamically adjusting display elements through sound type, frequency, and amplitude, synchronizes the vehicle atmosphere with the music rhythm, providing a richer audiovisual experience. The display area and arrangement of display elements are dynamically adjusted according to the frequency and amplitude of the audio data, making the display effect more vivid and varied. By acquiring the proportional relationship between various color information and determining the display color of the display elements based on this proportional relationship, color coordination and balance are achieved. In multiple consecutive display areas, display elements can be uniformly or differentiated according to frequency and amplitude, increasing the sense of hierarchy in the visual effect. By acquiring the similarity between the target display image and the previous frame image, and using the color information of the previous frame image when the similarity is greater than a preset value, the computational load is reduced while maintaining display continuity.

[0143] Furthermore, this disclosure also provides a display control device. Referring to FIG21, the display control device 2100 may include an acquisition module 2110 and a display module 2120. Wherein:

[0144] The acquisition module 2110 can be used to acquire the color information corresponding to the target display image.

[0145] The display module 2120 can be used to control the display color of the vehicle ambient adjustment system based on color information when displaying a target image.

[0146] In some examples, the acquisition module 2110 can also be used to determine the display area corresponding to each display color in the target display image, and use the display color with a display area greater than a preset value as color information.

[0147] In some examples, the acquisition module 2110 can also be used to acquire brightness and saturation information of the target display image and update the display area based on the brightness and saturation information.

[0148] In some examples, the acquisition module 2110 can also be used to delete pixels whose brightness information is not within the set brightness range and pixels whose saturation information is not within the set saturation range, in order to update the display area.

[0149] In some examples, the display module 2120 can also be used to determine the display area of ​​each color information in the target display image and to determine the proportional relationship between the display areas;

[0150] The display colors of the vehicle's ambient lighting system are adjusted based on proportional relationships and color information.

[0151] In some examples, display module 2120 can also be used to control the display graphics of the vehicle ambient adjustment system based on audio data.

[0152] In some examples, display module 2120 can also be used to determine the sound type of audio data; and to determine the display elements in the display graphics based on the sound type.

[0153] In some examples, display module 2120 can also be used to determine the frequency and amplitude of audio data; and to determine the display area and arrangement of display elements within the display area based on the frequency and amplitude.

[0154] In some examples, the display module 2120 can also be used to obtain the proportional relationship between various color information and determine the display color of the display element based on the proportional relationship and the color information.

[0155] In some examples, the display module 2120 can also be used to render the colors of the display elements along a first direction based on color information and proportions to determine the display colors of the display elements.

[0156] In some examples, the vehicle atmosphere adjustment system includes multiple consecutive display areas, and the display module 2120 can also be used to display the same display elements in each display area, and the display area and arrangement of each display element in multiple display areas are the same.

[0157] In some examples, the vehicle atmosphere adjustment system includes multiple consecutive display areas, and the display module 2120 can also be used to determine the display area and arrangement of display elements based on frequency and amplitude, including: determining the display area and arrangement of display elements in multiple display areas based on frequency and amplitude according to the total display area of ​​multiple display areas.

[0158] In some examples, the acquisition module 2110 can also be used to acquire the similarity between the previous frame image of the target display image and the target display image; if the similarity is greater than a preset value, the color information of the previous frame image of the target display image is used as the color information of the target display image.

[0159] It should be understood that the above-described device embodiments are merely illustrative, and the device disclosed herein can be implemented in other ways. For example, the division of units / modules in the above embodiments is only a logical functional division, and there may be other division methods in actual implementation. For example, multiple units, modules, or components may be combined, integrated into another system, or some features may be ignored or not executed.

[0160] Furthermore, unless otherwise specified, the functional units / modules in the various embodiments of this disclosure can be integrated into one unit / module, or each unit / module can exist physically separately, or two or more units / modules can be integrated together. The integrated units / modules described above can be implemented in hardware or as software program modules.

[0161] When integrated units / modules are implemented in hardware, the hardware can be digital circuits, analog circuits, etc. The physical implementation of the hardware structure includes, but is not limited to, transistors, memristors, etc. Unless otherwise specified, the processor can be any suitable hardware processor, such as a CPU, GPU, FPGA, DSP, and ASIC, etc. Unless otherwise specified, the storage unit can be any suitable magnetic or magneto-optical storage medium, such as Resistive Random Access Memory (RRAM), Dynamic Random Access Memory (DRAM), Static Random Access Memory (SRAM), Enhanced Dynamic Random Access Memory (EDRAM), High-Bandwidth Memory (HMB), Hybrid Memory Cube (HMC), etc.

[0162] If the integrated unit / module is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this disclosure. The aforementioned memory includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0163] Please refer to Figure 22, which shows a structural block diagram of a display control device provided in an exemplary embodiment of this disclosure. In some examples, the display control device can be at least one of devices such as a smartphone, smartwatch, desktop computer, laptop, virtual reality terminal, augmented reality terminal, wireless terminal, and laptop computer. The display control device has communication functions and can access wired or wireless networks. The display control device can refer to one of multiple terminals, and those skilled in the art will understand that the number of such terminals can be more or less. It is understood that the display control device undertakes the calculation and processing work of the technical solution of this disclosure, and the embodiments of this disclosure do not limit this aspect.

[0164] As shown in Figure 22, the display control device 2200 may include at least one processor 2210, a memory 2220, and a communication interface 2230.

[0165] The memory 2220 is used to store programs. Specifically, the program may include program code, which includes computer operation instructions.

[0166] The memory 2220 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0167] The processor 2210 is used to execute computer execution instructions stored in the memory 2220 to implement the display control method described in the foregoing method embodiments. The processor 2210 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this disclosure.

[0168] The display control device 2200 may also include a communication interface 2230, through which it can communicate and interact with external devices. In specific implementations, if the communication interface 2230, memory 2220, and processor 2210 are implemented independently, they can be interconnected via a bus to complete communication. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc., but this does not imply that there is only one bus or one type of bus.

[0169] Optionally, in a specific implementation, if the communication interface 2230, memory 2220 and processor 2210 are integrated on a single chip, then the communication interface 2230, memory 2220 and processor 2210 can communicate through an internal interface.

[0170] This disclosure also provides a computer-readable storage medium, which may include various media capable of storing program code, such as a USB flash drive, a portable hard drive, a read-only memory, a random access memory, a disk, or an optical disk. Specifically, the computer-readable storage medium stores program instructions, which are used for the display control method in the above embodiments.

[0171] This disclosure also provides a computer program product including computer instructions stored in a computer-readable storage medium; a processor of a display control device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the display control device to perform the display control methods of the various embodiments described above.

[0172] Those skilled in the art will recognize that the functions described in the embodiments of this disclosure in one or more of the foregoing examples can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or code on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transfer of a computer program from one place to another. Storage media can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0173] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as the combination of these technical features does not contradict each other, it should be considered within the scope of this specification.

[0174] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention applied herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not claimed herein.

[0175] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A display control method, characterized in that, include: Obtain the color information corresponding to the target display image; When displaying the target image, the display color of the vehicle ambient adjustment system is controlled based on the color information.

2. The display control method according to claim 1, characterized in that, The step of obtaining the color information corresponding to the target display image includes: The display area corresponding to each display color in the target display image is determined, and the display color with a display area greater than a preset value is used as the color information.

3. The display control method according to claim 2, characterized in that, Before using the display color with a display area greater than a preset value as the color information, the method further includes: Obtain the brightness and saturation information of the target display image, and update the display area based on the brightness and saturation information.

4. The display control method according to claim 3, characterized in that, Updating the display area based on the brightness information and the saturation information includes: Pixels whose brightness information is outside the set brightness range are deleted, and pixels whose saturation information is outside the set saturation range are deleted to update the display area.

5. The display control method according to any one of claims 1 or 4, characterized in that, When displaying the target image, controlling the display color of the vehicle ambient lighting system based on the color information includes: Determine the proportional relationship between the display areas of each color information in the target display image; Based on the aforementioned proportional relationship, the display colors of the vehicle ambient lighting system are controlled according to the color information.

6. The display control method according to claim 1, characterized in that, The method further includes: The display graphics of the vehicle's ambient lighting system are controlled based on audio data.

7. The display control method according to claim 6, characterized in that, Controlling the display graphics of the vehicle ambient lighting system based on audio data includes: Determine the sound type of the audio data; The display elements in the display graphics are determined based on the sound type.

8. The display control method according to claim 7, characterized in that, The method further includes: Determine the frequency and amplitude of the audio data; The display area and arrangement of the display elements within the display area are determined based on the frequency and amplitude.

9. The display control method according to claim 8, characterized in that, The control of the display color of the vehicle ambient lighting system based on the color information includes: Obtain the proportional relationship between the various color information, and determine the display color of the display element based on the proportional relationship and the color information.

10. The display control method according to claim 8, characterized in that, The vehicle atmosphere adjustment system includes multiple consecutive display areas; Determining the display area and arrangement of the display elements within the display area based on the frequency and amplitude includes: Displaying the same display element in each display area, and the display area and arrangement of each display element in multiple display areas are the same; or Based on the total display area of ​​the multiple display areas, the display area and arrangement of the display elements in the multiple display areas are determined according to the frequency, amplitude and total display area.

11. The display control method according to claim 1, characterized in that, The method further includes: Obtain the similarity between the previous frame image of the target display image and the target display image; If the similarity is greater than a preset value, the color information of the previous frame of the target display image is used as the color information of the target display image.

12. A display control device, characterized in that, include: The acquisition module acquires the color information corresponding to the target display image; The display module controls the display color of the vehicle ambient lighting system based on the color information when displaying the target display image.

13. A display control device, characterized in that, The display control device includes a processor and a memory; the processor is used to execute instructions stored in the memory to implement the display control method as described in any one of claims 1 to 11.

14. A computer storage medium, characterized in that, The storage medium stores at least one instruction, which is executed by a processor to implement the display control method as described in any one of claims 1 to 11.

Images