Method, device and system for realizing film watching special effect of cabin cinema and vehicle

Abstract

A method, device, system and vehicle for realizing a special viewing effect of a cabin cinema are suitable for the field of intelligent automobiles, the method comprises: acquiring video picture content played by a first display unit, the first display unit belonging to a first class of display units, the first class of display units comprising one or more display units; performing effect processing on the video picture content to obtain special effect data, wherein the special effect data is used for displaying one or more special effects; and outputting the special effect data to one or more other display units except the first display unit in the first type of display units, so that the one or more other display units display a first special effect according to the special effect data. According to the method and the device, when a user watches a film in the cabin, the display equipment in the cabin can be fully and effectively utilized, and meanwhile, the film watching atmosphere adaptive to the played media content can be created, so that the film watching experience of the user in the cabin is improved.

Description

Method, device, system and vehicle for realizing special effects of viewing movies in a cabin theater Technical Field

[0001] The present application relates to the field of intelligent vehicles, and in particular to a method, device, system and vehicle for achieving special effects of viewing movies in a cockpit theater. Background Art

[0002] As vehicles become increasingly intelligent, smart cockpits are attracting significant attention, with the in-cockpit audiovisual entertainment experience becoming a key factor in determining this experience. Currently, users primarily watch movies in the cockpit through installed video apps or by connecting their phones or other devices to the in-car computer and projecting videos onto it. However, the immersive viewing experience is still lacking.

[0003] Summary of the Invention

[0004] The present application provides a method, device, system and vehicle for achieving cabin theater viewing special effects, which helps to enhance the user's immersive experience of watching movies in the cabin.

[0005] In a first aspect, the present application provides a method for realizing special effects for watching movies in a cabin theater, the method comprising: obtaining video picture content played by a first display unit, the first display unit belonging to a first category of display units, the first category of display units including one or more display units; performing effect processing on the video picture content to obtain special effects data, the special effects data being used to display one or more special effects; outputting the special effects data to one or more other display units in the first category of display units except the first display unit, so that the one or more other display units display a first special effect according to the special effects data.

[0006] Exemplarily, the first type of display unit includes an image display device in the cabin, and the image display device includes a display screen in the cabin, for example, a first display unit. The first display unit can be a cabin central control screen. The image display device can also include an instrument display screen, a display screen in front of the passenger in the front passenger seat (also called the front passenger), a display screen in front of the left rear passenger, a display screen in front of the right rear passenger, and other cabin display devices. When the cabin central control screen is playing a movie, the video content in the central control screen is processed with effects to obtain special effect data, which includes one or more special effects, and then the special effect data is output to other display devices in the first type of display unit. This implementation method can make full use of the display devices in the cabin, create a viewing atmosphere of a cabin theater, and enhance the user's viewing experience.

[0007] In a possible implementation, different display units in the first type of display units can display different special effects, which can further enhance the atmosphere and immersion.

[0008] In one possible implementation, the processing includes one or more of the following: cropping, stretching, blurring, gradients, extracting image elements, and extracting primary colors. By processing the video content, the resulting special effects data maintains a strong correlation with the video content, such as the primary color tone, helping to enhance the viewing atmosphere.

[0009] In one possible implementation, the special effect data is further output to one or more second-type display units, so that the one or more second-type display units display a second special effect based on the special effect data. Exemplarily, the second-type display units may include one or more ambient lights within the cabin, and the special effect data is output to the ambient lights, which then display lighting effects to enhance the viewing atmosphere.

[0010] In one possible implementation, the outputting of the special effect data to one or more second-category display units includes outputting the special effect data to a control module so that the control module controls the display of one or more second-category display units according to the special effect data. Exemplarily, the second-category display unit may include an ambient light in the cabin, and the special effect data is output to the control module of the ambient light, and the control module further regulates and optimizes the display effect of the ambient light, for example, further adjusting the presentation effect of the special effect according to the surrounding environment to enhance the viewing atmosphere. Furthermore, in one possible implementation, it also includes obtaining the audio content played by the first display unit; extracting audio features based on the audio content; and outputting the audio features to the control module so that the control module controls the display of the one or more second-category display units according to the special effect data and the audio features. In one possible implementation, the audio features include amplitude and / or frequency. Exemplarily, the audio features are output to the control module of the ambient light. The control module adjusts the brightness of the ambient light according to the amplitude of the audio, and adjusts the flashing speed of the ambient light according to the frequency of the audio. Then, combined with the lighting effects of the ambient light, a soothing or tense atmosphere corresponding to the video being played is created to enhance the user's viewing experience. Furthermore, in a possible implementation, different display units in the second type of display unit can have the same or different special effects. Exemplarily, the ambient light surrounds the cabin, and ambient lights in different positions can display different special effects, which can further enhance the ambient experience.

[0011] In the second aspect, the present application provides a device, including: an acquisition module, used to acquire the video screen content played by a first display unit, the first display unit belongs to a first category of display units, and the first category of display units includes one or more display units; a processing module, used to perform effect processing on the video screen content to obtain special effect data, and the special effect data is used to display one or more special effects; an output module, used to output the special effect data to one or more other display units in the first category of display units except the first display unit, so that the one or more other display units display the first special effect according to the special effect data.

[0012] In a possible implementation, the processing module performs one or more of the following effects on the video content: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.

[0013] In a possible implementation, the output module is further configured to output the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.

[0014] In a possible implementation, the device further includes a control module, the output module outputs the special effect data to the control module, and the control module is configured to receive the special effect data and control the display of one or more second-type display units according to the special effect data.

[0015] Furthermore, in one possible implementation, the acquisition module is further configured to acquire audio content played by the first display unit; the processing module is further configured to extract audio features based on the audio content; and the output module is further configured to output the audio features to the control module, which controls the display of the one or more second-type display units based on the special effect data and the audio features. In one possible implementation, the audio features include amplitude and / or frequency.

[0016] In a possible implementation, the second type of display unit includes an ambient light. Further, the ambient light includes a first ambient light and a second ambient light, and the first ambient light and the second ambient light have different lighting effects.

[0017] In a possible implementation, the first type of display unit includes an image display device. Further, the image display device includes the first display unit, a second display unit, and a third display unit, wherein the second display unit and the third display unit have different image special effects.

[0018] In a third aspect, the present application provides a device comprising a processor and a memory, wherein the processor is configured to read a computer program stored in the memory so as to enable the device to execute the method described in the first aspect or any of the methods described in the first aspect.

[0019] In a fourth aspect, the present application provides a display system comprising a computing platform and a display device, wherein the computing platform comprises the device described in the second or third aspect, and the display device comprises a first type of display unit, the first type of display unit being configured to display a first special effect based on special effect data output by the computing platform, the first type of display unit comprising one or more display units. Furthermore, in one possible implementation, the first type of display unit comprises an image display device.

[0020] In one possible implementation, the display device further includes a second type of display unit, the second type of display unit being configured to display a second special effect based on the special effect data output by the computing platform, the second display unit including one or more display units. Furthermore, in one possible implementation, the second type of display unit includes an ambient light.

[0021] In a fifth aspect, the present application provides a vehicle comprising any one of the device described in the second aspect, the device described in the third aspect, and the system described in the fourth aspect.

[0022] In a sixth aspect, the present application provides a computer-readable storage medium for storing a computer program. When the computer program runs on a computer, the first aspect or any method described in the first aspect is implemented.

[0023] In a seventh aspect, the present application provides a chip comprising a processor and a communication interface, wherein the processor is configured to read instructions to execute the method described in the first aspect or any of the methods described in the first aspect.

[0024] In an eighth aspect, the present application provides a computer program product, comprising a computer program code, wherein when the computer program code is run on a computer, the computer executes the method according to the first aspect or any method according to the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] FIG1 is a schematic diagram of a scene inside a vehicle cabin provided by an embodiment of the present application;

[0026] FIG2 is a schematic structural diagram of a vehicle cockpit display system provided in an embodiment of the present application;

[0027] FIG3 is a schematic structural diagram of a first type of display unit provided in an embodiment of the present application;

[0028] FIG4 is a flow chart of a method for achieving cockpit movie viewing special effects provided by an embodiment of the present application;

[0029] FIG5 is a schematic diagram of a process for achieving a special effect of viewing a movie in a cockpit according to an embodiment of the present application;

[0030] FIG6 is a schematic diagram of a partition when extracting the main color of a picture provided by an embodiment of the present application;

[0031] FIG7 is another schematic diagram of partitioning when extracting the main color of a picture provided by an embodiment of the present application;

[0032] FIG8 is a schematic diagram of another process for achieving cockpit movie viewing special effects according to an embodiment of the present application;

[0033] FIG9 is a schematic structural diagram of a device for achieving cockpit movie viewing special effects provided by an embodiment of the present application;

[0034] FIG10 is a schematic structural diagram of another device for achieving cabin viewing special effects provided by an embodiment of the present application;

[0035] FIG11 is a schematic diagram of the structure of a chip provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] The technical solutions in the embodiments of the present application will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0037] References to "one embodiment" or "some embodiments" in this specification mean that a particular feature, structure, or characteristic described in conjunction with that embodiment is included in one or more embodiments of the present application. Thus, phrases such as "in one embodiment," "in some embodiments," "in other embodiments," and "in yet other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more but not all embodiments," unless otherwise specifically emphasized. The terms "including," "comprising," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0038] In this application, the terms "first", "second", etc. are used to distinguish identical or similar items with substantially the same effects and functions. It should be understood that there is no logical or temporal dependency between "first", "second", and "nth", nor is there any limitation on the quantity and execution order.

[0039] In this application, "at least one" means one or more, and "more" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: including the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0040] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0041] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0042] In addition, in order to better illustrate the present application, numerous specific details are provided in the following specific embodiments. Those skilled in the art should understand that the present application can also be implemented without certain specific details.

[0043] FIG1 shows a schematic diagram of a scene in a vehicle cabin provided by an embodiment of the present application. In the vehicle cabin, the automobile head unit, also known as the in-vehicle audio and video entertainment system, can be set in the vehicle's central control area, and the screen connected to it can also be called a central control display or central control screen. With the gradual expansion of digital display devices in the cabin, in some vehicles, multiple display screens are set in the cabin, or a large screen that can be split into two parts, for displaying digital instrument panels, entertainment programs, related information, etc. As shown in FIG1 , multiple display screens are set in the cabin, including a digital instrument display screen 101, a central control screen 102, an entertainment display screen 103 (copilot screen) located in front of the co-pilot passenger, an entertainment display screen 104 located in front of the left rear passenger, and an entertainment display screen 105 located in front of the right rear passenger. One or more display devices with projection functions can also be set in the cabin, such as a head-up display (HUD), an augmented-reality head-up display (AR-HUD), or other types of projectors. Among them, HUD is a display device that projects an image into the field of view in front of the driver or passenger. The HUD utilizes the principles of optical reflection to project important information as a two-dimensional image onto the vehicle's front windshield or onto a separate transparent screen. As shown in Figure 1 , this information can be projected onto windshield 106. Furthermore, the cabin may include one or more ambient lights 107, which display different colors at a specific frequency to enhance the cabin atmosphere. With the continuous advancement of intelligent vehicles, to meet users' diverse cockpit needs and enhance their experience, the number of in-cabin display devices is increasing, and the functionality of the display systems is becoming increasingly complex. The following briefly describes the cockpit display system.

[0044] FIG2 is a schematic diagram of the structure of a vehicle cockpit display system provided in an embodiment of the present application. As shown in FIG2 , the display system 200 includes a computing platform 210 and a display device 220 .

[0045] The computing platform 210 can also be called a controller and can include one or more processors, such as processors 211 to 21m (m is a positive integer) shown in Figure 2. A processor is a circuit with signal processing capabilities. In one implementation, the processor can be a circuit with instruction reading and execution capabilities, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU), or a digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationship of a hardware circuit. The logical relationship of the hardware circuit is fixed or reconfigurable, such as a processor that is an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 210 may also include a memory for storing instructions. Some or all processors in the computing platform 210 may call instructions in the memory and execute the instructions to implement corresponding functions.

[0046] The display device 220 may include multiple types of display units, such as 221 to 22n (n is a positive integer) as shown in FIG2 . Each type of display unit may include one or more display units. For example, as shown in FIG3 , the first type of display unit 221 may include k display units (the first display unit to the kth display unit, k is a positive integer). The classification of display units can be based on the different display functions of the display units or the different device structures of the display units. For example, here, the display device shown in FIG1 is divided into three types of display units, each type of display unit including one or more display units. The first type of display unit is an image display device, including the central control screen 102, the digital instrument display screen 101, the entertainment display screen 103 in front of the front passenger, the entertainment display screen 104 in front of the left rear passenger, and the entertainment display 105 in front of the right rear passenger; the second type of display unit includes the ambient light 107; and the third type of display unit includes the windshield 106 onto which the HUD is projected. It should be understood that there are many ways to classify the above-mentioned display units, and this application does not limit this.

[0047] In summary, there are more and more in-cabin display devices, but in actual user experience, these display devices are not fully and effectively utilized. For example, when a user plays a video in the cockpit using a video application installed in the vehicle computer, or uses a terminal device connected to the vehicle computer to project a video to the vehicle computer, the video image is displayed on the cockpit central control screen. The user's viewing experience is not much different from that of directly using a terminal device (such as a mobile phone or tablet), and the viewing atmosphere is not immersive enough. Therefore, the in-cabin display devices can be fully utilized to enhance the user's viewing experience.

[0048] This application provides a method, device, system, and vehicle for achieving in-cabin movie viewing special effects, which are described in detail below. For example, when a movie is playing on the central control screen in the cabin, the video content of the central control screen is captured, then effects processing is performed to obtain special effects data. Finally, this special effects data is output to other display devices in the cabin, which then display the special effects based on the special effects data. This fully utilizes the display devices in the cabin, creating a cinema-like viewing atmosphere and enhancing the user's viewing experience.

[0049] FIG4 shows a flow chart of a method for achieving cockpit movie viewing special effects provided by an embodiment of the present application. As shown in FIG4 , the method may include S401-S403:

[0050] S401: Acquire video content played by a first display unit, where the first display unit belongs to a first category of display units, which includes one or more display units.

[0051] Exemplarily, the first display unit may be a central control screen.

[0052] In one embodiment, the video screen content may be a frame of the source video being played or the video screen content.

[0053] In one embodiment, the video screen content may be one or more frames of screen content obtained by capturing the played video screen.

[0054] Exemplarily, the display screen of the first display unit may be recorded to obtain one or more frames of video screen content of the recorded video.

[0055] In addition, the acquisition of the video content may be to acquire the video content of each frame of the playing media, or to acquire the video content periodically, for example, to acquire the video content every 2 seconds.

[0056] S402: Perform effect processing on the video image content to obtain special effect data, where the special effect data is used to display one or more special effects.

[0057] In one embodiment, the video image content is subjected to effect processing, including one or more of cropping, stretching, blurring, gradient, extracting image elements, extracting main colors, and the like.

[0058] For example, as shown in FIG5 , 500 is the video screen content played by the first display unit of the first type of display unit. After the video screen content is cropped, as shown in FIG5 , the video screen content 510 of 25% of the left side of the video screen content 500 and the video screen content 520 of 25% of the right side of the video screen content 500 are obtained. Then, the cropped video screen content 510 and the video screen content 520 are stretched, blurred and other effect processing are performed to obtain the processed first special effect data 511 and the second special effect data 521.

[0059] For example, the special effect data can be obtained by cropping 50% of the left side of the video content, and then stretching, blurring, and gradient processing the cropped video content.

[0060] Exemplarily, special effects data can also be obtained by extracting video screen elements. Extracting video screen elements can specifically include: identifying people, animals, plants, and backgrounds in the video screen content, and then extracting special effects data from the identified content through processing methods such as cutouts. Special effects data can also be obtained by stretching, blurring, and other processing on the identified content.

[0061] Exemplarily, special effect data can also be obtained by extracting the main color of the screen. Extracting the main color of the screen can specifically include: dividing the video screen content into x areas, extracting a color value from each area, and setting the color value of the i-th area to color(i). The color value can be the color value of the middle position of the i-th area, or the color value of any position in the i-th area, and then taking the average of the color values ​​extracted from all areas to obtain the main color of the video screen. The main color of the video screen is represented by mainColor.

[0062] As shown in FIG6 and FIG7, the video screen content is divided into 16 areas and 36 areas respectively, and the corresponding video screen main color can be obtained according to the above formula.

[0063] It should be understood that the effect processing solutions described in the above embodiments do not represent all effect processing solutions, but various effect processing solutions for video picture content should be included in the scope of this application.

[0064] S403: Output the special effect data to one or more other display units in the first type of display units except the first display unit, so that the one or more other display units display a first special effect according to the special effect data.

[0065] For example, in step S402, the left 50% of the video content played on the central control screen is cropped, and then the cropped video content is stretched, blurred, and gradient processed to obtain special effect data. This special effect data is output to the passenger screen and the digital instrument display.

[0066] In one embodiment, the first type of display unit may include an image display device, including the first display unit, and a second display unit and a third display unit, wherein the second display unit and the third display unit have different image effects.

[0067] For example, as shown in Figure 5, the image display device includes a first display unit 500, a second display unit 512, and a third display unit 522. First special effect data 511 is output to the second display unit 512, and second special effect data 521 is output to the third display unit 522. Second display unit 512 can be an instrument panel, and third display unit 522 can be an entertainment screen located in front of the front passenger seat. This approach fully utilizes the available screens in the cabin, enhancing the user's viewing experience.

[0068] In one embodiment, the method further includes outputting the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.

[0069] Exemplarily, the second type of display unit may include one or more ambient lights in the cabin, and the main color special effect data of the video screen obtained in step S402 is output to one or more ambient lights in the cabin. The color tone presented by the ambient light is adapted to the video screen, which is beneficial to creating a unified viewing atmosphere.

[0070] In one embodiment, as shown in FIG8 , outputting the special effect data to one or more second-type display units includes outputting the special effect data to a control module so that the control module controls the display of one or more second-type display units according to the special effect data.

[0071] Exemplarily, the second type of display unit may include one or more ambient lights in the cabin. The main color effects of the video screen obtained in step S402 are output to the control module of the cabin ambient lights, and the control module controls the cabin ambient lights to display the main color effects of the screen.

[0072] Exemplarily, the second type of display unit may include a windshield onto which the HUD of the cockpit is projected. The character element special effect data obtained by extracting the video screen elements in step S402 is output to the HUD device, and the special effects are projected onto the windshield according to the special effects data through the HUD device. As the video plays, the character element special effects displayed on the windshield are constantly changing, thereby increasing the fun of watching the movie.

[0073] In one embodiment, as shown in FIG8 , the audio content played by the first display unit can also be obtained, audio features can be extracted based on the audio content, and then the audio features can be output to the control module in the above embodiment, so that the control module can control the display of one or more second-type display units based on the special effect data and the audio features. Exemplarily, the audio content of the video played on the central control screen is obtained, the amplitude, frequency and other features of the audio are extracted from the audio content, and then the amplitude, frequency and other features of the audio are output to the control module of the atmosphere light, which controls the display brightness of the atmosphere light according to the amplitude information of the audio, controls the flashing speed of the atmosphere light according to the frequency information of the audio, and controls the lighting effects of the atmosphere light according to the special effect data, so as to create a tense, fast-paced or soothing atmosphere. Exemplarily, the audio features of the played media are output to the HUD device, which controls the size and / or color of the character image in the projection according to the amplitude information of the audio, and controls the speed of character switching in the projection according to the frequency information of the audio.

[0074] It should be understood that the first display unit can be not only the central control screen, but also the entertainment display screen located in front of the front passenger, or the entertainment display screen located in front of the rear passengers, etc., and this application does not limit it. For example, when the entertainment display screen located in front of the left rear passenger plays a media video, the video image content can be extracted from the display screen, and then processed to obtain special effect data, which can then be output to other display devices (such as the entertainment display screen located in front of the right passenger, ambient light, etc.) to enhance the viewing experience of the rear passengers in the cabin.

[0075] In addition, there are various ways to trigger the cockpit viewing effects of this application. In one embodiment, the cockpit can have a cinema mode. When the user turns on the cinema mode and then uses the car computer to play a video, the cockpit viewing effects are triggered. In another embodiment, the user turns on the cinema mode during the movie viewing process, which triggers the cockpit viewing effects. In some embodiments, there are controls on the video applications used by the user. For example, it is determined whether the video application is a cinema mode application. If it is an application mode application, the cockpit viewing effects can be triggered. The triggering methods mentioned in the above embodiments are only exemplary and do not represent all triggering methods. It should be understood that this application does not impose specific restrictions on the triggering methods, but all methods of triggering this application to achieve the cockpit viewing effects should be included in the scope of this application.

[0076] In addition, the various embodiments described herein may be independent solutions or may be combined according to internal logic, and these solutions all fall within the scope of protection of this application.

[0077] The device provided in the embodiment of the present application is described in detail below with reference to Figure 9. It should be understood that the description of the device embodiment corresponds to the description of the method embodiment, so that for matters not described in detail, reference can be made to the method embodiment above.

[0078] As shown in FIG9 , an embodiment of the present application provides a device for realizing cockpit movie viewing special effects. The device can be applied to the flowcharts shown in FIG4 , FIG5 , and FIG8 to perform the functions in the above method embodiments.

[0079] In one embodiment, the apparatus comprises:

[0080] An acquisition module 901 is configured to acquire video content played by a first display unit, where the first display unit belongs to a first category of display units, which includes one or more display units.

[0081] A processing module 902 is configured to perform effect processing on the video content to obtain special effect data, wherein the special effect data is used to display one or more special effects;

[0082] The output module 903 is configured to output the special effect data to one or more other display units in the first type of display units except the first display unit, so that the one or more other display units display the first special effect according to the special effect data.

[0083] In one embodiment, the effect processing performed by the processing module 902 on the video picture content includes one or more of the following: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.

[0084] In one embodiment, the output module 903 is further configured to output the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.

[0085] In one embodiment, the apparatus further includes a control module 904, and the output module 903 is further configured to output the special effect data to the control module 904, and the control module 904 is configured to control the display of one or more second-type display units according to the special effect data.

[0086] In one embodiment, the acquisition module 901 is also used to acquire the audio content played by the first display unit; the processing module 902 is also used to extract audio features based on the audio content; the output module 903 is also used to output the audio features to the control module 904, so that the control module 904 controls the display of one or more second-type display units according to the special effects data and the audio features.

[0087] In one embodiment, the audio features extracted by the processing module include amplitude and / or frequency.

[0088] Exemplarily, acquisition module 901 and processing module 902 may be computing platform 210 in FIG. 2 , or a processing circuit or processor within computing platform 210. For example, if acquisition module 901 and processing module 902 are processor 211 within computing platform 210, processor 211 may acquire the video content played by the first display unit and may also acquire audio features of the media. Furthermore, processor 211 may perform effects processing on the video content to acquire special effects data and may also extract audio features from the audio content.

[0089] Exemplarily, the output module 903 may be the computing platform 210 in FIG. 2 or a processing circuit or processor in the computing platform 210. For example, if the output module 903 is the processor 212 in the computing platform 210, the processor 212 may output the special effect data to one or more display units other than the first display unit in the first type of display unit, may output the special effect data to the second type of display unit, may output the special effect data to the control module 904, and may output audio features to the control module 904.

[0090] For example, the control module 904 may be the computing platform 210 in FIG2 or a processing circuit or processor in the computing platform 210. For example, if the control module 904 is the processor 213 in the computing platform 210, the processor 213 may control the display of one or more second-type display units based on the input special effect data and audio characteristics.

[0091] The functions implemented by the above-mentioned acquisition module 901, the functions implemented by the processing module 902, the functions implemented by the output module 903, and the functions implemented by the control module 904 can be implemented by different processors respectively, or some functions can be implemented by the same processor, or all functions can be implemented by the same processor. The embodiments of the present application do not limit this.

[0092] All modules of the above devices may be implemented entirely by a processor calling software, or entirely by a hardware circuit, or partially by a processor calling software and the rest by a hardware circuit.

[0093] In an embodiment of the present application, a processor may be a circuit capable of processing signals. In one implementation, the processor may be a circuit capable of reading and executing instructions, such as a CPU, microprocessor, GPU, or DSP. In another implementation, the processor may implement certain functions through the logical relationships of a hardware circuit, where the logical relationships of the hardware circuit are fixed or reconfigurable, such as an ASIC, PLD, FPGA, or a hardware circuit designed for artificial intelligence, such as an NPU, TPU, or DPU. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration can be understood as the process of the processor loading instructions to implement the functions of some or all of the above modules.

[0094] Each module in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.

[0095] In addition, the modules in the above device can be fully or partially integrated together, or can be implemented independently. In one implementation, these modules are integrated together and implemented in the form of a system on a chip (SoC). The SoC may include at least one processor for implementing any of the above methods or implementing the functions of the modules of the device. The type of at least one processor included in the SoC can be different, for example, including a CPU and FPGA, a CPU and an artificial intelligence processor, a CPU and a GPU, etc.

[0096] An embodiment of the present application also provides a device 1000, as shown in Figure 10, the device 1000 includes a processor 1010 and a memory 1020, wherein the memory 1020 is used to store instructions, and the processor 1010 executes the instructions stored in the storage unit 1020 to enable the device to execute the method or steps performed in the above embodiment.

[0097] The present application also provides a display system 200, as shown in FIG2 , which includes a computing platform 210 and a display device 220. The computing platform 210 may include the device 900 or the device 1000. The display device 220 may include a first type of display unit and may also include a second type of display unit.

[0098] An embodiment of the present application further provides a vehicle, which includes any one of the device 900 , the device 1000 , and the display system 200 .

[0099] The embodiment of the present application also provides a chip 1100, as shown in Figure 11, including a processor 1110 and a communication interface 1120, the processor 1110 is used to read instructions to execute the method or steps performed by the above embodiment. The communication interface 1120 is used to communicate with other devices through a transmission medium. In the embodiment of the present application, the communication interface 1120 can be a transceiver, a circuit, a bus, a module or other types of communication interfaces. In the embodiment of the present application, when the communication interface 1120 is a transceiver, the transceiver can include an independent receiver, an independent transmitter, or a transceiver with integrated transceiver functions, or an interface circuit. Exemplarily, the communication interface 1120 can obtain the video screen content played by the first display unit, and can also output the special effect data processed by the processor 1110 to one or more display units in the first type of display unit other than the first display unit. Exemplarily, the communication interface 1120 can obtain the audio content of the first display unit, and can also output the audio features extracted from the audio content to the control module in the above embodiment.

[0100] An embodiment of the present application further provides a computer program product, which includes: computer program code, which enables the computer to execute the above method when the computer program code is run on a computer.

[0101] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a program code. When the computer program code is run on a computer, the computer executes the above method.

[0102] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.

[0103] It should be understood that in the various embodiments of the present application, the size of the serial number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0104] It should be understood that determining B based on A does not mean determining B based solely on A. B can also be determined based on A and / or other information.

[0105] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for realizing special effects of watching movies in a cabin theater, characterized in that: Used in vehicles, including: Acquire video screen content played by a first display unit, where the first display unit belongs to a first type of display unit, and the first type of display unit includes one or more display units; Performing effect processing on the video picture content to obtain special effect data, wherein the special effect data is used to display one or more special effects; The special effect data is output to one or more other display units in the first type of display units except the first display unit, so that the one or more other display units display a first special effect according to the special effect data.

2. The method according to claim 1, characterized in that The processing includes one or more of the following: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: The special effect data is output to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.

4. The method according to claim 3, characterized in that Outputting the special effect data to one or more second-type display units includes: The special effect data is output to a control module, so that the control module controls the display of one or more second-type display units according to the special effect data.

5. The method according to claim 4, characterized in that Also includes: Acquire the audio content played by the first display unit; Extracting audio features according to the audio content; The audio feature is output to the control module, so that the control module controls the display of the one or more second-type display units according to the special effect data and the audio feature.

6. The method according to claim 5, characterized in that The audio characteristics include amplitude and / or frequency.

7. The method according to any one of claims 3 to 6, characterized in that: The second type of display unit includes an ambient light.

8. The method according to claim 7, characterized in that The atmosphere light comprises a first atmosphere light and a second atmosphere light, and the first atmosphere light and the second atmosphere light have different lighting effects.

9. The method according to any one of claims 1 to 8, characterized in that: The first type of display unit includes an image display device.

10. The method according to claim 9, characterized in that The image display device includes the first display unit, and a second display unit and a third display unit, wherein the second display unit and the third display unit have different image special effects.

11. A device, characterized in that: include: An acquisition module, configured to acquire video screen content played by a first display unit, wherein the first display unit belongs to a first type of display unit, and the first type of display unit includes one or more display units; A processing module, used for performing effect processing on the video picture content to obtain special effect data, wherein the special effect data is used to display one or more special effects; An output module is used to output the special effect data to one or more other display units in the first type of display units except the first display unit, so that the one or more other display units display the first special effect according to the special effect data.

12. The device according to claim 11, characterized in that The processing includes one or more of the following: cropping, stretching, blurring, gradient, extracting picture elements, and extracting main colors.

13. The device according to claim 11 or 12, characterized in that The output module is further used to output the special effect data to one or more second-type display units, so that the one or more second-type display units display a second special effect according to the special effect data.

14. The device according to claim 13, characterized in that Also includes a control module, The output module is specifically used to output the special effect data to the control module; The control module is used to receive the special effect data and control the display of one or more second-type display units according to the special effect data.

15. The device according to claim 14, characterized in that Also includes: The acquisition module is also used to acquire the audio content played by the first display unit; The processing module is also used to extract audio features according to the audio content; The output module is also used to output the audio feature to the control module; The control module is specifically configured to control the display of the one or more second-type display units according to the special effect data and the audio characteristics.

16. The device according to claim 15, characterized in that The audio characteristics include amplitude and / or frequency.

17. The device according to any one of claims 13 to 16, characterized in that The second type of display unit includes an ambient light.

18. The device according to claim 17, characterized in that The atmosphere light comprises a first atmosphere light and a second atmosphere light, and the first atmosphere light and the second atmosphere light have different lighting effects.

19. The device according to any one of claims 11 to 18, characterized in that The first type of display unit includes an image display device.

20. The device according to claim 19, characterized in that The image display device includes the first display unit, and a second display unit and a third display unit, wherein the second display unit and the third display unit have different image special effects.

21. A device, characterized in that: The method comprises a processor and a memory, wherein the processor is used to read a computer program stored in the memory to execute the method according to any one of claims 1 to 10.

22. A display system, characterized in that: It includes a computing platform and a display device, the computing platform includes the device as described in any one of claims 11 to 21, the display device includes a first type of display unit, the first type of display unit is used to display a first special effect according to the special effect data output by the computing platform, and the first type of display unit includes one or more display units.

23. The display system according to claim 22, characterized in that: The display device also includes a second type of display unit, which is used to display a second special effect according to the special effect data output by the computing platform, and the second type of display unit includes one or more display units.

24. The display system according to claim 22 or 23, characterized in that: The first type of display unit includes an image display device, and the second type of display unit includes an ambient light.

25. A vehicle, characterized in that: The device comprises the device as claimed in any one of claims 11 to 21 or the display system as claimed in any one of claims 22 to 24.

26. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to execute the method according to any one of claims 1 to 10.

Images