Vehicle cinema mode control method and device, equipment, storage medium and product

Abstract

The invention discloses a vehicle cinema mode control method and device, equipment, a storage medium and a product, and belongs to the technical field of vehicle control. When the playing instruction of the multimedia resource is received, the vehicle environment information is acquired, the display scene is determined based on the vehicle environment information, and the multimedia resource is played on the front windshield through the head-up display system based on the display scene, so that the multimedia resource is directly projected to the front windshield through the head-up display system to be played. The device is reduced, the playing efficiency is improved, and the display scene is matched with the current vehicle environment information, so that the display picture is clearer, and the playing effect of the multimedia resource can be ensured. And the operation of the equipment in the vehicle is automatically controlled based on the equipment operation information corresponding to the vehicle cinema mode, so that the convenience of watching the multimedia resources in the vehicle is improved, that is, when the multimedia resources are played in the vehicle, an immersive vehicle cinema mode is created, and the film watching experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a control method, device, equipment, storage medium and product for a vehicle cinema mode. Background Art

[0002] With the development of automobile technology, automobiles have more and more functions, and users have higher and higher requirements for in-car entertainment. In order to improve user satisfaction with in-car entertainment, the vehicle theater mode came into being. In the vehicle theater mode, the vehicle can play movies, TV series and other multimedia resources. Summary of the invention

[0003] The embodiments of the present application provide a method, device, equipment, storage medium and product for controlling a vehicle cinema mode, which creates an immersive vehicle cinema mode when playing multimedia resources in the vehicle, thereby improving the viewing experience of the user. The technical solution is as follows:

[0004] In one aspect, a method for controlling a vehicle cinema mode is provided, the method comprising:

[0005] In response to receiving a play instruction for a multimedia resource, obtaining vehicle environment information;

[0006] Based on the vehicle environment information, determining a display scene corresponding to the vehicle environment information, the display scene being used to instruct a head-up display system of the vehicle to play at least one of brightness, contrast and color of the multimedia resource;

[0007] Based on the display scene, projecting the multimedia resource onto the front windshield of the vehicle for playback through the head-up display system;

[0008] Determine device operation information corresponding to the vehicle cinema mode, the vehicle comprising a plurality of devices, the device operation information comprising operation parameters of each of the plurality of devices;

[0009] The operations of the plurality of devices are controlled based on the device operation information.

[0010] In some embodiments, the method further comprises:

[0011] Based on the thermal imaging image inside the vehicle, determine the target seat where the occupant is located in the vehicle;

[0012] The step of projecting the multimedia resource onto the front windshield of the vehicle for playing includes:

[0013] Based on the target seat, determining a target area on the front windshield corresponding to the target seat;

[0014] The multimedia resource is projected onto a target area on the front windshield for playback.

[0015] In some embodiments, determining the device operation information corresponding to the vehicle theater mode includes:

[0016] Based on the vehicle environment information, obtaining device operation information corresponding to the vehicle environment information from a plurality of first device operation information, wherein the plurality of first device operation information all correspond to the vehicle cinema mode, and the plurality of first device operation information correspond to different vehicle environment information; or

[0017] Based on the type of the multimedia resource, obtaining device operation information corresponding to the type from a plurality of second device operation information, wherein the plurality of second device operation information all corresponds to the vehicle cinema mode, and the plurality of second device operation information corresponds to different types of multimedia resources; or

[0018] The device operation information corresponding to the last multimedia resource played by the vehicle is determined as the device operation information corresponding to the vehicle theater mode.

[0019] In some embodiments, the method further comprises:

[0020] In response to receiving an instruction to end playing of the multimedia resource, restoring the vehicle to a state before playing the multimedia resource; or,

[0021] In response to receiving an instruction to end playing of a multimedia resource, the operation of multiple devices in the vehicle is controlled based on current vehicle environment information.

[0022] In some embodiments, the method further comprises:

[0023] In response to receiving the playback instruction in the vehicle parking mode, executing the step of acquiring the vehicle environment information;

[0024] In response to receiving the play instruction in the vehicle non-parking mode, a prompt message is output, wherein the prompt message is used to prompt the user that multimedia resources are not allowed to be played during driving and to prompt the user of the parking lot closest to the current vehicle position.

[0025] In some embodiments, the plurality of devices include at least one of an air conditioner, an ambient light, a seat, a speaker, and a scent generator;

[0026] The operating parameters of the air conditioner include at least one of the temperature mode, temperature value, wind speed and wind direction of the air conditioner; the operating parameters of the ambient light include at least one of the light color, light brightness and light mode of the ambient light; the operating parameters of the seat include at least one of the ventilation volume, heating temperature, vibration mode and tilt angle; the operating parameters of the speaker include at least one of the sound effect mode and volume value; the operating parameters of the odor generator include at least one of the odor type and odor concentration.

[0027] In another aspect, a control device for a vehicle cinema mode is provided, the device comprising:

[0028] An acquisition module, configured to acquire vehicle environment information in response to receiving a play instruction for a multimedia resource;

[0029] A determination module, configured to determine a display scene corresponding to the vehicle environment information based on the vehicle environment information, wherein the display scene is used to instruct a head-up display system of the vehicle to play at least one of brightness, contrast and color of the multimedia resource;

[0030] A playback module, configured to project the multimedia resource onto the front windshield of the vehicle for playback through the head-up display system based on the display scene;

[0031] The determination module is further used to determine device operation information corresponding to the vehicle cinema mode, the vehicle includes a plurality of devices, and the device operation information includes operation parameters of each of the plurality of devices;

[0032] A control module is used to control the operation of the multiple devices based on the device operation information.

[0033] In some embodiments, the determining module is further configured to:

[0034] Based on the thermal imaging image inside the vehicle, determine the target seat where the occupant is located in the vehicle;

[0035] The playback module is used to:

[0036] Based on the target seat, determining a target area on the front windshield corresponding to the target seat;

[0037] The multimedia resource is projected onto a target area on the front windshield for playback.

[0038] In some embodiments, the determining module is used to:

[0039] Based on the vehicle environment information, obtaining device operation information corresponding to the vehicle environment information from a plurality of first device operation information, wherein the plurality of first device operation information all correspond to the vehicle cinema mode, and the plurality of first device operation information correspond to different vehicle environment information; or

[0040] Based on the type of the multimedia resource, obtaining device operation information corresponding to the type from a plurality of second device operation information, wherein the plurality of second device operation information all corresponds to the vehicle cinema mode, and the plurality of second device operation information corresponds to different types of multimedia resources; or

[0041] The device operation information corresponding to the last multimedia resource played by the vehicle is determined as the device operation information corresponding to the vehicle theater mode.

[0042] In some embodiments, the apparatus further comprises a recovery module, configured to:

[0043] In response to receiving an instruction to end playing of the multimedia resource, restoring the vehicle to a state before playing the multimedia resource; or,

[0044] In response to receiving an instruction to end playing of a multimedia resource, the operation of multiple devices in the vehicle is controlled based on current vehicle environment information.

[0045] In some embodiments, the apparatus further comprises:

[0046] an execution module, configured to execute the step of acquiring vehicle environment information in response to receiving the playback instruction in a vehicle parking mode;

[0047] The output module is used to output prompt information in response to receiving the playback instruction in the vehicle non-parking mode, wherein the prompt information is used to prompt the user that multimedia resources are not allowed to be played during driving and to prompt the user of the parking lot closest to the current vehicle position.

[0048] In some embodiments, the plurality of devices include at least one of an air conditioner, an ambient light, a seat, a speaker, and a scent generator;

[0049] The operating parameters of the air conditioner include at least one of the temperature mode, temperature value, wind speed and wind direction of the air conditioner; the operating parameters of the ambient light include at least one of the light color, light brightness and light mode of the ambient light; the operating parameters of the seat include at least one of the ventilation volume, heating temperature, vibration mode and tilt angle; the operating parameters of the speaker include at least one of the sound effect mode and volume value; the operating parameters of the odor generator include at least one of the odor type and odor concentration.

[0050] On the other hand, a vehicle controller is provided, which includes a processor and a memory, wherein at least one program code is stored in the memory, and the at least one program code is loaded and executed by the processor to implement the above-mentioned vehicle theater mode control method.

[0051] On the other hand, a computer-readable storage medium is provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor to implement the above-mentioned vehicle theater mode control method.

[0052] On the other hand, a computer program product is provided, wherein the product stores at least one program code, and the at least one program code is used to be executed by a processor to implement the above-mentioned vehicle theater mode control method.

[0053] In an embodiment of the present application, when a playback instruction for multimedia resources is received, vehicle environment information is obtained, a display scene is determined based on the vehicle environment information, and then the multimedia resources are played on the front windshield through the head-up display system based on the display scene. In this way, the multimedia resources are directly projected onto the front windshield for playback through the head-up display system, without the need to arrange screens and other devices in the vehicle. This not only reduces the number of devices and improves the playback efficiency, but also makes the display image clearer because the display scene matches the current vehicle environment information, thereby ensuring the playback effect of the multimedia resources. In addition, the operation of the equipment in the vehicle is automatically controlled based on the equipment operation information corresponding to the vehicle theater mode, without the need for the user to manually adjust each device, thereby improving the convenience of watching multimedia resources in the vehicle. That is, when the method plays multimedia resources in the vehicle, an immersive vehicle theater mode is created, thereby improving the user's viewing experience.

[0054] It is to be understood that the foregoing general description and the following detailed description are exemplary only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] Figure 1 is a schematic diagram of an implementation environment of a method for controlling a vehicle theater mode according to an exemplary embodiment of the present application;

[0056] Figure 2 is a flow chart of a method for controlling a vehicle theater mode shown in an exemplary embodiment of the present application;

[0057] Figure 3 is a schematic diagram of the interaction of multiple devices in a vehicle shown in an exemplary embodiment of the present application;

[0058] Figure 4 is a block diagram of a control device for a vehicle cinema mode shown in an exemplary embodiment of the present application;

[0059] Figure 5 is a block diagram of a vehicle controller according to an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0060] In order to make the technical solutions and advantages of the present application clearer, the implementation methods of the present application are described in further detail below.

[0061] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0062] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions. For example, the vehicle environment information and physiological information involved in this application are all obtained with full authorization.

[0063] Please refer to Figure 1 , which shows a schematic diagram of the implementation environment of the control method of the vehicle theater mode shown in an exemplary embodiment of the present application; the implementation environment includes a vehicle controller (central control host), a central control screen, a microphone, a vehicle controller, a body controller, an air-conditioning controller and an amplifier controller, etc. Among them, the body controller is used to control various devices in the car, including windows, sunshades, ambient lights, fragrances, etc. The air-conditioning controller is used to control the air conditioner, negative ion generator, etc. in the car. The power amplifier controller is used to control the speakers in the car, etc. Among them, the central control screen and the microphone are used to receive user instructions and send the instructions to the vehicle controller, and the vehicle controller is used to send instructions to the vehicle controller, the body controller, the air-conditioning controller and the power amplifier controller, etc., so that these controllers control the operation of the corresponding devices.

[0064] The vehicle controller is used to project the multimedia resource onto the front windshield through the head-up display system for playback upon receiving a multimedia resource playback instruction; and to control the operation of multiple devices in the vehicle based on the device operation information corresponding to the vehicle theater mode, so that the vehicle environment is in the vehicle theater mode to play the multimedia resource. The vehicle in the embodiment of the present application may be a new energy vehicle or a fuel vehicle; the new energy vehicle includes a pure electric vehicle or a hybrid vehicle.

[0065] Please refer to Figure 2 , which shows a flow chart of a method for controlling a vehicle theater mode according to an exemplary embodiment of the present application, wherein the method is performed by a vehicle controller. Figure 2 , the method comprising:

[0066] Step 201: In response to receiving a play instruction for a multimedia resource, a vehicle controller obtains vehicle environment information.

[0067] In the embodiment of the present application, the multimedia resources may be videos, pictures, and texts. Videos may be movies, TV series, animations, and the like. Vehicle environment information refers to the environment information outside the vehicle, including weather information, light information, air humidity, road images, and the like. Vehicle environment information may be obtained through cameras, light sensors, temperature sensors, humidity sensors, and the like.

[0068] In an embodiment of the present application, a user can trigger the playback instruction of multimedia resources through the vehicle's central control screen, through a microphone, and by voice, or through a terminal connected to the vehicle (such as a mobile phone).

[0069] Optionally, a plurality of multimedia resources may be displayed on the central control screen, and in response to a selection operation on any multimedia resource, the vehicle controller determines that a play instruction for the multimedia resource has been received. Any multimedia resource may be selected by a trigger operation of the user or by a voice instruction of the user.

[0070] Optionally, the central control screen displays multiple multimedia resources in the cinema mode state. Among them, the central control screen has a soft switch for the vehicle cinema mode. In response to the triggering operation of the soft switch, the central control screen sends an opening instruction to the vehicle controller, and the central control screen is displayed in the cinema mode state, which makes it convenient for the user to select any multimedia resource for playback. When the central control screen is in the cinema mode state, the user can control the previous song, next song, pause, mute, and volume through the multi-function steering wheel. Furthermore, the central control screen can also be controlled by voice, such as the user sends a voice request to the vehicle controller through a microphone, and the request is used to request that the central control screen be displayed in the cinema mode state.

[0071] In some embodiments, brief information about the vehicle cinema mode is also displayed on the central control screen.

[0072] Among them, after the user selects any multimedia resource, in response to the confirmation operation of the selected multimedia resource, the vehicle controller confirms that the playback instruction of the multimedia resource has been received, and the vehicle enters the vehicle theater mode.

[0073] It should be noted that multimedia resources are only allowed to be played when the vehicle is in parking mode, which also includes the following implementation methods: in response to receiving a playback instruction in the vehicle parking mode, the vehicle controller executes the step of acquiring vehicle environment information; in response to receiving a playback instruction in the vehicle non-parking mode, the vehicle controller outputs a prompt message, and the prompt message is used to prompt the user that multimedia resources are not allowed to be played during driving and prompt the user to the parking lot closest to the current vehicle position.

[0074] When the vehicle gear is in P gear, it is determined that the vehicle is in parking mode. In this embodiment, multimedia resources are allowed to be played only in the vehicle parking mode, ensuring driving safety. In addition, when a play instruction is received in the vehicle non-parking mode, the user is prompted and the nearest parking lot is prompted, which improves the integrity of the interaction and facilitates the user to quickly find a parking lot, thereby improving the user experience.

[0075] It should be noted that multimedia resources are allowed to be played only when the vehicle's entire circuit is connected, that is, when the vehicle's power key is in the ON position. Similarly, when the power key is not in the ON position, a prompt message is output, and the prompt message is used to prompt that the power key is not in the ON position. That is, when a play command is received, if the multimedia resource's play conditions are not met, that is, the play fails, the failure reason is prompted, so that the user can handle it in time, so that the vehicle meets the multimedia resource's play conditions.

[0076] In some embodiments, in order to ensure that multimedia resources can be played normally, in response to receiving a playback instruction for the multimedia resources, the vehicle controller also detects the battery level of the vehicle, and when the battery level is less than a preset level, it also outputs a prompt message, which is used to prompt the user that the current battery level is low and to prompt the user of the charging place closest to the current vehicle position.

[0077] Step 202: The vehicle controller determines a display scene corresponding to the vehicle environment information based on the vehicle environment information, where the display scene is used to instruct the head-up display system of the vehicle to play at least one of brightness, contrast and color of multimedia resources.

[0078] Optionally, different display scenes are set in advance for different vehicle environment information. The above process of determining the display scene based on the vehicle environment information is to determine the display scene corresponding to the vehicle environment information from a plurality of display scenes based on the vehicle environment information.

[0079] Optionally, the multiple display scenes include a rainy day display scene, a sunny day display scene, a foggy day display scene, a snowy day display scene, etc. In the multiple display scenes, at least one of brightness, contrast, and color of the head-up display system is different.

[0080] Step 203: The vehicle controller projects the multimedia resources onto the front windshield of the vehicle for playback through the head-up display system based on the display scene.

[0081] Among them, the Head Up Display (HUD), also known as the head-up display system, is a photoelectric display device that can project current speed, navigation and other information onto the windshield, forming an image in front of the glass. The driver can see the navigation and speed information without turning or lowering his head.

[0082] Furthermore, the head-up display system of the present application is an augmented reality head-up display system (AR-HUD), which can project digital images and information onto the windshield and integrate them with the real driving environment. It has a larger field of view and a longer imaging distance, higher clarity, and can provide navigation, safety tips, entertainment information and other content.

[0083] In some embodiments, the vehicle controller directly projects the multimedia resources onto the entire front windshield for playback; or, the vehicle controller projects the multimedia resources onto the middle area of ​​the front windshield for playback; or, the vehicle controller determines the projection position based on the position of the members. The process includes the following steps.

[0084] The vehicle controller determines the target seat where the occupant is located based on the thermal imaging image inside the vehicle; accordingly, the process in which the above-mentioned vehicle controller projects multimedia resources onto the front windshield of the vehicle for playback includes the following steps: the vehicle controller determines the target area on the front windshield corresponding to the target seat based on the target seat; and projects the multimedia resources onto the target area on the front windshield.

[0085] For example, if the target seat is the left driver's seat, the multimedia resources are projected to the left area of ​​the front windshield for playback. If the target seat is the right passenger seat, the multimedia resources are projected to the right area of ​​the front windshield for playback. If the target seat is a rear seat, the multimedia resources are projected to the middle area of ​​the front windshield for playback. If there are multiple target seats, that is, multiple occupants, the multimedia resources are projected to the middle area of ​​the front windshield for playback, or the multimedia resources are projected to the entire front windshield for playback.

[0086] Furthermore, the vehicle controller also determines the size of the projection area of ​​the multimedia resource based on the target seat. When the target seat is the front seat, the first projection size is determined as the size of the projection area of ​​the multimedia resource; when the target seat is the back seat, the second projection size is determined as the size of the projection area of ​​the multimedia resource. The second projection size is larger than the first projection size. In this way, when the occupant is in the front row, the multimedia resource is projected in a smaller size, and when the occupant is in the back row, the multimedia resource is projected in a larger size, so that the projection size matches the position of the occupant.

[0087] It should be noted that in the above embodiments, the example of projecting multimedia resources onto the front windshield for playback through the head-up display system is used for explanation. In other embodiments, the multimedia resources can also be projected onto other windshields for playback through the head-up display system. The process is the same as above and will not be repeated here.

[0088] Among them, projecting multimedia resources onto the front windshield for playing means entering the vehicle theater mode, and accordingly, determining the operation information of the in-vehicle equipment to control the in-vehicle equipment to operate in the vehicle theater mode.

[0089] Step 204: The vehicle controller determines device operation information corresponding to the vehicle cinema mode, the vehicle includes a plurality of devices, and the device operation information includes respective operation parameters of the plurality of devices.

[0090] The multiple devices include at least one of an air conditioner, an ambient light, a seat, a speaker, and an odor generator. The operating parameters of the air conditioner include at least one of the temperature mode, temperature value, wind speed, and wind direction of the air conditioner; the operating parameters of the ambient light include at least one of the light color, light brightness, and light mode of the ambient light; the operating parameters of the seat include at least one of the ventilation volume, heating temperature, vibration mode, and tilt angle; the operating parameters of the speaker include at least one of the sound effect mode and volume value; the operating parameters of the odor generator include at least one of the odor type and odor concentration.

[0091] In the above embodiment, multiple devices including air conditioners, ambient lights, seats, speakers and odor generators are used as an example for description, and the multiple devices may also include car windows, sunshade lights, ceiling lights, etc.

[0092] In some embodiments, the above-mentioned vehicle controller determines the equipment operation information corresponding to the vehicle theater mode, including the following implementation methods.

[0093] First, the vehicle controller obtains device operation information corresponding to the vehicle environment information from multiple types of first device operation information based on the vehicle environment information, the multiple types of first device operation information all correspond to the vehicle cinema mode, and the multiple types of first device operation information correspond to different vehicle environment information.

[0094] In the embodiment of the present application, a plurality of first device operation information corresponds to different vehicle environment information, and the vehicle environment information includes weather information, light information, air humidity, air temperature, road image, etc., and different first device operation information corresponds to different at least one of the weather information, light information, air humidity, air temperature, road image, etc. Since the first device operation information includes operation parameters of a plurality of devices, optionally, the operation parameters of at least one device in the different first device operation information are different.

[0095] Second, the vehicle controller obtains device operation information corresponding to the type from a plurality of second device operation information based on the type of multimedia resources, and the plurality of second device operation information all correspond to the vehicle cinema mode, and the plurality of second device operation information correspond to different types of multimedia resources.

[0096] In the embodiment of the present application, a plurality of second device operation information corresponds to different types of multimedia resources, and different second device operation information corresponds to different at least one of weather information, lighting information, air humidity, air temperature, road image, etc. Since the second device operation information includes operation parameters of a plurality of devices, optionally, the operation parameters of at least one device in different second device operation information are different.

[0097] Among them, the types of multimedia resources can be various types such as feature films, art films, news documentaries, science and education films, westerns, musicals, science fiction films, comedies, romance films, etc.

[0098] Among them, different device operation information is determined in advance for different types of multimedia resources, and then when playing any type of multimedia resources, the corresponding device operation information is directly determined based on the type of multimedia resources, thereby improving convenience and efficiency.

[0099] In a third method, the vehicle controller determines the device operation information corresponding to the last multimedia resource played by the vehicle as the device operation information corresponding to the vehicle cinema mode.

[0100] In an embodiment of the present application, the vehicle has a power-off memory function, that is, the device operation information corresponding to the last multimedia resource played will be stored for easy use next time.

[0101] Among them, the device operation information corresponding to the last multimedia resource played by the vehicle can be manually set by the user, or determined based on information such as vehicle operation information or the type of multimedia resources, and is not specifically limited here.

[0102] A fourth type: the vehicle controller obtains physiological information of the occupant, and determines device operation information corresponding to the physiological information from a plurality of third device operation information based on the physiological information.

[0103] Among them, the physiological information of the occupants includes the occupants' body temperature, heart rate, blood pressure, etc. For example, the temperature of the air conditioner and the heating temperature of the seat can be determined based on the occupants' body temperature. The vibration frequency of the seat and the rhythm of the ambient light can be determined based on the occupants' heart rate.

[0104] Fifth type: the vehicle controller obtains the power level of the vehicle, and determines the device operation information corresponding to the power level from a plurality of fourth device operation information based on the power level.

[0105] Optionally, the plurality of fourth device operation information all correspond to the vehicle theater mode. For example, the fourth device operation information is divided into two types, the first type corresponds to a power level not less than a preset power level, and the second type corresponds to a power level less than a preset power level. Accordingly, the first type of device operation information corresponds to a high power consumption mode of the device, and the second type of device operation information corresponds to a low power consumption mode of the device.

[0106] Step 205: The vehicle controller controls the operation of multiple devices based on the device operation information.

[0107] In an embodiment of the present application, the vehicle controller sends the operating parameters of each device in the device operating information to the controllers of each device respectively, and each controller controls the operation of each device.

[0108] Among them, the vehicle controller sends an instruction carrying the operating parameters of the sound effect to the power amplifier controller, and the power amplifier controller turns on the sound effect based on the operating parameters in the instruction. The vehicle controller sends an instruction carrying the operating parameters of the air conditioner and the odor generator (fragrance) to the air conditioning controller, and the air conditioning controller turns on the air conditioner and the odor generator based on the operating parameters in the instruction, and further puts the air conditioner in AUTO (automatic) gear and turns on the air purification function. The vehicle controller sends an instruction carrying the operating parameters of the ambient light, sunshade, window, and seat to the body controller, and the body controller turns on the ambient light, closes the sunshade and window, and adjusts the seat based on the operating parameters in the instruction. For example, please refer to Figure 3 , which shows an interaction flow chart of multiple devices in a vehicle shown in an exemplary embodiment of the present application.

[0109] It should be noted that when the vehicle controller controls the operation of the device based on the device operation information, the user can also manually adjust the operating parameters of any device.

[0110] In the embodiment of the present application, in the vehicle theater mode, the vehicle controller can automatically control the operation of multiple devices in the vehicle, and the user can also manually set the parameters of the seats, sound effects, air conditioning, fragrance, sunshades, windows, etc. When any device is not set successfully, a pop-up window is displayed on the central control screen, and the device that is not set successfully is displayed in the pop-up window without affecting the opening of the vehicle theater mode.

[0111] In some embodiments, in the vehicle theater mode, the device operation information can also be periodically updated, and then the operation of multiple devices can be controlled based on the updated device operation information.

[0112] Wherein, in the case where the device operation information is determined based on the vehicle environment information, the vehicle controller periodically obtains the vehicle environment information to update the device operation information based on the vehicle environment information. In the case where the device operation information is determined based on the physiological information of the occupant, the vehicle controller periodically obtains the physiological information of the occupant to update the device operation information based on the physiological information. In the case where the device operation information is determined based on the power of the vehicle, the power of the vehicle is periodically obtained to update the device operation information based on the power of the vehicle.

[0113] In other embodiments, the device operation information may also be updated according to the content of the multimedia resource so that the device operation information matches the content of the multimedia resource. The vehicle controller obtains the visual information and audio information of the multimedia resource, and obtains the operation parameters of each device that match the visual information and audio information from the operation parameter library of each device based on the visual information and audio information.

[0114] The vehicle controller determines the scene currently displayed by the multimedia resource based on the visual information and the audio information. The scene can be various scenes such as rainy days, snowy days, dinner parties, sports, beautiful scenery, etc., and the operation parameter library of each device includes operation parameters corresponding to various scenes. For each device, the operation parameters corresponding to the scene currently displayed by the multimedia resource in the operation parameter library are determined as the operation parameters of the device.

[0115] It should be noted that the serial numbers of the above steps 202-203 and steps 204-205 are only for convenience of description and are not used to limit the execution order of the two. For example, steps 202-203 and steps 204-205 can be executed simultaneously.

[0116] It should be noted that the user may end the viewing process of the multimedia resource, or may exit the vehicle theater mode after the multimedia resource is played.

[0117] In some embodiments, the vehicle controller is also capable of receiving an instruction to end playback of a multimedia resource, and adjusts the state of the vehicle based on the instruction to end playback, including the following two implementation methods: in response to receiving an instruction to end playback of a multimedia resource, the vehicle controller restores the vehicle to the state before playing the multimedia resource; or, in response to receiving an instruction to end playback of a multimedia resource, the vehicle controller controls the operation of multiple devices in the vehicle based on current vehicle environment information.

[0118] Here, restoring the vehicle to the state before playing the multimedia resource means restoring the operating state of each device to the state before playing the multimedia resource. If the window is open before playing the multimedia resource, the window is opened in response to the end playback instruction.

[0119] It should be noted that the end playback instruction can be input by the user through the voice controller, by triggering the central control screen, or by a preset gesture.

[0120] In an embodiment of the present application, when a playback instruction for multimedia resources is received, vehicle environment information is obtained, a display scene is determined based on the vehicle environment information, and then the multimedia resources are played on the front windshield through the head-up display system based on the display scene. In this way, the multimedia resources are directly projected onto the front windshield for playback through the head-up display system, without the need to arrange screens and other devices in the vehicle. This not only reduces the number of devices and improves the playback efficiency, but also makes the display image clearer because the display scene matches the current vehicle environment information, thereby ensuring the playback effect of the multimedia resources. In addition, the operation of the equipment in the vehicle is automatically controlled based on the equipment operation information corresponding to the vehicle theater mode, without the need for the user to manually adjust each device, thereby improving the convenience of watching multimedia resources in the vehicle. That is, when the method plays multimedia resources in the vehicle, an immersive vehicle theater mode is created, thereby improving the user's viewing experience.

[0121] Please refer to Figure 4 , which shows a block diagram of a control device for a vehicle theater mode shown in an exemplary embodiment of the present application. The device includes:

[0122] The acquisition module 401 is used to acquire vehicle environment information in response to receiving a play instruction for a multimedia resource;

[0123] A determination module 402, configured to determine a display scene corresponding to the vehicle environment information based on the vehicle environment information, wherein the display scene is used to indicate at least one of brightness, contrast and color of a multimedia resource played by a head-up display system of the vehicle;

[0124] The playback module 403 is used to project the multimedia resources onto the front windshield of the vehicle for playback through the head-up display system based on the display scene;

[0125] The determination module 402 is further used to determine the device operation information corresponding to the vehicle cinema mode, the vehicle includes a plurality of devices, and the device operation information includes the operation parameters of the plurality of devices respectively;

[0126] The control module 404 is used to control the operation of multiple devices based on the device operation information.

[0127] In some embodiments, the determination module 402 is further configured to:

[0128] Based on the thermal imaging image inside the vehicle, determine the target seat where the occupant is located in the vehicle;

[0129] The playback module 403 is used to:

[0130] Based on the target seat, determining a target area on the front windshield corresponding to the target seat;

[0131] Project multimedia resources onto the target area on the front windshield for playback.

[0132] In some embodiments, the determination module 402 is configured to:

[0133] Based on the vehicle environment information, obtaining device operation information corresponding to the vehicle environment information from a plurality of first device operation information, wherein the plurality of first device operation information all corresponds to a vehicle cinema mode, and the plurality of first device operation information corresponds to different vehicle environment information; or

[0134] Based on the type of multimedia resources, device operation information corresponding to the type is obtained from a plurality of second device operation information, wherein the plurality of second device operation information all corresponds to the vehicle cinema mode, and the plurality of second device operation information corresponds to different types of multimedia resources; or

[0135] The device operation information corresponding to the last multimedia resource played by the vehicle is determined as the device operation information corresponding to the vehicle theater mode.

[0136] In some embodiments, the apparatus further comprises a recovery module for:

[0137] In response to receiving an instruction to end playing of the multimedia resource, restoring the vehicle to a state before playing the multimedia resource; or,

[0138] In response to receiving an instruction to end playing of a multimedia resource, the operation of multiple devices in the vehicle is controlled based on current vehicle environment information.

[0139] In some embodiments, the apparatus further comprises:

[0140] an execution module, configured to execute a step of acquiring vehicle environment information in response to receiving a play instruction in a vehicle parking mode;

[0141] The output module is used to output prompt information in response to receiving a play instruction in a non-parking mode of the vehicle, wherein the prompt information is used to prompt the user that multimedia resources are not allowed to be played during driving and to prompt the user of the parking lot closest to the current vehicle position.

[0142] In some embodiments, the plurality of devices include at least one of an air conditioner, an ambient light, a seat, a speaker, and a scent generator;

[0143] The operating parameters of the air conditioner include at least one of the temperature mode, temperature value, wind speed and wind direction of the air conditioner; the operating parameters of the ambient light include at least one of the light color, light brightness and light mode of the ambient light; the operating parameters of the seat include at least one of the ventilation volume, heating temperature, vibration mode and tilt angle; the operating parameters of the speaker include at least one of the sound effect mode and volume value; the operating parameters of the odor generator include at least one of the odor type and odor concentration.

[0144] In the embodiment of the present application, when receiving a playback instruction for multimedia resources, the vehicle environment information is obtained, the display scene is determined based on the vehicle environment information, and then the multimedia resources are played on the front windshield through the head-up display system based on the display scene. In this way, the multimedia resources are directly projected onto the front windshield for playback through the head-up display system, and there is no need to arrange screens and other devices in the car. This not only reduces the number of devices and improves the playback efficiency, but also makes the display picture clearer because the display scene matches the current vehicle environment information, thereby ensuring the playback effect of the multimedia resources. In addition, the operation of the equipment in the vehicle is automatically controlled based on the equipment operation information corresponding to the vehicle theater mode, without the need for the user to manually adjust each device, thereby improving the convenience of watching multimedia resources in the car. That is, when the solution plays multimedia resources in the car, it creates an immersive vehicle theater mode, thereby improving the user's viewing experience.

[0145] It should be noted that the control device for the vehicle theater mode provided in the above embodiment only uses the division of the above functional modules as an example when controlling the vehicle theater mode. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the vehicle controller is divided into different functional modules to complete all or part of the functions described above. In addition, the control device for the vehicle theater mode provided in the above embodiment and the control method embodiment of the vehicle theater mode belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0146] Please refer to Figure 5 , Figure 5The structural block diagram of a vehicle controller 500 provided by an exemplary embodiment of the present application is shown. The vehicle controller 500 may be a portable mobile vehicle controller, such as a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), a laptop computer or a desktop computer. The vehicle controller 500 may also be referred to as a user device, a portable vehicle controller, a laptop vehicle controller, a desktop vehicle controller, or other names.

[0147] Typically, the vehicle controller 500 includes a processor 501 and a memory 502 .

[0148] The processor 501 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 501 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 501 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 501 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 501 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0149] The memory 502 may include one or more computer-readable storage media, which may be non-transitory. The memory 502 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 502 is used to store at least one program code, which is used to be executed by the processor 501 to implement the operation performed by the vehicle controller in the control method of the vehicle theater mode provided in the method embodiment of the present application.

[0150] In some embodiments, the vehicle controller 500 may also optionally include: a peripheral device interface 503 and at least one peripheral device. The processor 501, the memory 502 and the peripheral device interface 503 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 503 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 504, a display screen 505, a camera assembly 506, an audio circuit 507 and a power supply 508.

[0151] The peripheral device interface 503 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 501 and the memory 502. In some embodiments, the processor 501, the memory 502, and the peripheral device interface 503 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 501, the memory 502, and the peripheral device interface 503 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0152] The radio frequency circuit 504 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 504 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 504 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 504 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 504 can communicate with other vehicle controllers through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: the World Wide Web, a metropolitan area network, an intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 504 may also include circuits related to NFC (Near Field Communication), which is not limited in this application.

[0153] The display screen 505 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 505 is a touch display screen, the display screen 505 also has the ability to collect touch signals on the surface or above the surface of the display screen 505. The touch signal can be input to the processor 501 as a control signal for processing. At this time, the display screen 505 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 505 can be one, set on the front panel of the vehicle controller 500; in other embodiments, the display screen 505 can be at least two, respectively set on different surfaces of the vehicle controller 500 or in a folding design; in other embodiments, the display screen 505 can be a flexible display screen, set on the curved surface or folding surface of the vehicle controller 500. Even, the display screen 505 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 505 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode, organic light-emitting diode).

[0154] The camera assembly 506 is used to capture images or videos. Optionally, the camera assembly 506 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the vehicle controller, and the rear camera is arranged on the back of the vehicle controller. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 506 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0155] The audio circuit 507 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 501 for processing, or input them into the radio frequency circuit 504 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there can be multiple microphones, which are respectively arranged at different parts of the vehicle controller 500. The microphone can also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 501 or the radio frequency circuit 504 into sound waves. The speaker can be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 507 may also include a headphone jack.

[0156] The power supply 508 is used to power various components in the vehicle controller 500. The power supply 508 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 508 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged through a wired line, and a wireless rechargeable battery is a battery that is charged through a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0157] In some embodiments, the vehicle controller 500 further includes one or more sensors 509 , including but not limited to: an acceleration sensor 510 , a gyroscope sensor 511 , a pressure sensor 512 , an optical sensor 513 , and a proximity sensor 514 .

[0158] The acceleration sensor 510 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the vehicle controller 500. For example, the acceleration sensor 510 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 501 can control the display screen 505 to display the user interface in a horizontal view or a vertical view based on the gravity acceleration signal collected by the acceleration sensor 510. The acceleration sensor 510 can also be used to collect game or user motion data.

[0159] The gyro sensor 511 can detect the body direction and rotation angle of the vehicle controller 500, and the gyro sensor 511 can cooperate with the acceleration sensor 510 to collect the user's 3D actions on the vehicle controller 500. Based on the data collected by the gyro sensor 511, the processor 501 can implement the following functions: motion sensing (such as changing the UI based on the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

[0160] The pressure sensor 512 can be set on the side frame of the vehicle controller 500 and / or the lower layer of the display screen 505. When the pressure sensor 512 is set on the side frame of the vehicle controller 500, it can detect the user's grip signal of the vehicle controller 500, and the processor 501 performs left and right hand recognition or shortcut operation based on the grip signal collected by the pressure sensor 512. When the pressure sensor 512 is set on the lower layer of the display screen 505, the processor 501 controls the operability controls on the UI interface based on the user's pressure operation on the display screen 505. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0161] The optical sensor 513 is used to collect the ambient light intensity. In one embodiment, the processor 501 can control the display brightness of the display screen 505 based on the ambient light intensity collected by the optical sensor 513. Specifically, when the ambient light intensity is high, the display brightness of the display screen 505 is increased; when the ambient light intensity is low, the display brightness of the display screen 505 is reduced. In another embodiment, the processor 501 can also dynamically adjust the shooting parameters of the camera component 506 based on the ambient light intensity collected by the optical sensor 513.

[0162] The proximity sensor 514, also called a distance sensor, is usually disposed on the front panel of the vehicle controller 500. The proximity sensor 514 is used to collect the distance between the user and the front of the vehicle controller 500. In one embodiment, when the proximity sensor 514 detects that the distance between the user and the front of the vehicle controller 500 is gradually decreasing, the processor 501 controls the display screen 505 to switch from the screen-on state to the screen-off state; when the proximity sensor 514 detects that the distance between the user and the front of the vehicle controller 500 is gradually increasing, the processor 501 controls the display screen 505 to switch from the screen-off state to the screen-on state.

[0163] Those skilled in the art will understand that Figure 5 The structure shown in the figure does not constitute a limitation on the vehicle controller 500, and the vehicle controller 500 may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0164] The embodiment of the present application also provides a computer-readable storage medium, in which at least one program code is stored, and the at least one program code is loaded and executed by a processor to implement the control method of the vehicle theater mode described in any of the above implementations. Optionally, the storage medium can be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium can be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, etc.

[0165] An embodiment of the present application also provides a computer program product, which stores at least one program code, and the at least one program code is loaded and executed by a processor to implement the control method of the vehicle theater mode shown in the above embodiments.

[0166] In some embodiments, the computer program product involved in the embodiments of the present application may be deployed and executed on a vehicle controller, or on multiple vehicle controllers located at one location, or on multiple vehicle controllers distributed at multiple locations and interconnected by a communication network. Multiple vehicle controllers distributed at multiple locations and interconnected by a communication network may constitute a blockchain system.

[0167] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0168] The above description is only for the purpose of facilitating those skilled in the art to understand the technical solution of the present application and is not intended to limit the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A method for controlling a vehicle cinema mode, characterized in that: The method comprises: In response to receiving a play instruction for a multimedia resource, obtaining vehicle environment information; Based on the vehicle environment information, determining a display scene corresponding to the vehicle environment information, the display scene being used to instruct a head-up display system of the vehicle to play at least one of brightness, contrast and color of the multimedia resource; Based on the display scene, projecting the multimedia resource onto the front windshield of the vehicle for playback through the head-up display system; Determine device operation information corresponding to the vehicle cinema mode, the vehicle comprising a plurality of devices, the device operation information comprising operation parameters of each of the plurality of devices; The operations of the plurality of devices are controlled based on the device operation information.

2. The method according to claim 1, characterized in that: The method further comprises: Based on the thermal imaging image inside the vehicle, determine the target seat where the occupant is located in the vehicle; The step of projecting the multimedia resource onto the front windshield of the vehicle for playing includes: Based on the target seat, determining a target area on the front windshield corresponding to the target seat; The multimedia resource is projected onto a target area on the front windshield for playback.

3. The method according to claim 1, characterized in that The determining of the device operation information corresponding to the vehicle cinema mode includes: Based on the vehicle environment information, obtaining device operation information corresponding to the vehicle environment information from a plurality of first device operation information, wherein the plurality of first device operation information all correspond to the vehicle cinema mode, and the plurality of first device operation information correspond to different vehicle environment information; or Based on the type of the multimedia resource, obtaining device operation information corresponding to the type from a plurality of second device operation information, wherein the plurality of second device operation information all corresponds to the vehicle cinema mode, and the plurality of second device operation information corresponds to different types of multimedia resources; or The device operation information corresponding to the last multimedia resource played by the vehicle is determined as the device operation information corresponding to the vehicle theater mode.

4. The method according to claim 1, characterized in that: The method further comprises: In response to receiving an instruction to end playing of the multimedia resource, restoring the vehicle to a state before playing the multimedia resource; or, In response to receiving an instruction to end playing of a multimedia resource, the operation of multiple devices in the vehicle is controlled based on current vehicle environment information.

5. The method according to claim 1, characterized in that The method further comprises: In response to receiving the playback instruction in the vehicle parking mode, executing the step of acquiring the vehicle environment information; In response to receiving the play instruction in the vehicle non-parking mode, a prompt message is output, wherein the prompt message is used to prompt the user that multimedia resources are not allowed to be played during driving and to prompt the user of the parking lot closest to the current vehicle position.

6. The method according to claim 1, characterized in that The plurality of devices include at least one of an air conditioner, an ambient light, a seat, a speaker, and a scent generator; The operating parameters of the air conditioner include at least one of the temperature mode, temperature value, wind speed and wind direction of the air conditioner; the operating parameters of the ambient light include at least one of the light color, light brightness and light mode of the ambient light; the operating parameters of the seat include at least one of the ventilation volume, heating temperature, vibration mode and tilt angle; the operating parameters of the speaker include at least one of the sound effect mode and volume value; the operating parameters of the odor generator include at least one of the odor type and odor concentration.

7. A control device for a vehicle cinema mode, characterized in that: The device comprises: An acquisition module, configured to acquire vehicle environment information in response to receiving a play instruction for a multimedia resource; A determination module, configured to determine a display scene corresponding to the vehicle environment information based on the vehicle environment information, wherein the display scene is used to instruct a head-up display system of the vehicle to play at least one of brightness, contrast and color of the multimedia resource; A playback module, configured to project the multimedia resource onto the front windshield of the vehicle for playback through the head-up display system based on the display scene; The determination module is further used to determine device operation information corresponding to the vehicle cinema mode, the vehicle includes a plurality of devices, and the device operation information includes operation parameters of each of the plurality of devices; A control module is used to control the operation of the multiple devices based on the device operation information.

8. A vehicle controller, characterized in that: The vehicle controller includes a processor and a memory, wherein at least one program code is stored in the memory, and the at least one program code is loaded and executed by the processor to implement the vehicle cinema mode control method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: At least one program code is stored in the storage medium, and the at least one program code is loaded and executed by the processor to implement the vehicle theater mode control method according to any one of claims 1 to 6.

10. A computer program product, characterized in that The product stores at least one program code, and the at least one program code is used to be executed by a processor to implement the vehicle theater mode control method as described in any one of claims 1 to 6.

Images