Vehicle cabin control method and device, electronic equipment, vehicle and storage medium

Abstract

The invention provides a vehicle cabin control method and device, electronic equipment, a vehicle and a storage medium. The control method of the vehicle cabin is applied to the vehicle, and the vehicle comprises at least one of playing equipment used for playing media streams and somatosensory equipment related to a target environment scene and somatosensory of a user. The method comprises the following steps: in response to an opening instruction for opening a target environment scene, obtaining a media stream related to the target environment scene; the media stream comprises a cutting frame of each image frame and a split-track audio; and controlling the cutting frame and the split-track audio to be played in each playing device, and linking the motion sensing device to work at the same time. Thus, by using the playing device and the somatosensory device, the cockpit can be effectively utilized, the multi-mode function of the cockpit can be achieved, and good somatosensory experience such as auditory sense and visual sense is brought to a user.

Description

Technical Field

[0001] The present invention relates to the field of vehicle control technology, and in particular to a vehicle cockpit control method, device, electronic equipment, vehicle and storage medium. Background Art

[0002] The cockpit trend of modern vehicles is moving towards the Internet. The vehicle cockpit has the ability to integrate human-computer interaction, network services, and scenario expansion of users, on-board equipment and cockpit environment, providing drivers and passengers with a limited mobile space with a comprehensive experience of safety, intelligence, efficiency and pleasure.

[0003] Therefore, how to effectively utilize the on-board equipment in the cockpit to provide users with a good auditory and visual experience has become a technical problem that needs to be solved urgently. Summary of the Invention

[0004] The present application provides an improved vehicle cabin control method, device, electronic device, vehicle and storage medium.

[0005] The present application provides a vehicle cabin control method, which is applied to a vehicle, wherein the vehicle includes: a playback device for playing a media stream, and at least one of a somatosensory device associated with a target environment scene and a somatosensory device associated with a user; the method includes:

[0006] In response to an opening instruction for opening the target environment scene, obtaining a media stream related to the target environment scene; the media stream includes cropped frames of each image frame and track-by-track audio;

[0007] The cropped frame and the split-track audio are controlled to be played in each playback device while the somatosensory device is linked to work.

[0008] Furthermore, the sub-track audio includes default audio and / or custom audio;

[0009] The acquiring of the media stream related to the target environment scene includes:

[0010] In response to an adjustment instruction to adjust the default audio, a customized audio related to a target environment scene is obtained to replace the default audio.

[0011] Furthermore, the sub-track audio includes default audio and / or custom audio;

[0012] The acquiring of the media stream related to the target environment scene includes:

[0013] Displaying a replacement entry for replacing the default audio;

[0014] In response to a selection instruction for selecting the replacement entry, calling the selected replacement entry to obtain the custom audio;

[0015] Use the custom audio to replace the default audio.

[0016] Furthermore, the displaying of a replacement entry for replacing the default audio includes: simultaneously displaying a plurality of replacement entries for replacing the default audio;

[0017] and / or,

[0018] The displaying of a replacement entry for replacing the default audio includes:

[0019] According to the priority order of multiple replacement entries, starting from the highest priority level, the current replacement entries with higher priority are displayed first;

[0020] In response to a selection instruction for selecting a replacement entry, calling the selected replacement entry includes:

[0021] In response to a selection instruction for performing a next selection on the current replacement entry, a next replacement entry is displayed according to a priority order of the multiple replacement entries; the next replacement entry is a replacement entry adjacent to the higher priority and lower than the higher priority.

[0022] Furthermore, the replacement entry includes multiple replacement entries; the priority order of the multiple replacement entries is the replacement entry corresponding to the local audio library, the replacement entry corresponding to the AI ​​and the local networking page.

[0023] Furthermore, the linking of the somatosensory device to operate includes:

[0024] Detecting whether the somatosensory device has custom parameters associated with the target environment scene;

[0025] If not, the somatosensory device is linked to operate according to the default parameters associated with the target environment scene;

[0026] If so, the somatosensory device is linked to work according to the custom parameters.

[0027] Furthermore, in response to an opening instruction for opening the target environment scene, obtaining a media stream related to the target environment scene includes:

[0028] In response to an opening instruction for opening the target environment scene, determining the number of the playback devices to be opened and the installation positions of the playback devices in the vehicle;

[0029] Acquire a media stream corresponding to the target environment scene, having the same number of channels as the opened number and the same clipping direction as the installation position;

[0030] The controlling the cropped frame and the track audio to be played on each playback device includes:

[0031] The cropped frames of each media stream are played on each playback device according to the installation position, and the divided track audio is played on each playback device.

[0032] The present application provides a vehicle cabin control device, which is applied to a vehicle, wherein the vehicle comprises: a playback device for playing a media stream, and at least one of a somatosensory device associated with a target environment scene and a somatosensory device associated with a user; the device comprises:

[0033] a media stream acquisition module, configured to acquire a media stream related to the target environment scene in response to an opening instruction for opening the target environment scene; the media stream includes cropped frames of each image frame and track audio; the track audio includes default audio and / or custom audio;

[0034] The linkage control module is used to control the playback of the cropped frame and the split-track audio in each playback device while linking the somatosensory device to work.

[0035] The present application provides a vehicle, comprising one or more processors, for implementing the method as described in any one of the above items.

[0036] The present application provides an electronic device, comprising one or more processors, for implementing any of the methods described above.

[0037] The present application provides a computer-readable storage medium having a program stored thereon. When the program is executed by a processor, the method described in any one of the above items is implemented.

[0038] The present application provides a computer program product, comprising a computer program / instruction, which implements any of the above methods when executed by a processor.

[0039] In some embodiments, the vehicle cockpit control method of the present application works in conjunction with a somatosensory device while the media stream is turned on. This somatosensory device is used to meet the user's somatosensory needs. In this way, using a playback device and a somatosensory device, the cockpit can be effectively utilized to realize the multimodal functions of the cockpit, bringing users a good auditory and visual experience. In this way, multi-sensory multi-modal multimedia interaction is utilized to utilize audio and visual experiences such as music and animation in a limited space to create a charming and visually appealing cockpit for users. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 Shown is a flow chart of a vehicle cabin control method provided by an embodiment of the present application;

[0041] Figure 2 Flowchart showing the playback of cropped frames and split-track audio on various playback devices in the vehicle cabin control method provided by an embodiment of the present application;

[0042] Figure 3 Shown Figure 1 Schematic diagram of each playback device of the vehicle cockpit control method shown;

[0043] Figure 4 Shown Figure 1 A schematic diagram of the flow of media stream playback of the vehicle cockpit control method shown;

[0044] Figure 5 Shown Figure 1 A schematic diagram of a specific flow chart of data execution in the vehicle cockpit control method shown;

[0045] Figure 6 Schematic diagram of the structure of a vehicle cabin control device provided by an embodiment of the present application;

[0046] Figure 7 Shown is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with one or more embodiments of this specification. Rather, they are merely examples of apparatuses and methods consistent with certain aspects of one or more embodiments of this specification, as detailed in the appended claims.

[0048] It should be noted that in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the method may include more or fewer steps than those described in this specification. In addition, a single step described in this specification may be broken down into two or more steps for description in other embodiments; and two or more steps described in this specification may be combined into a single step for description in other embodiments.

[0049] An embodiment of the present application provides a vehicle cabin control method, applicable to a vehicle. The vehicle may include, but is not limited to, a playback device for playing a media stream, and at least one of a somatosensory device associated with a target environment scene and a user's somatosensory experience. The somatosensory device is used to meet the user's somatosensory needs. These playback devices and / or somatosensory devices that are linked to the target environment scene and associated with the user's somatosensory experience are all in-vehicle devices linked to the target environment scene, thereby enabling multimodal interaction with the target environment scene.

[0050] Figure 1 Shown is a flow chart of a method for controlling a vehicle cabin according to an embodiment of the present application.

[0051] like Figure 1 As shown, the vehicle cabin control method may include but is not limited to the following steps 101 to 102:

[0052] Step 101 : In response to an opening instruction for opening a target environment scene, a media stream related to the target environment scene is obtained; the media stream includes cropped frames of each image frame and track-based audio.

[0053] It should be noted that the vehicle's environmental scene is used to indicate the state of adjusting multiple vehicle settings and the parameters of the desired environmental scene to a specific environmental scene in the fewest possible times. The parameters of the desired environmental scene include, for example, the temperature, humidity, smell, color, volume, and display content (also known as images). This allows users to use the vehicle according to their desired environmental scene without having to adjust it separately each time, saving time and effort. The vehicle's environmental scene in this article may include, but is not limited to, at least one environmental scene. This article may also include: obtaining an environmental scene selected by the user from the vehicle's environmental scenes as the target environmental scene. The following selection method is used to obtain the environmental scene selected by the user from the vehicle's environmental scenes: 1. Receiving an environmental scene icon selected by the user through screen input (such as a manual click by the user); 2. Receiving a user voice command (if the vehicle supports voice control); 3. Based on preset trigger conditions, such as detecting keywords in the user's voice.

[0054] Step 102 : Control the cropped frames and the track-split audio to play in each playback device while linking the somatosensory device to work.

[0055] In the embodiment of the present application, while the media stream is being activated, the somatosensory device operates in conjunction with the user's somatosensory needs. Thus, by using the playback device and the somatosensory device, the cockpit can be effectively utilized to realize the multimodal functionality of the cockpit, providing the user with a good auditory and visual experience. This multisensory, multimodal multimedia interaction allows for audio and visual experiences such as music and animation within a confined space, creating a captivating and visually engaging cockpit for the user.

[0056] The cockpit multimodality in this article refers to technology that integrates multiple human senses such as vision, hearing, and smell, uses multiple channels such as images, audio, and smell for input, and fully simulates a more realistic interaction between the vehicle's target environment scene and people.

[0057] Figure 2 The flowchart shown is a flow chart of the playback of cropped frames and split-track audio in various playback devices in the vehicle cabin control method according to an embodiment of the present application.

[0058] Combine Figure 1 and Figure 2 As shown, the above step 101 can be implemented by the following steps 110 to 120. The above step 102 of controlling the cropped frame and the track audio to be played in each playback device can be implemented by the following step 130:

[0059] Step 110 : In response to an opening instruction for opening the target environment scene, determining the number of opened playback devices.

[0060] The above-mentioned opening instruction in response to opening the target environment scene is used to indicate the playback conditions of the media stream related to the target environment scene that currently meets the target environment scene of the vehicle.

[0061] Combine Figure 2 As shown, in the above step 110, at least one of the following optional examples is adopted in response to the opening instruction for opening the target environment scene:

[0062] In a first optional example, a soft switch instruction for displaying a media stream related to a target environment scene is received from a playback device. The playback device may include a display screen. The soft switch may include, but is not limited to, a screen button on the display screen, such as a screen touch button.

[0063] Furthermore, at least one environmental scene of at least one vehicle is displayed via a playback device. If a touch operation received by a touch indicator corresponding to the at least one environmental scene of the vehicle is a touch operation to select a target environmental scene, at least one environmental scene indicator indicating the selected scene is displayed; the selected environmental scene indicator is determined as the target environmental scene. The environmental scene indicator is used to display the environmental scene of each vehicle. The touch indicator corresponding to the at least one environmental scene of the vehicle is used to indicate the environmental scene information of the vehicle.

[0064] In a second optional example, a voice instruction is received; the voice instruction includes content for displaying a media stream related to a target environment scene.

[0065] In a third optional example, the voice inside the vehicle cabin is detected in real time, and the voice is parsed to determine whether it contains content for displaying the target environment scene.

[0066] Step 120: Obtain media streams corresponding to the target environment scene and having the same number of channels as the number of channels opened, based on the number of channels opened. Each media stream includes: cropped frames obtained by cropping each image frame of the audio or video to be played.

[0067] In step 120, all cropped frames of each image frame from each media stream are stitched together to form a nearly complete frame. This document requires that the complete frame be formed with minimal loss. Even if there is some loss, without loss of significant information in the image frame, this is considered normal cropping loss. As long as this loss does not significantly affect the user's experience and does not cause significant loss of information in the image frame, it falls within the scope of protection of the embodiments of this application.

[0068] The above-mentioned target environmental scenes may include but are not limited to at least one of an environmental ecosystem mode, a cosmic star scene mode and a life scene mode.

[0069] The environmental ecosystem mode may include, but is not limited to, at least one of a flower scene mode, a water scene mode, and a forest scene mode. The water scene mode may include, but is not limited to, at least one of an ocean scene mode, a lake decompression scene, a water rafting scene, and a rain scene mode. The cosmic star scene mode may include, but is not limited to, a cloud and moon scene mode. The life scene mode may include, but is not limited to, a relaxation scene and a daily life scene. The relaxation scene may include, but is not limited to, at least one of a muscle relaxation scene, a body scan scene, and a cloud relaxation scene.

[0070] Step 130 : Play the media streams and sub-track audios of each channel on each playback device accordingly.

[0071] The above-mentioned media stream includes video data. The video data may include but is not limited to animated videos related to the target environment scene, such as dynamic wallpapers and / or renderings.

[0072] In this method, when the vehicle's playback conditions for media streams related to the target environment scene are met, media streams corresponding to the target environment scene, with the same number of channels as the number of open playback devices within the vehicle-mounted device linked to the target environment scene, are obtained and played on each playback device. Each media stream includes: cropped frames obtained by cropping each image frame of the audio or video to be played. In this way, by playing the cropped media streams on each playback device of the vehicle-mounted device, a good audio and visual experience is provided to the user.

[0073] Figure 3 Shown Figure 2Schematic diagram of each playback device of the vehicle cabin control method shown.

[0074] like Figure 3 and Figure 2 As shown, the above step 110 may further include but is not limited to determining the number of playback devices opened and the installation position of the playback devices in the vehicle in response to the opening instruction for opening the target environment scene. Correspondingly, the above step 130 may further include but is not limited to playing the cropped frames of each media stream on each playback device according to the installation position, and playing the split-track audio on each playback device. Among them, the playback device can be a device for playing audio and video. The playback device may also include an audio device for playing audio and a display device for playing video. For example, each number of media streams is displayed on each playback device respectively. The installation positions of the above-mentioned playback devices are respectively installed around at least one of the top of the cabin, the middle of the cabin and the front of the cabin in the vehicle.

[0075] It should be noted that the number of open channels may include but is not limited to 1 or more than 2. Accordingly, if the number of open channels is 1, i.e., 1 playback device, the number of media streams is 1. The above step 130 may further include: playing the 1-channel media stream on one playback device.

[0076] In example 1, if only one playback device is enabled, the media stream is played on that device alone. In example 2, if only one playback device is enabled, the media stream is played on that device alone and linked to the in-vehicle device in the target environment scenario.

[0077] If two or more playback devices are enabled for linked playback, it is equivalent to the user being in the cockpit, with all the playback devices around them playing in sync. All the cropped frames of each image frame of each media stream are spliced ​​together to form a complete frame, bringing an immersive audio and visual experience. Correspondingly, if the number of enabled devices is two or more, that is, two or more playback devices, then the media stream is one, and the above step 130 can further include: playing the two or more media streams on the two or more playback devices. Among them, two or more includes two.

[0078] For example, if you have two or more playback devices open, you can link them together to play each media stream, and then link them to the in-vehicle devices in the target environment. This allows you to play each media stream on multiple screens. For another example, if you have two or more playback devices open, you can link them together to play each media stream. This allows you to link multiple in-vehicle devices.

[0079] Continue to see Figure 3As shown, the playback device of the vehicle cockpit control method is used to play media streams. The playback device may include but is not limited to a DIM (Driver Information Monitor, also known as an instrument panel), a CSD (Central Screen Display, also known as a main screen), a screen installed near the vehicle's armrest console, a rear screen, and at least one of a PSD (Passenger Seat Display, also known as a co-pilot screen) installed in front of the co-pilot of the vehicle. The rear screen may include a ceiling screen installed in the ceiling area of ​​the cockpit and located above between the front seats and the rear seats, and / or a TV (Television Screen) screen on the backside of the backrest. The co-pilot screen provides independent information display and interactive functions for the co-pilot passenger.

[0080] Of course, the playback device may not be limited to these five screens. For example, the playback device may also include but is not limited to a HUD (Head-Up Display), an armrest screen installed in the middle armrest position of the vehicle seat, a backrest screen detachably or fixedly installed behind the front seat backrest, a detachable screen and at least one of a smart surface.

[0081] The HUD, mounted above the vehicle's center console and near the front windshield, can be adjusted in angle and height to accommodate different driver heights and sitting postures. Rear-mounted HUDs include either suspended or dashboard-mounted versions. Suspended HUDs are fixed to the sun visor above the driver, projecting information onto the area above the windshield. Dashboard-mounted HUDs are fixed to the center console in front of the driver, projecting information onto the area in front of the windshield.

[0082] The aforementioned smart surface is a technology that allows for the integration of screens into CMF (Color-Material-Finish) materials anywhere in the vehicle, tailored to user needs. Smart surface technology integrates electronic functionality into vehicle interior CMF surfaces, such as leather, fabric, wood, glass, plastic, natural fiber, and metal. Activated through touch sensing, gestures, or voice commands, it enables functions such as information display, intelligent control, and ambient lighting, providing users with a more intelligent and personalized experience. Of course, other playback devices capable of playing media streams also fall within the scope of protection of the embodiments of this application and will not be listed here.

[0083] These playback devices are already installed and positioned at the factory or when used by the user. Each playback device has a fixed installation location within the vehicle. Thus, each playback device has a fixed installation location relative to the entire vehicle, and any playback device is fixed in its installation location relative to other playback devices within the vehicle. This allows the image frame to be cropped based on the cropping direction and the installation location of each playback device.

[0084] Furthermore, when one or more playback devices are turned on, the turned-on playback device is used to play the media stream. Thus, based on the installation location of the playback device, a media stream that matches the cropping direction is determined or a media stream that matches the installation location is temporarily cropped. See below for details.

[0085] Figure 4 Shown Figure 2 The figure shows a flow chart of media stream playback in a vehicle cockpit control method.

[0086] like Figure 4 As shown, the above method may further include but not limited to step 111. Accordingly, the above step 120 may include but not limited to step 121, and the above step 130 may include but not limited to step 131:

[0087] Step 111: Determine the installation location of the playback device in the vehicle. This step 111 may be performed before step 110 or after step 110 and before step 120, and will not be described in detail here.

[0088] The number of playback devices opened in this article is one or more (including two).

[0089] Step 121 : According to the open quantity, obtain a media stream with the same number of channels as the open quantity and the same cutting direction as the installation position.

[0090] Step 131 : Play each media stream on each playback device according to the installation location.

[0091] The cropping direction herein may include but is not limited to cropping in the left-right direction, such as one or more of left-right cropping and left-center-right cropping.

[0092] In this regard, in Example 1, according to the media stream cropped left and right, and determining that the installation position of the target display device is a left or right position, the media stream corresponding to the left part when cropping is displayed in the target display device relatively to the left of the target display device, and the media stream corresponding to the right part when cropping is displayed in the target display device relatively to the right of the target display device.

[0093] Example 2, compared with the above Example 1, differs in that: according to the media stream cropped from left to center to right, and it is determined that the installation position of the target display device is the left to center to right position, the media stream corresponding to the left part during cropping is displayed in the target display device relatively to the left of the target display device; the media stream corresponding to the middle part during cropping is displayed in the target display device relatively to the center of the target display device; and the media stream corresponding to the right part during cropping is displayed in the target display device relatively to the right of the target display device.

[0094] The cutting direction herein may include but is not limited to cutting in the up-down direction, such as one or more of up-down cutting and up-middle-down cutting.

[0095] In this regard, in example one, according to the media streams cropped up and down, and determining that the installation position of the target display device is an upper and lower position, the media stream corresponding to the upper side will be displayed in the target display device relatively above the target display device, and the media stream corresponding to the lower side will be displayed in the target display device relatively below the target display device.

[0096] Example 2, compared with the above-mentioned Example 1, differs in that: according to the media stream cropped at the top, middle and bottom, and the installation position of the target display device is determined to be the top, middle and bottom position, the media stream corresponding to the upper part during cropping is displayed in the target display device relatively above the target display device; the media stream corresponding to the middle part during cropping is displayed in the target display device relatively in the middle of the target display device; and the media stream corresponding to the lower part during cropping is displayed in the target display device relatively below the target display device.

[0097] Combine Figures 2 to 4 As shown, the above step 120 may adopt at least any one of the following methods to obtain the above media stream:

[0098] In a first optional embodiment, according to the number of openings, media streams with the same number of paths as the number of openings are obtained from the pre-cut and generated preset number of media streams. Furthermore, media streams with the same number of paths as the number of openings can be obtained from the pre-cut and generated preset number of media streams; these media streams are matched one by one with the playback device to determine the media stream that ultimately needs to be played, so that each media stream is matched with the playback device. The matching content includes the matching between the cutting direction and the installation position of the target playback position. In this way, the media stream can be cut in advance, and when it is played as required by the playback device, the corresponding media stream can be obtained in a timely manner, and the media stream can be quickly obtained.

[0099] To this end, this article can adopt the following method to generate a preset number of media streams; pre-crop each image frame of the media stream according to the preset number of paths to generate cropped frames after cropping each image frame of the preset number of media streams; all cropped frames of each image frame of the preset number of media streams are spliced ​​to form a complete frame.

[0100] The aforementioned pre-cropping of each image frame of the media stream according to a preset number of paths to generate cropped frames of each image frame of the preset number of media streams includes: pre-cropping each image frame of the media stream according to a preset number of paths in different cropping directions to generate cropped frames of each image frame of the preset number of media streams. In this way, cropping can be performed quickly and in advance, facilitating more efficient subsequent use of the media stream.

[0101] In one cropping example, each image frame of the media stream is pre-cropped in different cropping directions according to the number of preset paths and the installation location of each playback device, generating cropped frames after each image frame of the preset path of the media stream is cropped. This pre-cropped media stream can be more precisely cropped for each playback device.

[0102] In this regard, when using media streams, the aforementioned method of obtaining a media stream with the same number of channels as the number of channels opened from a pre-cropped media stream with a preset number of channels may include, but is not limited to, obtaining a media stream with a cropping direction corresponding to the installation location and the same number of channels as the number of channels opened from a pre-cropped media stream with a preset number of channels, based on the number of channels opened and the installation location of each playback device. In this manner, a media stream with a cropping direction corresponding to the installation location and the same number of channels as the number of channels opened can be directly obtained from a pre-cropped media stream with a preset number of channels, in a timely and rapid manner.

[0103] It should be noted that the preset number of channels is used to indicate the number of channels that have been pre-cropped according to cropping requirements. For example, if one channel needs to be cropped in advance, the preset number of channels is 1, that is, the media stream before cropping, also known as the original audio and video.

[0104] For example, if you need to crop more than two channels in advance, the preset number of channels is set to more than two. Each image frame of the original audio or video will be pre-cropped into more than two cropped frames. Furthermore, the cropping is performed in advance according to different cropping directions. The cropping directions are used to correspond to the installation positions of the various display devices. With this agreed-upon method, the specific cropping method is used for playback on the specific playback device.

[0105] The aforementioned cropping directions may include, but are not limited to, at least one of a left-right cropping direction, an up-down cropping direction, a left-center-right cropping direction, an up-center-down cropping direction, an up-down-left-center cropping direction, an up-down-left-center cropping direction, an up-down-left-center cropping direction, a down-down-left-center cropping direction, an up-down-left-center cropping direction, and an up-down-right-center cropping direction. Of course, any combination of these cropping directions is also possible. As long as the loss of the original media stream is minimized as much as possible and any cropping direction that can be played on a playback device falls within the scope of protection of the embodiments of the present application.

[0106] In another cropping example, each image frame of the media stream is pre-cropped in different cropping directions according to the preset number of paths and the usage of each playback device, generating cropped frames after cropping each image frame of the preset number of paths of media stream. In this way, even media streams with the same number of paths can contain media streams with different cropping directions. The usage mode is used to indicate that one playback device is turned on for use or that two or more playback devices are turned on for use. The usage mode may include but is not limited to a single mode or a combination mode. In this way, the media stream to be played can be cropped in advance according to the combination mode of the playback devices, and the cropping is more refined, which can facilitate subsequent quick application.

[0107] In this regard, when using media streams, obtaining a media stream with the same number of channels as the number of channels opened from a pre-cropped and generated media stream with a preset number of channels according to the number of channels opened may include, but is not limited to: obtaining a media stream with a cropping direction corresponding to the usage mode and the same number of channels as the number of channels opened from a pre-cropped and generated media stream with a preset number of channels according to the number of channels opened and the usage mode of the playback device, such as single mode or combined mode. In this way, a media stream with a cropping direction corresponding to the usage mode and the same number of channels as the number of channels opened can be directly obtained from a pre-cropped and generated media stream with a preset number of channels in a timely and rapid manner.

[0108] In a second optional embodiment, each image frame of the media stream is cropped in real time according to the number of openings, to generate media streams with the same number of channels as the number of openings.

[0109] Combine Figure 1 As shown in this article, the in-vehicle devices linked to the target environment scenario can have pre-set default parameter data or can adjust these default parameter data to custom parameter data based on user needs. This custom parameter data is used to represent personalized needs and is personalized data. These default parameter data and custom parameter data are also called elements of the target environment scenario.

[0110] In this regard, this article can use the default parameter data of the target environment scene, or adjust part or all of the default parameter data, such as adding parameter data, deleting parameter data, and changing at least one of the parameter data to obtain customized parameter data of the target environment scene, and subsequently use the customized parameter data of the target environment scene.

[0111] This somatosensory device may include, but is not limited to, at least one of functional fragrances, air conditioning, lighting components, and seats. The lighting components may include, but are not limited to, at least one of ambient lighting and lighting. Each in-vehicle device can support a single modality. By integrating at least one in-vehicle device with the playback device within the in-vehicle device, multimodal cockpit functionality can be achieved. Furthermore, by leveraging multisensory and multimodal multimedia interaction, audio and visual experiences such as music and animation can be combined within a confined space to create a captivating and visually engaging cockpit for the user.

[0112] Next, the parameters of the vehicle-mounted device linked to the target environment scene may include but are not limited to default parameters and custom parameters; the method of the embodiment of the present application may also include but is not limited to: obtaining the vehicle-mounted device linked to the adjusted target environment scene in the following manner: step 1) and step 2):

[0113] Step 1) receiving an adjustment instruction for adjusting default parameter data of an onboard device linked to an adjustable target environment scene;

[0114] Step 2) According to the adjustment instruction, the default parameter data is adjusted to generate the adjusted parameter data as the custom parameter data; and / or, according to the adjustment instruction, information is added or deleted to the custom parameter to generate the custom parameter data.

[0115] Adjusting the default parameter data according to the adjustment instruction to generate the adjusted parameter data as the customized parameter data may include the following first and third steps: first, verifying whether the adjustment operation of the default parameter data adjusted by the adjustment instruction complies with the specification. Second, if the adjustment operation complies with the specification, adjusting the default parameter data according to the adjustment operation to obtain the adjusted parameter data as the customized parameter data. Third, if the adjustment operation does not comply with the specification, refusing to adjust the default parameter data.

[0116] Based on this, Figure 5 In the second optional embodiment shown, the above method may further include but is not limited to steps 210 to 230:

[0117] Step 210: Check whether the vehicle-mounted device has the custom parameter data set by the user last time. Step 220: If it is detected that the vehicle-mounted device does not have the custom parameter data, execute the default parameter data set by the vehicle-mounted device. Step 230: If it is detected that the vehicle-mounted device has the custom parameter data, execute the custom parameter data. The custom parameter data set by the user last time is used to represent the adjusted custom parameter data. For example, a selection instruction is received from the user to select the vehicle-mounted device linked to the target environment scene. If the above selection instruction is received, the above step 210 is executed, that is, to check whether the vehicle-mounted device has the custom parameter data set by the user last time.

[0118] Prior to step 210, the method further includes receiving a user instruction to adjust an in-vehicle device associated with the target environment scenario. If the instruction is received, alternative portals for adjusting the in-vehicle device are displayed. If the user selects an portal from the alternative portals, the selected alternative portal is invoked to obtain adjustment content, and the adjustment is performed using the adjustment content. These adjustment contents are also referred to as elements.

[0119] The adjustment content may represent any content related to and adjustable for each vehicle-mounted device. For example, the adjustment content may include, but is not limited to, at least one of parameter data for a functional fragrance, parameter data for an air conditioner, parameter data for a seat, and parameter data for a lighting assembly.

[0120] To address this, a pre-installed audio source entry category recognition algorithm must be deployed locally within the vehicle's onboard computer to distinguish between alternative audio source entries. After the local system boots up and receives user input, the algorithm identifies the user's selected alternative entry. Using this selected entry, the corresponding resource is called to obtain the adjustment content, which is then used to make adjustments.

[0121] Combine Figure 1 As shown, the track audio includes default audio and / or custom audio. Accordingly, the acquisition of the media stream related to the target environment scene in the above step 101 can be implemented in at least one of the following optional implementation methods:

[0122] In a first optional implementation, in response to an adjustment instruction for adjusting the default audio, a custom audio related to the target environment scene is obtained to replace the default audio. In this way, the custom audio can be directly obtained and the default audio replacement can be performed efficiently.

[0123] In a second optional implementation, (1) a replacement entry for replacing the default audio is displayed. (2) In response to a selection instruction for selecting a replacement entry, the selected replacement entry is called to obtain the custom audio. (3) The custom audio is used to replace the default audio. In this way, the user's desired custom audio can be selected based on each replacement entry, thereby increasing the diversity and autonomy of user customization.

[0124] The above step (1) may further include simultaneously displaying multiple replacement entries for replacing the default audio, so that the user can easily select and replace the audio.

[0125] Based on this, in a first optional embodiment, in step 1, if an adjustment instruction is received from the user for adjusting the media stream related to the target environment scene, a replacement entrance for replacing the material is displayed. In step 2, if a selection instruction is received from the user to select a replacement entrance from the replacement entrance, the selected replacement entrance is called to obtain the custom material. The material may include but is not limited to audio and / or video for replacement. In step 3, the default audio is replaced with the custom audio in the custom material. The above-mentioned default audio includes one or more of the audio data. In this way, the user is immersed in the media stream formed by each cropped frame. See below for detailed description.

[0126] In a second alternative embodiment, in step 1, if a user receives an adjustment instruction for adjusting the sub-track audio data of the target environment scene, a replacement entry for replacing the sound source of the sub-track audio data is displayed. In step 2, if a user receives a selection instruction for selecting a replacement entry from the replacement entry, the selected replacement entry is called to obtain the replacement audio. In step 3, the sub-track audio data is replaced with the replacement audio.

[0127] The replacement entry may include but is not limited to at least one of a replacement entry corresponding to AI (Artificial Intelligence), a replacement entry corresponding to a local network, and a replacement entry corresponding to a local database.

[0128] In this article, at least one of the following optional methods can be used to call the selected replacement entry to obtain the replacement audio:

[0129] In the first option, if the selected replacement entry corresponds to the AI's replacement entry, the AI's page is called; the AI ​​page receives the user's input replacement command and obtains the replacement audio. In this way, the music material engine and cockpit generated by AI and the local sound source library are combined, and the signal transmission is carried out through AI technology content generation, giving users application capabilities and enhancing the user's differentiated cockpit experience, solving the shortcomings of the related technology of single data source and relatively limited content.

[0130] To do this, a sound source category recognition algorithm must be pre-deployed on the vehicle's onboard computer to distinguish between custom parameter data and default parameter data, and to store user input information and the corresponding custom parameter data. After the local system is started, upon receiving user input, the sound source category recognition algorithm determines whether custom parameter data or default parameter data is required as the target information. Based on this target information, some elements of the target environment scene are generated. The material corresponding to the target environment scene is obtained, and the corresponding material and some elements are combined to generate the control cabin parameters.

[0131] Furthermore, the user input information may include, but is not limited to, a replacement instruction input by the user. The AI ​​page receives the user's replacement instruction, which then searches the AI ​​database to obtain the user's desired replacement audio. The replacement instruction indicates the user's desired audio (also referred to as the replacement audio). This replacement instruction may include, for example, text and / or voice content.

[0132] Example 1: This article describes a scenario in which a user, using text or voice input within a target environment, generates audio for the corresponding target environment in the cabin. For example, while parked, a user might voice-command the vehicle's head unit, "I want the feeling of a spring day at the seaside, with warm sunshine and a gentle sea breeze." The head unit then generates the audio source for the corresponding target environment. Here, a matching audio source for the aforementioned speech can be used as the audio source. Alternatively, the audio source can be at least one audio source most relevant to the aforementioned speech.

[0133] Example 2: Using AI-generated sound sources, combined with the target environment scene from the corresponding multimodal cockpit data, an accurate rendering of the effect, ambient light color, air conditioning temperature and air volume, and seat temperature and air volume, is found. For example, while parked and resting, a user can voice-command the vehicle's computer, "I want the feeling of a spring day at the beach, with warm sunshine and a gentle sea breeze." The computer then generates a sound source for the corresponding target environment scene and converts the image into an animated seaside scene. The air conditioning automatically adjusts the temperature, windshield, and air flow mode. The ambient light, in conjunction with the hardware, generates visual colors that match the target environment scene.

[0134] In a second optional manner, if the selected replacement entry is a replacement entry corresponding to the local network, the local network page is called; and the replacement instruction input by the user is received through the local network page to obtain the replacement audio.

[0135] In a third optional manner, if the selected replacement entry is a replacement entry corresponding to the local database, the local audio library is called; and the audio selected by the user from the local audio library is received as the replacement audio.

[0136] One of the above-mentioned first optional method, the above-mentioned second optional method and the third optional method is performed alone or in combination of two or more.

[0137] The local database is used to store at least one of an audio source and a video associated with each target environment scene. In some embodiments, if the selected replacement entry corresponds to a replacement entry in the local database, calling the local audio library may include, but is not limited to: if the selected replacement entry corresponds to a replacement entry in the local database, calling the audio source corresponding to the target environment scene in the local audio library. This direct search and call of the corresponding audio source based on the target environment scene can reduce the user's need to sift through large amounts of data in the local audio library.

[0138] The local database may include, but is not limited to, a local audio source library and / or local image material data. Example 1: The system user herein can utilize a locally preset built-in audio material library (also referred to as a local audio material library) to help the user generate user-defined audio by combining audio sources from the local audio material library. Furthermore, in conjunction with the cabin sound field adjustment function, the system allows the user to customize the position and sound control of audio source elements, providing various preset interactive needs.

[0139] Example 2: Through the combination of AI and the local audio material library, a sound source is generated, and the corresponding target environment scene of the multimodal data of the cockpit is matched to find the corresponding renderings and the color of the ambient light, the temperature and air volume of the air conditioner, the temperature and air volume of the seat, etc. For example: When the user is parked and resting, he or she inputs the voice input to the vehicle's computer, "I want the feeling of being at the seaside in spring, with warm sunshine and a gentle sea breeze." The vehicle's computer generates the sound source of the corresponding target environment scene and generates animation information of the seaside from the picture; the air conditioner automatically adjusts the temperature, windshield and blowing mode; the ambient light cooperates with the hardware to generate visual colors that match the target environment scene.

[0140] In other embodiments, if the selected replacement entry corresponds to a replacement entry in the local database, calling the local audio library may include, but is not limited to: if the selected replacement entry corresponds to a replacement entry in the local database, determining the target environment scene, calling all audio sources in the local audio library, and prioritizing the audio sources corresponding to the target environment scene, displaying them before the remaining audio sources. All audio sources include the audio sources corresponding to the target environment scene as well as all other audio sources excluding those corresponding to the target environment scene. This not only facilitates user selection based on priority recommendations but also increases user selectivity.

[0141] In this specific example, the sound source associated with the flower scene mode includes, but is not limited to, windy audio.

[0142] The sound sources associated with the water scene mode include, but are not limited to, the audio of water movement. Furthermore, the sound sources associated with the ocean scene mode include, for example, the audio of waves crashing. The sound sources associated with the rain scene mode include, for example, the audio of rain.

[0143] The sound sources associated with the above-mentioned cosmic star scene mode include, but are not limited to, ethereal music.

[0144] The sound sources associated with the above-mentioned life scene modes include, but are not limited to, audio with rhythm, object movement and / or object collision.

[0145] The above step (1) may further include, but is not limited to: according to the priority order of the multiple replacement entries, starting from the highest priority level, preferentially displaying the current replacement entry with a higher priority. The above step (2) may further include, but is not limited to, responding to: a selection instruction for the next step selection for the current replacement entry, displaying the next replacement entry according to the priority order of the multiple replacement entries; the next replacement entry is the replacement entry adjacent to the higher priority and lower than the higher priority. In this way, the replacement entries are recommended in sequence according to the priority set in advance by the user, displayed in sequence, and recommended to the user, thereby improving the user experience.

[0146] The replacement entry includes multiple replacement entries; the priority order of the multiple replacement entries is the replacement entry corresponding to the local audio library, the replacement entry corresponding to the AI, and the local network page. In this way, local audio can be used quickly and conveniently.

[0147] In a third optional embodiment, it is detected whether the playback device has the custom parameter data of the streaming media set by the user last time;

[0148] Correspondingly, if it is detected that the playback device does not have the customized parameter data of the streaming media, the default parameter data of the streaming media set by the vehicle-mounted device is executed;

[0149] If it is detected that the playback device has custom parameter data of the streaming media, the custom parameter data of the streaming media is executed.

[0150] Combine Figure 2 As shown, in this third optional embodiment, the process may be performed before step 110 or step 120, as long as the audio and video to be played can be obtained in time before the media stream is acquired. Detailed limitation is not made here.

[0151] In an embodiment of the present application, after the user generates audio corresponding to the target environment scene through AI-generated audio or a local audio material library, the user can use sound field control and individual sound source element component control to adjust the changes in the sound field of the current sound source element component in the entire cabin, thereby enhancing the three-dimensional spatial sense of the entire cabin.

[0152] In addition, during the playback process of the various media streams corresponding to the audio and video to be played, the playback device can play each media stream individually or in conjunction with each other, or it can be used in conjunction with other in-vehicle devices other than the playback device, such as somatosensory devices.

[0153] Combine Figure 1 As shown, the operation of linking the somatosensory device in step 102 may include, but is not limited to: 1) detecting whether the somatosensory device has customized parameters associated with the target environment scene. 2) If not, linking the somatosensory device to operate according to the default parameters associated with the target environment scene. 3) If yes, linking the somatosensory device to operate according to the customized parameters. In this way, the parameter data of the somatosensory device can be adjusted to meet user needs.

[0154] Furthermore, the above step 1) may include but is not limited to the following step [1]; the above step 2) may include but is not limited to the following step [2]; and the above step 3) may include but is not limited to the following step [3]:

[0155] [1] If the user interface corresponding to the somatosensory device is opened, the somatosensory device is detected to see whether the somatosensory device has the custom parameter data set by the user last time. [2] If the somatosensory device is detected to have the custom parameter data, the default parameter data set for the somatosensory device is executed. [3] If the somatosensory device is detected to have the custom parameter data, the custom parameter data of the somatosensory device is executed. In this way, the parameter data of the somatosensory device can be adjusted to meet the user's needs.

[0156] In the first example, when the user interface for a functional fragrance linked to a target environment scenario is opened, the user checks whether the functional fragrance has previously set custom parameter data. If so, the custom parameter data is executed; if not, the default parameter data is used. The custom parameter data for the functional fragrance includes at least one of a single usage mode and a combination mode for the functional fragrance.

[0157] In a second example, when the user interface corresponding to an air conditioner linked to a target environment scenario is opened, the air conditioner is checked to see if the user's previously set custom parameter data exists. If so, the custom parameter data is applied; if not, the default parameter data is used. The custom parameter data for the air conditioner includes at least one of temperature, humidity, and air flow.

[0158] In the third example, if the user interface corresponding to the seat linked to the target environment scene is opened, it is detected whether the seat has the custom parameter data set by the user last time; if so, the custom parameter data of the seat is executed; if not, the default parameter data of the seat is used. The custom parameter data of the seat includes at least one of the seat rotation angle and the seat tilt angle;

[0159] In a fourth example, when a user interface corresponding to a light component linked to a target environment scene is opened, the user checks whether the light component has custom parameter data previously set by the user. If so, the custom parameter data for the light component is executed; if not, the default parameter data for the light component is used. The custom parameter data for the light component includes at least one of light brightness, light flashing mode, and light combination mode.

[0160] One or more of the first example, the second example, the third example, and the fourth example.

[0161] Based on the same inventive concept as the above method, the embodiment of the present application also provides a vehicle cabin control device, such as Figure 6 As shown, the control device of the vehicle cabin may include the following modules.

[0162] The media stream acquisition module 31 is used to obtain the media stream related to the target environment scene in response to the opening instruction to open the target environment scene; the media stream includes the cropped frames of each image frame and the track audio; the track audio includes default audio and / or custom audio.

[0163] The linkage control module 32 is used to control the playback of the cropped frames and the split-track audio in each playback device while linking the somatosensory device to work.

[0164] Furthermore, the data determination module determines the number of playback devices to be opened and the installation positions of the playback devices in the vehicle in response to an opening instruction to open the target environment scene;

[0165] The media stream acquisition module is used to obtain the media stream corresponding to the target environment scene, with the same number of channels as the open number and the same cropping direction as the installation position;

[0166] The playback module is used to play the cropped frames of each media stream on each playback device according to the installation location, and play the divided track audio on each playback device.

[0167] As an example, the above-mentioned device may include but is not limited to:

[0168] An installation location module, used to determine the installation location of the playback device in the vehicle;

[0169] The media stream acquisition module includes: a first media stream acquisition submodule, configured to acquire, according to the number of openings, media streams having the same number of paths as the number of openings and the same cutting direction as the installation position;

[0170] The playback module includes a playback submodule for playing the media streams of each channel on the corresponding playback devices according to the installation location.

[0171] As an embodiment, the media stream acquisition module includes: a media stream pre-cutting submodule, configured to obtain media streams with the same number of channels as the open number from the pre-cut media streams with the preset number of channels generated according to the open number.

[0172] As an embodiment, the media stream pre-cropping submodule is specifically used to: obtain a media stream with a cropping direction corresponding to the installation position and the same number of paths as the number of openings from the pre-cropped media stream with a preset number of paths, according to the number of openings and the installation position of the playback device.

[0173] As an embodiment, the media stream pre-cropping sub-module is specifically used to: pre-crop each image frame of the audio and video to be played in different cropping directions according to the preset number of paths and the usage of each playback device, and generate cropped frames after cropping each image frame of the media stream of the preset number of paths.

[0174] As an embodiment, the media stream generation module is used to: generate a preset number of media streams in the following manner; pre-crop each image frame of the audio and video to be played according to the preset number of paths, and generate cropped frames after cropping each image frame of the preset number of media streams; and splice all cropped frames of each image frame of the preset number of media streams to form a complete frame.

[0175] As an embodiment, the media stream generation module includes: a media stream generation sub-module, which is specifically used to pre-crop each image frame of the audio and video to be played in different cropping directions according to a preset number of paths, and generate cropped frames after cropping each image frame of the media stream of the preset number of paths.

[0176] As an embodiment, the media stream acquisition module includes: a media stream real-time cropping submodule for cropping each image frame of the audio and video to be played in real time according to the open number, and generating a media stream with the same number of channels as the open number.

[0177] As an embodiment, the audio and video to be played includes track audio data. Accordingly, the above device may include the following display submodule, call submodule and replacement submodule:

[0178] A display submodule, used to display a replacement entry for replacing the default audio;

[0179] A calling submodule, configured to, in response to a selection instruction for selecting a replacement entry, call the selected replacement entry to obtain the custom audio;

[0180] Replacement submodule, used to use custom audio to replace the default audio.

[0181] As an embodiment, the calling submodule includes a first calling unit and a first acquiring unit. The first calling unit is configured to call the AI's page if the selected replacement entry is the replacement entry corresponding to the AI. The first acquiring unit is configured to receive a replacement instruction input by the user through the AI's page to obtain the replacement audio.

[0182] As an embodiment, the calling submodule includes a second calling unit and a second obtaining unit. The second calling unit is configured to call a page on the local network if the selected replacement entry corresponds to a replacement entry on the local network. The second obtaining unit is configured to receive a replacement instruction input by a user on the local network page and obtain the replacement audio.

[0183] As an embodiment, the calling submodule includes a third calling unit and a third obtaining unit. The third calling unit is configured to call the local audio library if the selected replacement entry corresponds to a replacement entry in the local database. The third obtaining unit is configured to receive an audio selected by the user from the local audio library as the replacement audio.

[0184] As an embodiment, the above-mentioned calling submodule includes a fourth calling unit and a fourth acquisition unit; the fourth calling unit is used to call the sound source corresponding to the target environment scene in the local audio library according to the target environment scene if the selected replacement entry is the replacement entry corresponding to the local database.

[0185] As an embodiment, the above-mentioned device may also include but is not limited to:

[0186] The detection module is configured to detect whether the vehicle-mounted device has the custom parameter data set by the user last time. The first determination module is configured to execute the default parameter data set for the vehicle-mounted device if the vehicle-mounted device detects that the custom parameter data does not exist. The second determination module is configured to execute the custom parameter data if the vehicle-mounted device detects that the custom parameter data exists.

[0187] The implementation process of the functions and effects of each module / submodule / unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and the same technical effects can be achieved, so it will not be repeated here.

[0188] An embodiment of the present application provides an electronic device, including the above-mentioned vehicle cabin control device.

[0189] The vehicle cockpit control method of the embodiments of the present application is applied to electronic devices. The electronic devices may include the vehicle cockpit control device described above, such as one or more of a server device, a PC (Personal Computer) device, and a mobile terminal. The server device and the PC device may include, but are not limited to, a server, a desktop computer, a tablet computer, or a laptop computer.

[0190] The mobile terminal may include, but is not limited to, a smart mobile terminal, a PDA (Personal Digital Assistant), and a handheld terminal. PDAs may include industrial PDAs and consumer PDAs. Any electronic device capable of implementing the embodiments of the present invention falls within the scope of protection of the present invention, without limitation.

[0191] Figure 7 Shown is a schematic structural diagram of an electronic device 50 provided in an embodiment of the present application.

[0192] like Figure 7 As shown, the electronic device 50 includes one or more processors 51 for implementing the vehicle cockpit control method as described above.

[0193] In some embodiments, the electronic device 50 may include a storage medium 59. For example, the computer-readable storage medium may store a program that can be called by the processor 51, and may include a non-volatile storage medium. In some embodiments, the electronic device 50 may include a memory 58 and an interface 57. In some embodiments, the electronic device 50 may also include other hardware depending on the actual application.

[0194] The computer-readable storage medium of the embodiment of the present application stores a program thereon, which, when executed by the processor 51 , is used to implement the vehicle cabin control method described above.

[0195] The present application provides a computer program product, comprising a computer program / instruction, which implements any of the above methods when executed by a processor.

[0196] The present application also provides a computer program, which is stored in a computer-readable storage medium, for example, Figure 7 The computer program is stored in a storage medium 59, and when the processor executes the computer program, the processor 51 is prompted to execute the method described above.

[0197] The present application may take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing program code. Computer-readable storage media include permanent and non-permanent, removable and non-removable media, and may implement information storage by any method or technology. Information may be computer-readable instructions, data structures, modules of a program, or other data. Examples of computer-readable storage media include but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0198] The above description is only a preferred embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of this specification should be included in the scope of protection of this specification.

[0199] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, the phrase "comprises a ..." defining an element does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.

Claims

1. A method for controlling a vehicle cabin, characterized in that: The method is applied to a vehicle, the vehicle comprising: a playback device for playing a media stream, and at least one of a somatosensory device associated with a target environment scene and a user's somatosensory device; the method comprising: In response to an opening instruction for opening the target environment scene, obtaining a media stream related to the target environment scene; the media stream includes cropped frames of each image frame and track-by-track audio; The cropped frame and the split-track audio are controlled to be played in each playback device while the somatosensory device is linked to work.

2. The vehicle cabin control method according to claim 1, wherein: The track audio includes default audio and / or custom audio; The acquiring of the media stream related to the target environment scene includes: In response to an adjustment instruction to adjust the default audio, a customized audio related to a target environment scene is obtained to replace the default audio.

3. The vehicle cabin control method according to claim 1, wherein: The track audio includes default audio and / or custom audio; The acquiring of the media stream related to the target environment scene includes: Displaying a replacement entry for replacing the default audio; In response to a selection instruction for selecting the replacement entry, calling the selected replacement entry to obtain the custom audio; Use the custom audio to replace the default audio.

4. The vehicle cabin control method according to claim 3, wherein: The displaying of a replacement entry for replacing the default audio includes: simultaneously displaying a plurality of replacement entries for replacing the default audio; and / or, The displaying of a replacement entry for replacing the default audio includes: According to the priority order of multiple replacement entries, starting from the highest priority level, the current replacement entries with higher priority are displayed first; In response to a selection instruction for selecting a replacement entry, calling the selected replacement entry includes: In response to a selection instruction for performing a next selection on the current replacement entry, a next replacement entry is displayed according to a priority order of the multiple replacement entries; the next replacement entry is a replacement entry adjacent to the higher priority and lower than the higher priority.

5. The vehicle cabin control method according to claim 4, wherein: The replacement entry includes multiple replacement entries; the priority order of the multiple replacement entries is the replacement entry corresponding to the local audio library, the replacement entry corresponding to the AI ​​and the local networking page.

6. The vehicle cabin control method according to any one of claims 1 to 5, characterized in that: The linking of the somatosensory device to operate includes: Detecting whether the somatosensory device has custom parameters associated with the target environment scene; If not, the somatosensory device is linked to operate according to the default parameters associated with the target environment scene; If so, the somatosensory device is linked to work according to the custom parameters.

7. The vehicle cabin control method according to any one of claims 1 to 5, characterized in that: The step of obtaining a media stream related to the target environment scene in response to an opening instruction for opening the target environment scene includes: In response to an opening instruction for opening the target environment scene, determining the number of the playback devices to be opened and the installation positions of the playback devices in the vehicle; Acquire a media stream corresponding to the target environment scene, having the same number of channels as the opened number and the same clipping direction as the installation position; The controlling the cropped frame and the track audio to be played on each playback device includes: The cropped frames of each media stream are played on each playback device according to the installation position, and the divided track audio is played on each playback device.

8. A vehicle cockpit control device, characterized in that: Applied to a vehicle, the vehicle comprising: a playback device for playing a media stream, and at least one of a somatosensory device associated with a target environment scene and a user's somatosensory device; the apparatus comprising: a media stream acquisition module, configured to acquire a media stream related to the target environment scene in response to an opening instruction for opening the target environment scene; the media stream includes cropped frames of each image frame and track audio; the track audio includes default audio and / or custom audio; The linkage control module is used to control the playback of the cropped frame and the split-track audio in each playback device while linking the somatosensory device to work.

9. An electronic device, characterized in that: The method comprises one or more processors for implementing the vehicle cockpit control method according to any one of claims 1 to 7.

10. A vehicle, characterized in that: The method comprises one or more processors for implementing the vehicle cockpit control method according to any one of claims 1 to 7.

11. A computer-readable storage medium, characterized in that A program is stored thereon, and when the program is executed by a processor, the vehicle cockpit control method according to any one of claims 1 to 7 is implemented.

Images