Vehicle-mounted cabin linkage control system and method and vehicle

Abstract

The embodiment of the invention provides a vehicle-mounted cabin linkage control system and method and a vehicle, and the system comprises an application module layer which is used for generating an equipment linkage request, obtaining equipment linkage configuration information, and sending the equipment linkage request and the equipment linkage configuration information to a middleware layer when an application module is monitored to run to a linkage scene; and the middleware layer is used for generating a device control signal and sending the device control signal to the device module layer according to the current device state of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information when receiving the device linkage request so as to control a target linkage device in the device module layer to perform corresponding operation. By introducing a unified middleware layer, real-time linkage between each functional module in a cabin and equipment in a vehicle is realized, and a user is allowed to configure a linkage strategy and effect according to personal preference.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent cockpits, and in particular to a vehicle-mounted cockpit linkage control system, method and vehicle. Background Art

[0002] With the continuous development of automobile intelligence and entertainment, users' expectations for in-vehicle cockpits have far exceeded traditional driving and riding needs. Modern consumers hope to enjoy a richer, more personalized and immersive entertainment experience while driving or riding. Therefore, linking entertainment functions such as games and KTV with cockpit equipment such as seats, air conditioners, ambient lights, handles, and fragrances has become an important development direction in the field of smart cockpits.

[0003] This linkage strategy can not only enhance the user's entertainment experience, but also dynamically adjust the cockpit environment according to the user's real-time feedback and preferences to create a more comfortable riding atmosphere. However, the current in-vehicle cockpit linkage solution lacks unified control, which will lead to problems such as disordered and untimely device linkage, affecting the overall linkage effect of the in-vehicle cockpit. In addition, the linkage strategy and effect are preset, which is difficult to meet the growing personalized needs of users. Summary of the invention

[0004] The present invention provides a vehicle-mounted cockpit linkage control system, method and vehicle, which realizes real-time linkage between various functional modules in the vehicle-mounted cockpit and in-vehicle equipment, and allows users to freely configure linkage strategies and effects according to personal preferences.

[0005] In a first aspect, an embodiment of the present invention provides a vehicle-mounted cockpit linkage control system, comprising:

[0006] The application module layer is used to generate a device linkage request and obtain device linkage configuration information when it is detected that the application module runs into a linkage scenario, and send the device linkage request and the device linkage configuration information to the middleware layer, wherein the device linkage configuration information is generated in at least one of the following ways: generating or obtaining predefined device linkage configuration information based on the received linkage configuration operation;

[0007] The middleware layer is used to generate a device control signal when receiving the device linkage request based on the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information, and send the device control signal to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

[0008] In a second aspect, an embodiment of the present invention provides a vehicle-mounted cockpit linkage control method, which is executed by the vehicle-mounted cockpit linkage control system according to any embodiment, and the method includes:

[0009] When the application module layer in the vehicle-mounted cockpit linkage control system detects that the application module is running in the linkage scenario, a device linkage request is generated, and device linkage configuration information is obtained, and the device linkage request and the device linkage configuration information are sent to the middleware layer, wherein the device linkage configuration information is generated in at least one of the following ways: generating or obtaining predefined device linkage configuration information based on the received linkage configuration operation;

[0010] Through the middleware layer in the vehicle-mounted cockpit linkage control system, when the device linkage request is received, a device control signal is generated according to the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information, and the device control signal is sent to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

[0011] In a third aspect, an embodiment of the present invention provides a vehicle, including:

[0012] at least one processor; and

[0013] a memory communicatively connected to the at least one processor; wherein,

[0014] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the vehicle-mounted cockpit linkage control method as described in any embodiment of the present invention.

[0015] The embodiment of the present invention provides a vehicle-mounted cockpit linkage control system, method and vehicle, the system includes: an application module layer, a middleware layer and a device module layer; wherein the application module layer is used to generate a device linkage request and obtain device linkage configuration information when monitoring that the application module runs into a linkage scene, and send the device linkage request and the device linkage configuration information to the middleware layer, and the generation method of the device linkage configuration information includes at least one of the following: generating or obtaining pre-defined device linkage configuration information based on the received linkage configuration operation; the middleware layer is used to generate a device control signal according to the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information when receiving the device linkage request, and send the device control signal to the device module layer to control the target linkage device in the device module layer to perform corresponding operations. The above technical solution, by introducing a unified middleware layer, realizes efficient linkage between each module and device, and avoids the problem of disordered and untimely linkage between devices. Whether it is KTV, games or other entertainment functions, smooth and seamless switching can be achieved, which greatly enhances the user's immersion and coherence experience. At the same time, the user-defined linkage strategy and personalized configuration of the effect allow users to flexibly configure according to their needs and preferences. This personalized setting not only meets the diverse needs of users, but also enhances the user's sense of participation and satisfaction.

[0016] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 A schematic diagram of the structure of a vehicle-mounted cockpit linkage control system provided in Embodiment 1 of the present invention;

[0019] Figure 2 A schematic diagram of the device linkage strategy configuration provided in the first embodiment of the present invention;

[0020] Figure 3 This is an example diagram of a handle configuration in a vehicle-mounted cockpit linkage control system provided in Embodiment 1 of the present invention;

[0021] Figure 4A schematic diagram of the structure of another vehicle-mounted cockpit linkage control system provided in Embodiment 1 of the present invention;

[0022] Figure 5 This is a structural example diagram of a vehicle-mounted cockpit linkage control system provided in Embodiment 1 of the present invention;

[0023] Figure 6 A scheduling schematic diagram of a scheduler provided in Embodiment 1 of the present invention;

[0024] Figure 7 A flowchart of a vehicle-mounted cockpit linkage control method provided in Embodiment 2 of the present invention;

[0025] Figure 8 A schematic diagram of the structure of a vehicle provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "original", "target", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] It should be noted that the current in-vehicle cockpit linkage on the market has the following problems: 1) Lack of a unified dispatcher. The linkage of many current in-vehicle cockpit systems has the following scenarios: a. The linkage function may be controlled by multiple independent modules (such as KTV, games); b. The same module may need to be linked with multiple devices in the cockpit (such as games need to link seats, fragrances, and air conditioners); c. The same module switches with different scenes, and the same linked device needs to switch the linkage effect in time (such as the seat needs to switch from strong vibration to weak vibration). If there is no unified dispatcher to coordinate and manage the above scenarios, it will lead to problems such as confusion and untimely linkage of devices, affecting the user's immersive experience. 2) Preset linkage strategies and effects. The linkage strategies and effects of many in-vehicle cockpit systems are preset, and users cannot flexibly configure them according to their needs and preferences. Although this preset linkage method simplifies the system design, it is difficult to meet the growing personalized needs of users.

[0029] Embodiment 1

[0030] Figure 1 This is a schematic diagram of the structure of a vehicle-mounted cockpit linkage control system provided by the first embodiment of the present invention. The system can be applied to the linkage control between the vehicle-mounted cockpit application module and the vehicle-mounted equipment. The system can be implemented in the form of hardware and / or software and can be configured in the vehicle. Figure 1 As shown, the vehicle cockpit linkage control system provided in the first embodiment may specifically include: an application module layer 10, a middleware layer 20 and a device module layer 30; wherein,

[0031] The application module layer 10 is used to generate a device linkage request and obtain device linkage configuration information when it is detected that the application module runs into a linkage scenario, and send the device linkage request and the device linkage configuration information to the middleware layer. The device linkage configuration information is generated in at least one of the following ways: generating based on the received linkage configuration operation, or obtaining pre-defined device linkage configuration information;

[0032] The middleware layer 20 is used to generate a device control signal when receiving a device linkage request based on the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information, and send the device control signal to the device module layer 30 to control the target linkage device in the device module layer 30 to perform corresponding operations.

[0033] For example, if you want to link the KTV with the ambient light on the vehicle when it is playing, you need to give the KTV's audio signal, spectrum and other related information to the middleware layer. After the middleware layer obtains the relevant information, it will schedule the ambient light to link with the KTV. This is considered to be the linkage of the application module scene.

[0034] In this embodiment, the entire system is composed of an application module layer 10, a middleware layer 20, and a device module layer 30. The application module layer 10 includes various application modules, such as games, KTV, and videos, etc. These application modules mainly define linkage scenes, such as game character collisions, etc., and send requests to the middleware layer according to the defined scenes. When it is detected that the current running scene of the application module is the linkage scene corresponding to the application module obtained above, a device linkage request containing the linkage scene will be generated.

[0035] Continuing with the above description, different from the prior art in which the preset linkage effects of the devices are relatively few and the experience in the linkage process has no sense of hierarchy, in this embodiment, the application module layer 10 is used to provide visual effect configuration and preview for the linkage devices, and users can define more linkage effects according to their preferences. The device linkage configuration information obtained by the application module layer 10 can be generated based on the received linkage configuration operation or can be pre-defined and stored. For example, the user can configure the device linkage situation according to his own needs, or the linkage configuration information can be pre-defined and stored, and directly called when used, or the user can adjust and modify it according to his own needs based on the pre-defined device linkage configuration information. The user can configure the strategy and effect of the device linkage in the visual interface provided by the system, thereby generating the device linkage configuration information. Exemplarily, the device linkage configuration information may include the devices that need to be linked and their behaviors associated with the linkage scene, as well as the effects during the linkage process. The device linkage configuration information involves linkage strategy configuration and linkage effect configuration. The linkage strategy configuration allows the user to configure the linkage strategy between different devices according to actual needs. These strategies define how the devices should work together in different scenarios to achieve the best effect. The linkage effect configuration complements the linkage strategy configuration and is used to adjust specific effects during the linkage process, such as vibration, fragrance, lighting, blowing, etc., to enhance the user experience.

[0036] Continuing with the above description, when the application module layer 10 detects that the application module is running into the linkage scenario, it will generate a device linkage request, obtain the device linkage configuration information, and send the device linkage request and the device linkage configuration information to the middleware layer 20. Correspondingly, after receiving the device linkage request, the middleware layer 20 is responsible for coordinating the workflow between the various application modules. The middleware layer 20 determines which application module or linkage scenario to be linked based on the request of the application module layer 10 and the status of the device module layer 30, and performs interrupt operations based on the priority of the scenario defined by the application module. In addition, the middleware layer 20 interacts with the device module layer 30, and controls the specific behavior of the device based on the priority-related instructions and linkage strategies, effect configurations and other device linkage configuration information determined above, and achieves precise control of the device by converting abstract instructions into signals that the device can understand.

[0037] The device module layer 30 includes various hardware devices in the vehicle cabin, such as ambient lights, fragrances, air conditioners, seats, handles, etc. These devices receive instructions through the middleware layer 20 and perform corresponding operations. At the same time, they also feed back their own status information to the middleware layer so that the system can monitor and adjust in real time.

[0038] The above technical solution, by introducing a unified middleware layer, realizes efficient linkage between modules and devices, avoiding the problems of disordered and untimely linkage between devices. Whether it is KTV, games or other entertainment functions, smooth and seamless switching can be achieved, greatly enhancing the user's immersion and continuity experience. At the same time, the user-defined linkage strategy and personalized configuration of the effect allow users to flexibly configure according to their own needs and preferences. This personalized setting not only meets the diverse needs of users, but also enhances the user's sense of participation and satisfaction.

[0039] As a first optional embodiment of the embodiment of the present invention, based on the above embodiment, this first optional embodiment can optimize the application module layer 10, specifically for:

[0040] a1) Obtain the linkage scenario corresponding to the application module.

[0041] The device linkage configuration information includes various application modules and corresponding linkage scenes. The application module layer includes various functional modules, such as games, KTV and videos, etc. These application modules have corresponding linkage scenes defined, such as game character collisions, etc. Specifically, for the currently running application module, the linkage scene corresponding to the currently running application module can be obtained from the device linkage configuration information.

[0042] b1) When it is detected that the current running scenario of the application module is a linkage scenario, a device linkage request including the linkage scenario is generated.

[0043] In this embodiment, when it is detected that the current running scenario of the application module is the linkage scenario corresponding to the application module obtained above, a device linkage request containing the linkage scenario will be generated. The device linkage request is used to be sent to the middleware layer 20, and is processed by the middleware layer 20 to realize the linkage of related devices.

[0044] c1) Obtaining device linkage configuration information, and sending the device linkage request and the device linkage configuration information to the middleware layer 20 .

[0045] Continuing with the above description, the application module layer 10 obtains the device linkage configuration information, and sends the device linkage request and the device linkage configuration information to the middleware layer 20 .

[0046] The above technical solution specifies the execution steps of the application module layer, and realizes that when the application module runs into the linkage scene, a device linkage request is sent to the middleware layer to realize the function of device linkage.

[0047] As a second optional embodiment of the embodiment of the present invention, based on the above embodiment, the second optional embodiment can optimize the application module layer 10 and is also used for:

[0048] a2) The linkage configuration interface is displayed.

[0049] Among them, the linkage configuration interface includes a linkage configuration area and an effect preview area. The linkage configuration area includes linkage scene configuration items associated with the application module, linkage device configuration items, linkage duration configuration items and linkage priority configuration items associated with the linkage scene, and linkage effect configuration items associated with the linkage device.

[0050] Different from the prior art, in which the device linkage strategies corresponding to the scenarios of general application modules are preset, there are relatively few preset linkage effects, and the experience during the linkage process has no sense of hierarchy, in this embodiment, visual effect configuration and preview can be provided for the linkage devices, and users can define more linkage effects according to their preferences, making the device linkage effects richer and bringing users a better immersive experience.

[0051] For example, the linkage configuration interface is set up by playing games. When playing games, the seat starts to vibrate in a certain scene, the fragrance starts to spray a certain fragrance, and the air conditioner blows a certain wind. For example, when driving a kart and hitting an obstacle, which devices should be linked to this scene and how to link them. In addition to some preset linkage effects that can be selected, users can also configure according to their own preferences in the linkage effect configuration. For example, the previously preset atmosphere light is played in the form of a sine wave, and users can adjust the presentation of the atmosphere light, etc.

[0052] In this embodiment, the linkage configuration of the device mainly includes the configuration of the linkage strategy and the configuration of the linkage effect. The linkage strategy is which devices this linkage scene should be linked with, and the linkage effect is what kind of effect the configured device has. The linkage configuration interface includes a linkage configuration area and an effect preview area. The linkage configuration area is used to configure the linkage strategy and linkage effect, and the effect preview area is used to present the set linkage effect. The linkage configuration area may include linkage scene configuration items associated with the application module, linkage device configuration items associated with the linkage scene, linkage duration configuration items and linkage priority configuration items, and linkage effect configuration items associated with the linkage device. The linkage scene configuration items associated with the application module are used to set which linkage scenes are associated with the application module, and the linkage device configuration items are used to set which devices that need to be linked are associated with each linkage scene. The linkage duration configuration item is used to configure the duration of the linkage. The linkage priority configuration item is used to configure the priority of the linkage scene, and the linkage effect configuration item is used to configure which specific operations the device performs.

[0053] The system provided in this embodiment can provide users with visual policy configuration and preview. Figure 2 A schematic diagram of a device linkage strategy configuration provided in the first embodiment of the present invention, such as Figure 2 As shown, the entire policy configuration includes the scenarios associated with the application module, linkage parameter configuration, linkage device configuration and linkage device effect configuration. For example, the scenarios associated with the application module include scenario 1, scenario 2... scenario n, and the linkage parameters include the linkage devices associated with each scene, linkage duration and priority, etc. The linkage devices include handles, fragrances, seats, atmosphere lights and air conditioners, etc. Each linkage device has corresponding preset effects and custom effects.

[0054] Exemplarily, the process of user configuration of linkage policy can be described as: configure policy for each scenario according to the scenario set by the application; after selecting the scenario, configure the linkage device; select the linkage effect for each linkage device, you can choose the preset linkage effect, or you can choose the custom linkage effect configured by the linkage effect configuration module; configure the linkage duration and priority; end the configuration and preview.

[0055] b2) receiving linkage configuration operations for the linkage configuration area and generating device linkage configuration information.

[0056] In this embodiment, the user can perform configuration operations on the configuration items in the linkage configuration area, which is recorded as linkage configuration operations. The application module layer 10 receives the linkage configuration operations, analyzes the linkage configuration operations, and can determine which configurations the user has performed. The information generated by these configurations is recorded as device linkage configuration information.

[0057] c2) The effect preview page generated based on the device linkage configuration information is presented in the effect preview area.

[0058] In this embodiment, a corresponding effect preview page is generated according to the device linkage configuration information and presented in the effect preview area.

[0059] For example, the configuration is performed by taking a handle as an example. Generally, the preset linkage effects of a handle are only strong vibration and weak vibration. This system provides a visual configuration and preview function for the handle. The following is a detailed introduction to the handle configuration. Figure 3 This is an example diagram of a handle configuration in a vehicle-mounted cockpit linkage control system provided in the first embodiment of the present invention, such as Figure 3 As shown, the horizontal axis is the duration of the handle vibration, and the vertical axis is the intensity of the handle vibration. The user can set the vibration intensity from t0 to t1 to s2, the vibration intensity from t1 to t2 to s4, the vibration intensity from t2 to t3 to s3, and the vibration intensity from t3 to t4 to s1. The entire configuration (t0-t4) is combined as a scene linkage effect, and the configured vibration effect can be previewed in the visual configuration interface. The custom effects of the handle are implemented using software solutions. If the handle device supports custom vibration effects, the device manufacturer can also provide an interface and implement it by the device manufacturer, which will have a better effect. The customization of other devices is similar and will not be repeated here.

[0060] The above technical solution adds an application module layer to provide users with visual effect configuration and preview. Users can define more linkage effects according to their preferences, making the device linkage effects richer and bringing users a better immersive experience.

[0061] Figure 4 A structural diagram of another vehicle-mounted cockpit linkage control system provided in Embodiment 1 of the present invention is shown in FIG. Figure 4 As shown, as a third optional embodiment of the embodiment of the present invention, based on the above embodiment, this third optional embodiment can optimize the middleware layer 20 including the scheduler 21 and the device controller 22; wherein,

[0062] The scheduler 21 is used to evaluate the current device status of each device in the device module layer 30 when receiving the device linkage request, and generate a priority scheduling instruction according to the request priority of the device linkage request;

[0063] The device controller 22 is used to generate a device control signal according to the priority scheduling instruction and the device linkage configuration information and send it to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

[0064] In this embodiment, the scheduler 21 is used to receive the device linkage request sent by the application module layer 10. After receiving the device linkage request, the scheduler 21 determines the scheduling priority of the application module and controls the scheduling of which devices. The scheduler 21 will evaluate the current device status of each device in the device module layer 30, and evaluate the request priority of the device linkage request, and generate a priority scheduling instruction based on the request priority. For example, many modules in the vehicle cockpit can run at the same time, and many application modules can be linked with the devices in the cockpit, so conflicts may occur. Therefore, a unified scheduler is needed to prioritize the linkage of each module, and the scheduling strategy can use a simple high priority to interrupt the linkage of low-priority application modules. Alternatively, the same application module has multiple scenes, and the scene switching is relatively frequent. There is a scene and the device have not ended, and the next scene linkage instruction has been triggered, so a unified scheduler is also needed to control the priority of each scene linkage, and a high priority interruption low priority strategy can be used for scheduling. Among them, the scheduling strategy can be scheduled by high and low priority, or it can be scheduled in combination with the running status of the vehicle machine or the running status of the linkage device, so that the experience is better.

[0065] In this embodiment, the device controller 22 includes controllers corresponding to each device, such as a handle controller, a seat controller, an atmosphere light controller, and a fragrance controller. The device controller 22 receives information from the scheduler 21 and the linkage configuration, generates a device control signal, and sends it to the device module layer 30. Specifically, the device controller 22 interacts directly with the device module layer 30, and controls the specific behavior of the device according to the instructions, linkage strategy, and effect configuration of the scheduler 21. The device controller 22 is responsible for converting abstract instructions into signals that the device can understand, so as to achieve precise control of the device.

[0066] For example, Figure 5 This is a structural example diagram of a vehicle-mounted cockpit linkage control system provided in Embodiment 1 of the present invention, such as Figure 5 As shown, the application module layer includes game, KTV, video and other application modules, the middleware layer 20 includes a scheduler 21 and a device controller 22, the device controller 22 includes a handle controller, a seat cushion controller, an atmosphere light controller, a fragrance controller, etc., and the device module layer 30 includes a handle, a seat cushion, an atmosphere light, a fragrance and other devices. Game, KTV, video and other application modules are connected to the scheduler 21 in communication, and each application module has a corresponding linkage strategy configuration and linkage effect configuration given to the scheduler 21. The scheduler 21 is connected to the handle controller, the seat cushion controller, the atmosphere light controller and the fragrance controller. The handle controller is used to control the handle, the seat cushion controller is used to control the seat cushion, the atmosphere light controller is used to control the atmosphere light, and the fragrance controller is used to control the fragrance. They are not listed here one by one.

[0067] Further, based on the third optional embodiment, the scheduler 21 may be optimized, specifically for:

[0068] a3) When a device linkage request is received, the current device status of each device in the device module layer 30 is evaluated.

[0069] Specifically, each device in the device module layer 30 feeds back its current state to the scheduler 21, and the scheduler 21 receives the device linkage request and evaluates the current state of each device.

[0070] b3) Determine the device linkage status of the vehicle cockpit according to the current device status of each device in the device module layer 30.

[0071] Specifically, it can be determined whether the device in the vehicle cockpit is operating in linkage with the application module according to the current device status of each device in the device module layer 30. For example, the device linkage status of the vehicle cockpit can be that none of the devices are operating in linkage, or many application modules are operating in linkage with the devices in the cockpit, or the same application module has multiple linkage scenes, and the linkage scenes are frequently switched, and the linkage instruction of the next scene is triggered before the previous linkage scene and the device are completed.

[0072] c3) If the device linkage status of the vehicle cockpit is that there are at least two application modules running simultaneously, a priority scheduling instruction is generated according to the priority of each application module in the device linkage configuration information.

[0073] In this embodiment, the scheduler 21 is mainly divided into application module scheduling and scene scheduling corresponding to the application module. For example, Figure 6 A scheduling diagram of a scheduler provided in Embodiment 1 of the present invention is shown in FIG. Figure 6 As shown, the scheduling of the scheduler includes application module scheduling and linkage scene scheduling. Application modules include game, KTV, video and other application modules, and linkage scenes include scene 1, scene 2, scene n and so on.

[0074] Regarding the scheduling of application modules: Currently, many application modules in the vehicle cockpit can run at the same time, and many application modules can be linked with the devices in the cockpit, which may cause conflicts, so a unified scheduler 21 is needed to prioritize the linkage of each application module. The scheduling strategy can adopt a simple high-priority application module to interrupt the linkage of a low-priority application module, and based on this, generate a priority scheduling instruction.

[0075] d3) If the device linkage status of the vehicle cockpit is that there are at least two linkage scenarios running simultaneously, a priority scheduling instruction is generated according to the priority of each linkage scenario in the device linkage configuration information.

[0076] For the scene scheduling corresponding to the application module: the same application module has multiple linkage scenes, and the linkage scenes are switched frequently. There is a situation where the linkage instruction of the next scene has been triggered before the previous linkage scene and the device are completed. Therefore, a unified scheduler 21 is also required to control the priority of each scene linkage. The strategy of interrupting the low priority with the high priority can be used for scheduling, and based on this, a priority scheduling instruction is generated.

[0077] The above technical solution, by introducing a unified scheduler, achieves efficient linkage between modules and devices, avoiding the problem of disordered and untimely linkage between devices. Whether it is KTV, games or other entertainment functions, smooth and seamless switching can be achieved, greatly improving the user's immersion and coherence experience.

[0078] Further, based on the third optional embodiment, the scheduler 21 can be optimized to generate a priority scheduling instruction according to the priority of each application module in the device linkage configuration information, including:

[0079] a4) Obtain the priority of each application module from the device linkage configuration information, and use the application module with the highest priority as the priority scheduling application module.

[0080] In this embodiment, many application modules in the vehicle cockpit can run at the same time, and many application modules can be linked with the devices in the cockpit, so conflicts may occur, so a unified scheduler 21 is required to prioritize the linkage of each application module. The scheduling strategy can be a simple high-priority interruption of the linkage of low-priority application modules. The device linkage configuration information contains the priorities of different application modules. The priorities of each application module are obtained from the device linkage configuration information, and the application module with the highest priority is used as the priority scheduling application module.

[0081] b4) treating application modules other than the priority-scheduled application modules as application modules to be interrupted, and generating linkage interrupt instructions for the application modules to be interrupted.

[0082] The linkage interrupt instruction of the application module to be interrupted is used to instruct the device to be linked with the application module to be interrupted to interrupt operation. In this embodiment, the application modules other than the priority scheduled application modules are used as the application modules to be interrupted. Since the priority of the application modules to be interrupted is low, it is necessary to link the devices of the application modules to be interrupted to interrupt them, and generate the linkage interrupt instruction for the application modules to be interrupted.

[0083] c4) Generate linkage operation instructions for priority scheduling application modules, and use linkage interrupt instructions and linkage operation instructions as priority scheduling instructions.

[0084] Among them, the linkage operation instruction of the priority-scheduled application module is used to instruct the target linkage device associated with the priority-scheduled application module to start running. In this embodiment, after determining the priority-scheduled linkage scenario, the corresponding device that needs to be linked can be determined based on the priority-scheduled linkage scenario, which is recorded as the target linkage device. Generate a linkage operation instruction for the priority-scheduled application module to start the target linkage device. In this embodiment, the linkage interrupt instruction and the linkage operation instruction are used as priority scheduling instructions.

[0085] The above technical solution adds a scheduler to realize how to control based on priority when multiple application modules are running simultaneously.

[0086] Further, on the basis of the third optional embodiment, the scheduler 21 may be used to generate a priority scheduling instruction according to the priority of each linkage scenario in the device linkage configuration information, including:

[0087] a5) Obtain the priority of each linkage scene from the device linkage configuration information, and use the linkage scene with the highest priority as the linkage scene for priority scheduling.

[0088] In this embodiment, the same application module may have multiple linkage scenes, and the linkage scenes switch frequently. There is a situation where the linkage instruction of the next scene has been triggered before the previous linkage scene and the device are completed. Therefore, a unified scheduler 21 is also required to control the priority of each scene linkage, and a high priority interruption low priority strategy can be used for scheduling. The device linkage configuration information contains the priority of the linkage scene corresponding to the application module. The priority of each linkage scene corresponding to the application module is obtained from the device linkage configuration information, and the linkage scene with the highest priority is used as the linkage scene for priority scheduling.

[0089] b5) taking linkage scenarios other than the priority linkage scenarios as linkage scenarios to be interrupted, and generating linkage interruption instructions for the linkage scenarios to be interrupted.

[0090] The linkage interruption instruction of the linkage scene to be interrupted is used to instruct the device associated with the linkage scene to be interrupted to interrupt operation. In this embodiment, the linkage scenes other than the priority linkage scenes are used as the linkage scenes to be interrupted. Since the priority of the linkage scenes to be interrupted is low, it is necessary to interrupt the device associated with the linkage scenes to be interrupted, generate the linkage interruption instruction and send it to the device controller, so as to control the device associated with the linkage scenes to be interrupted to interrupt operation through the device controller.

[0091] c5) Generate linkage operation instructions for priority scheduling linkage scenarios, and use linkage interrupt instructions and linkage operation instructions as priority scheduling instructions.

[0092] Among them, the linkage operation instruction of the priority linkage scene is used to instruct the target linkage device associated with the priority linkage scene to start running. In this embodiment, after determining the priority linkage scene, the corresponding device that needs to be linked can be determined based on the priority linkage scene, which is recorded as the target linkage device. Generate a linkage operation instruction for the priority linkage scene to start the target linkage device. In this embodiment, the linkage interrupt instruction and the linkage operation instruction are used as priority scheduling instructions.

[0093] The above technical solution adds a scheduler to realize how to control based on priority when switching between different linkage scenarios of the same application module.

[0094] Further, based on the third optional embodiment, the device controller 22 may be optimized, specifically for:

[0095] a6) According to the linkage interrupt instruction in the priority scheduling instruction, an operation interrupt signal is generated to instruct the device associated with the application module to be interrupted or the linkage scenario to be interrupted to interrupt operation, and sent to the device module layer to control the device associated with the device module layer to interrupt operation.

[0096] In this embodiment, according to the scheduling method of high priority interrupting the linkage of low priority application modules, after receiving the linkage interrupt instruction in the priority scheduling instruction, it will be converted into an operation interrupt signal that the device can understand. For the device linkage state of the vehicle cockpit is that there are at least two application modules running at the same time, a run interrupt signal will be generated to instruct the device associated with the application module to be interrupted to interrupt the operation. For the device linkage state of the vehicle cockpit is that there are at least two linkage scenes running at the same time, a run interrupt signal will be generated to instruct the device associated with the linkage scene to be interrupted to interrupt the operation. The operation interrupt signal is then sent to the device module layer to control the associated devices in the device module layer to interrupt the operation.

[0097] b6) Determine the target linkage device, the behavior of the target linkage device, and the linkage effect of the target linkage device according to the device linkage configuration information.

[0098] In this embodiment, in addition to interrupting the operation of low-priority application modules or devices associated with linkage scenarios, it is also necessary to execute corresponding linkage effects on high-priority application modules or devices associated with linkage scenarios. Specifically, according to the device linkage configuration information, it can be determined that the devices that need to be linked in the linkage scenario are recorded as target linkage devices, and the behavior of the target linkage devices and the linkage effects of the target linkage devices can also be determined.

[0099] c6) Generate a device operation signal and send it to the device module layer according to the linkage operation instruction in the priority scheduling instruction, the target linkage device, the behavior of the target linkage device and the linkage effect of the target linkage device, so as to control the target linkage device in the device module layer to perform corresponding operations.

[0100] In this embodiment, according to the linkage operation instructions in the priority scheduling instructions, the target linkage devices, the behavior of the target linkage devices and the linkage effects of the target linkage devices, a conversion is performed to generate a device operation signal that can be understood by the target linkage devices, and the signal is sent to the device module layer to control the target linkage devices in the device module layer to perform corresponding operations.

[0101] Exemplarily, continuing the description of the above example, the handle realizes this vibration effect by being controlled by the handle controller, and the specific steps of the handle controller controlling the handle include: S1, the handle controller starts the motor configuration; S2, the handle controller sends the motor vibration command (vibration intensity s2); S3, the handle controller sleeps for a delay of t1-t0; S4, the handle controller sends the motor vibration command (vibration intensity s4); S5, the handle controller sleeps for a delay of t2-t1; S6, the handle controller sends the motor vibration command (vibration intensity s3); S7, the handle controller sleeps for a delay of t3-t2; S8, the handle controller sends the motor vibration command (vibration intensity s1); S9, the handle controller sleeps for a delay of t4-t3;

[0102] S10, the handle controller stops the motor. The above is an example of the effect configuration of the handle device, and other devices can be customized according to the actual situation of the device.

[0103] The above technical solution specifies the execution steps of the device controller.

[0104] Further, on the basis of the third optional embodiment, the target linkage device 30 may be optimized to further be used to: feed back the state information of the target linkage device to the middleware layer.

[0105] In this embodiment, after the target linkage device 30 completes the operation, it will feed back its own state information to the middleware layer 20 for monitoring or adjustment.

[0106] The above technical solution adds a feedback function for the status information of the target linkage device, providing a basis for monitoring the device.

[0107] Embodiment 2

[0108] Figure 7This is a flow chart of a vehicle-mounted cockpit linkage control method provided in the second embodiment of the present invention. The method can be applied to the linkage control between the vehicle-mounted cockpit application module and the vehicle-mounted equipment. The system can be implemented in the form of hardware and / or software and can be configured in the vehicle. Figure 7 As shown, the vehicle-mounted cockpit linkage control method provided in the second embodiment may specifically include the following steps:

[0109] S1. Through the application module layer in the vehicle-mounted cockpit linkage control system, when it is monitored that the application module runs into the linkage scenario, a device linkage request is generated, and the device linkage configuration information is obtained, and the device linkage request and the device linkage configuration information are sent to the middleware layer.

[0110] The generation method of the device linkage configuration information includes at least one of the following: generating based on the received linkage configuration operation, or acquiring predefined device linkage configuration information.

[0111] For example, if you want to link the KTV with the ambient light on the vehicle when it is playing, you need to give the KTV's audio signal, spectrum and other related information to the middleware layer. After the middleware layer obtains the relevant information, it will schedule the ambient light to link with the KTV. This is considered to be the linkage of the application module scene.

[0112] In this embodiment, the entire system consists of an application module layer, a middleware layer, and a device module layer. The application module layer includes various application modules, such as games, KTV, and videos, etc. These application modules mainly define linkage scenes, such as game character collisions, etc., and send requests to the middleware layer according to the defined scenes. When it is detected that the current running scene of the application module is the linkage scene corresponding to the application module obtained above, a device linkage request containing the linkage scene will be generated.

[0113] Continuing with the above description, different from the existing technology in which the preset linkage effects of the devices are relatively few and the experience in the linkage process has no sense of hierarchy, in this embodiment, the application module layer is used to provide visual effect configuration and preview for the linkage devices, and users can define more linkage effects according to their preferences. The device linkage configuration information obtained by the application module layer can be generated based on the received linkage configuration operation or can be pre-defined and stored. For example, the user can configure the device linkage according to his own needs, or the linkage configuration information can be pre-defined and stored, and directly called when used, or the user can adjust and modify it according to his own needs based on the pre-defined device linkage configuration information. The user can configure the strategy and effect of the device linkage in the visual interface provided by the system, thereby generating the device linkage configuration information. Exemplarily, the device linkage configuration information may include the devices that need to be linked and their behaviors associated with the linkage scene, as well as the effects during the linkage process. The device linkage configuration information involves linkage strategy configuration and linkage effect configuration. The linkage strategy configuration allows the user to configure the linkage strategy between different devices according to actual needs. These strategies define how the devices should work together in different scenarios to achieve the best effect. The linkage effect configuration complements the linkage strategy configuration and is used to adjust specific effects during the linkage process, such as vibration, fragrance, lighting, blowing, etc., to enhance the user experience.

[0114] Continuing with the above description, when the application module layer detects that the application module is running into the linkage scenario, it will generate a device linkage request, obtain the device linkage configuration information, and send the device linkage request and the device linkage configuration information to the middleware layer.

[0115] S2. Through the middleware layer in the vehicle-mounted cockpit linkage control system, when a device linkage request is received, a device control signal is generated according to the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information, and the device control signal is sent to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

[0116] After receiving the device linkage request, the middleware layer is responsible for coordinating the workflow between the various application modules. The middleware layer determines which application module or linkage scenario to be linked based on the request of the application module layer and the status of the device module layer, and performs interrupt operations based on the priority of the scenario defined by the application module. In addition, the middleware layer interacts with the device module layer, controls the specific behavior of the device based on the priority-related instructions and linkage strategies, effect configurations and other device linkage configuration information determined above, and realizes precise control of the device by converting abstract instructions into signals that the device can understand.

[0117] The device module layer includes various hardware devices in the vehicle cabin, such as ambient lights, fragrances, air conditioners, seats, handles, etc. These devices receive instructions through the middleware layer and perform corresponding operations. At the same time, they also feed back their own status information to the middleware layer so that the system can monitor and adjust in real time.

[0118] The above technical solution, by introducing a unified middleware layer, realizes efficient linkage between modules and devices, avoiding the problems of disordered and untimely linkage between devices. Whether it is KTV, games or other entertainment functions, smooth and seamless switching can be achieved, greatly enhancing the user's immersion and continuity experience. At the same time, the user-defined linkage strategy and personalized configuration of the effect allow users to flexibly configure according to their own needs and preferences. This personalized setting not only meets the diverse needs of users, but also enhances the user's sense of participation and satisfaction.

[0119] Embodiment 3

[0120] Figure 8 A schematic diagram of the structure of a vehicle provided for Embodiment 3 of the present invention. The components, their connections and relationships, and their functions shown herein are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0121] like Figure 8 As shown, the vehicle 50 includes at least one processor 51, and a memory connected to the at least one processor 51 in communication, such as a read-only memory (ROM) 52, a random access memory (RAM) 53, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 51 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 52 or the computer program loaded from the storage unit 58 to the random access memory (RAM) 53. In the RAM 53, various programs and data required for the operation of the vehicle 50 can also be stored. The processor 51, ROM 52 and RAM 53 are connected to each other through a bus 54. An input / output (I / O) interface 55 is also connected to the bus 54.

[0122] A number of components in the vehicle 50 are connected to the I / O interface 55, including: an input unit 56, such as a keyboard, a mouse, etc.; an output unit 57, such as various types of displays, speakers, etc.; a storage unit 58, such as a disk, an optical disk, etc.; and a communication unit 59, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 59 allows the vehicle 50 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0123] The processor 51 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 51 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 51 executes the various methods and processes described above, such as the vehicle-mounted cockpit linkage control method.

[0124] In some embodiments, the vehicle-mounted cockpit linkage control method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 58. In some embodiments, part or all of the computer program may be loaded and / or installed on the vehicle 50 via the ROM 52 and / or the communication unit 59. When the computer program is loaded into the RAM 53 and executed by the processor 51, one or more steps of the vehicle-mounted cockpit linkage control method described above may be performed. Alternatively, in other embodiments, the processor 51 may be configured to execute the vehicle-mounted cockpit linkage control method in any other appropriate manner (e.g., by means of firmware).

[0125] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0126] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A vehicle-mounted cockpit linkage control system, characterized in that: include: Application module layer, middleware layer and device module layer; among them, The application module layer is used to generate a device linkage request and obtain device linkage configuration information when it is detected that the application module runs into a linkage scenario, and send the device linkage request and the device linkage configuration information to the middleware layer, wherein the device linkage configuration information is generated in at least one of the following ways: generating or obtaining predefined device linkage configuration information based on the received linkage configuration operation; The middleware layer is used to generate a device control signal when receiving the device linkage request based on the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information, and send the device control signal to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

2. The system according to claim 1, characterized in that The application module layer is specifically used for: Obtaining the linkage scenario corresponding to the application module; When it is detected that the current running scenario of the application module is the linkage scenario corresponding to the application module, a device linkage request corresponding to the linkage scenario is generated; Acquire device linkage configuration information, and send the device linkage request and the device linkage configuration information to the middleware layer.

3. The system according to claim 1, characterized in that The application module layer is also used for: Presenting a linkage configuration interface, the linkage configuration interface including a linkage configuration area and an effect preview area, the linkage configuration area including linkage scene configuration items associated with the application module, linkage device configuration items, duration configuration items, and priority configuration items associated with the linkage scene, and linkage effect configuration items associated with the linkage device; receiving a linkage configuration operation for the linkage configuration area, and generating the device linkage configuration information; An effect preview page generated based on the device linkage configuration information is presented in the effect preview area.

4. The system according to claim 1, characterized in that The middleware layer includes a scheduler and a device controller; wherein, The scheduler is used to evaluate the current device status of each device in the device module layer when receiving the device linkage request, and generate a priority scheduling instruction according to the request priority of the device linkage request; The device controller is used to generate a device control signal according to the priority scheduling instruction and the device linkage configuration information and send it to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

5. The system according to claim 4, characterized in that The scheduler is specifically used for: When receiving the device linkage request, evaluating the current device status of each device in the device module layer; Determine the device linkage state of the vehicle cockpit according to the current device state of each device in the device module layer; If the device linkage state of the vehicle cockpit is that at least two application modules are running simultaneously, a priority scheduling instruction is generated according to the priority of each application module in the device linkage configuration information; If the device linkage state of the vehicle cockpit is that at least two linkage scenes are running simultaneously, a priority scheduling instruction is generated according to the priority of each linkage scene in the device linkage configuration information.

6. The system according to claim 5, characterized in that The step of the scheduler generating a priority scheduling instruction according to the priority of each of the application modules in the device linkage configuration information includes: Obtaining the priority of each of the application modules from the device linkage configuration information, and taking the application module with the highest priority as the application module to be scheduled preferentially; Taking application modules other than the priority scheduled application modules as application modules to be interrupted, generating linkage interrupt instructions for the application modules to be interrupted, wherein the linkage interrupt instructions of the application modules to be interrupted are used to instruct the device linked with the application modules to be interrupted to interrupt operation; Generate a linkage operation instruction for the priority-scheduled application module, use the linkage interrupt instruction and the linkage operation instruction as priority-scheduled instructions, and the linkage operation instruction of the priority-scheduled application module is used to instruct the target linkage device associated with the priority-scheduled application module to start running.

7. The system according to claim 5, characterized in that The step of the scheduler generating a priority scheduling instruction according to the priority of each linkage scenario in the device linkage configuration information includes: Obtaining the priority of each linkage scene from the device linkage configuration information, and taking the linkage scene with the highest priority as the linkage scene to be scheduled preferentially; Taking linkage scenarios other than the priority linkage scenario as linkage scenarios to be interrupted, generating linkage interruption instructions for the linkage scenarios to be interrupted, wherein the linkage interruption instructions for the linkage scenarios to be interrupted are used to instruct the devices associated with the linkage scenarios to be interrupted to interrupt operation; Generate a linkage operation instruction for the priority linkage scene, use the linkage interrupt instruction and the linkage operation instruction as the priority scheduling instruction, and the linkage operation instruction of the priority scheduling linkage scene is used to instruct the target linkage device associated with the priority scheduling linkage scene to start running.

8. The system according to claim 4, characterized in that The device controller is specifically used for: According to the linkage interruption instruction in the priority scheduling instruction, a running interruption signal is generated to instruct the device associated with the application module to be interrupted or the linkage scenario to be interrupted to interrupt operation, and sent to the device module layer to control the device associated with the device module layer to interrupt operation; Determine, according to the device linkage configuration information, a target linkage device, a behavior of the target linkage device, and a linkage effect of the target linkage device; According to the linkage operation instruction in the priority scheduling instruction, the target linkage device, the behavior of the target linkage device and the linkage effect of the target linkage device, a device operation signal is generated and sent to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

9. The system according to claim 1, characterized in that The target linkage device is also used for: Feedback the status information of the target linkage device to the middleware layer.

10. A vehicle-mounted cockpit linkage control method, characterized in that: The method is performed by the vehicle-mounted cockpit linkage control system according to any one of claims 1 to 9, and comprises: When the application module layer in the vehicle-mounted cockpit linkage control system detects that the application module is running in the linkage scenario, a device linkage request is generated, and device linkage configuration information is obtained, and the device linkage request and the device linkage configuration information are sent to the middleware layer, wherein the device linkage configuration information is generated in at least one of the following ways: generating or obtaining predefined device linkage configuration information based on the received linkage configuration operation; Through the middleware layer in the vehicle-mounted cockpit linkage control system, when the device linkage request is received, a device control signal is generated according to the current device status of each device in the device module layer, the request priority of the device linkage request and the device linkage configuration information, and the device control signal is sent to the device module layer to control the target linkage device in the device module layer to perform corresponding operations.

11. A vehicle, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the vehicle-mounted cockpit linkage control method as claimed in claim 10.

Images