Scene linkage control method and device, and electronic device

Abstract

The application discloses a scene linkage control method and device and electronic equipment, and relates to the technical field of automobile electrical control. The method comprises the following steps: collecting multi-source heterogeneous data in real time by a plurality of different data sources, and performing fusion preprocessing on the collected multi-source heterogeneous data; performing feature extraction on the multi-source heterogeneous data after the fusion preprocessing, and performing scene determination according to the extracted features; adaptively matching a scene linkage control strategy according to the determined scene type; and issuing a linkage control instruction by a plurality of devices in cooperation according to the matched scene linkage control strategy. The scene linkage control method, device and electronic equipment provided by the application solve the problems that data and computing power resources of a cabin control system cannot be shared and a linkage response is lagged.

Description

Technical Field

[0001] This application relates to the field of automotive electrical control technology, and in particular to scene linkage control methods, devices and electronic equipment. Background Technology

[0002] With the rapid iteration of automotive intelligence and connectivity technologies, automotive electronic and electrical architecture has gradually evolved from a traditional distributed architecture to a domain-centralized architecture. The cockpit domain, as the core carrier of intelligent interaction and driving experience, integrates various driving-related functions such as in-vehicle audio-visual systems, human-machine interaction, environmental control, lighting control, and driving assistance prompts, becoming a key module for improving vehicle intelligence and user driving experience. Currently, new energy vehicles have fully entered the stage of intelligent cockpit popularization. User demands for vehicles are gradually shifting from basic transportation functions to a full-scenario, personalized, and intelligent immersive driving experience. Scenario-based linkage control capabilities have become one of the core competitive advantages of intelligent cockpits.

[0003] In existing technologies, traditional vehicle cockpit control systems mostly adopt a functionally separate control mode. Various cockpit functional modules are developed and operate independently, and their corresponding control logics are isolated from each other, lacking a unified overall scheduling and linkage mechanism. Specifically, cockpit equipment such as in-vehicle air conditioning, ambient lighting, multimedia audio-visual systems, windows, seats, and driving prompts are all equipped with independent control units and triggering logic. This can only achieve manual triggering of a single function or simple automatic control under fixed conditions, and cannot combine driving conditions, environmental conditions, user behavior, and driving scenarios to achieve multi-device, multi-dimensional coordinated linkage control. Summary of the Invention

[0004] The purpose of this invention is to provide a scene linkage control method, device, and electronic device that solves the problems of cockpit control system data and computing resources not being shared and linkage response being delayed.

[0005] This invention provides the following solution: According to one aspect of the present invention, a scene linkage control method is provided, the scene linkage control method comprising: Multi-source heterogeneous data is collected in real time from multiple different data sources, and the collected multi-source heterogeneous data is fused and preprocessed. Feature extraction is performed on the multi-source heterogeneous data after fusion and preprocessing, and scene determination is performed based on the extracted features; Based on the determined scene type, an adaptive matching scene linkage control strategy is performed. The scene linkage control strategy includes: a timing control strategy and a priority scheduling strategy. Based on the matched scenario-based linkage control strategy, multiple devices work together to issue linkage control commands.

[0006] Optional, also includes: After the linkage control command is issued, obtain the status feedback of the device command execution. Based on the status feedback, perform closed-loop verification of the execution effect.

[0007] Optionally, based on status feedback, closed-loop verification of the execution effect can be performed, including: Based on the status feedback values, determine whether there are any execution deviations; If there is an execution deviation, the control parameters in the linkage control strategy will be corrected.

[0008] Optionally, based on status feedback, closed-loop verification of the execution effect can be performed, including: Based on the status feedback value, determine whether there is a dynamic update of the scene; If there are dynamic scene updates, update the standard thresholds in scene determination.

[0009] Optionally, based on the determined scene type, an adaptive scene linkage control strategy can be matched, including: Obtain the currently determined scene type; Obtain the linkage control strategies used by the cockpit equipment under the specified scenario type; By statistically analyzing the linkage control strategies, the linkage control strategy with the highest frequency of use in the aforementioned scenario type is identified. The most frequently used linkage control strategy under the aforementioned scenario type will be applied as the matched linkage control strategy.

[0010] Optionally, based on the determined scene type, an adaptive scene linkage control strategy can be matched, including: Obtain the currently determined scene type; Obtain the linkage control strategy matched by the online model for the current scene type; The linkage control strategy matched by the online model is applied as the matched linkage control strategy.

[0011] Optionally, based on the determined scene type, the adaptive matching of scene linkage control strategies also includes: Obtain user feedback on the linkage control strategy; Based on user feedback, the application's linkage control strategy was optimized.

[0012] Optionally, based on the matched scenario-based linkage control strategy, multiple devices can coordinate and issue linkage control commands, including: Compare the facial information captured by the DMS camera to determine if it is a face that has been recorded.

[0013] According to a second aspect of the present invention, a scene linkage control device is provided, the scene linkage control device comprising: The acquisition module is used to collect multi-source heterogeneous data from multiple different data sources in real time, and to perform fusion and preprocessing on the collected multi-source heterogeneous data; The judgment module is used to extract features from the multi-source heterogeneous data after fusion and preprocessing, and to make scene judgments based on the extracted features. The matching module is used to adaptively match scene linkage control strategies based on the determined scene type. The scene linkage control strategies include: timing control strategies and priority scheduling strategies. The distribution module is used to distribute control commands to multiple devices in a coordinated manner based on the matched scenario linkage control strategy.

[0014] According to three aspects of the present invention, an electronic device is provided, the electronic device comprising: Processor, communication interface, memory, and communication bus. The processor, communication interface, and memory communicate with each other through a communication bus. The memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the scene linkage control method described above.

[0015] The above solution achieves the following beneficial technical effects: This invention effectively solves several core technical pain points in existing intelligent cockpit linkage control. It has outstanding substantive features and significant progress in improving the intelligent driving experience, ensuring driving safety, optimizing system performance, and reducing vehicle cost and power consumption. It has extremely high engineering application value and market promotion value. Attached Figure Description

[0016] Figure 1 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 2 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 3 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 4 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 5 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 6 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 7This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 8 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 9 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 10 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention; Figure 11 This is a structural diagram of a scene linkage control device provided in one or more embodiments of the present invention; Figure 12 This is a structural diagram of an electronic device provided in one or more embodiments of the present invention. Detailed Implementation

[0017] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] Figure 1 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 1 The scene linkage control method includes the following operation steps: S11 collects multi-source heterogeneous data in real time from multiple different data sources and performs fusion preprocessing on the collected multi-source heterogeneous data.

[0019] S12 extracts features from the pre-processed multi-source heterogeneous data and determines the scene based on the extracted features.

[0020] S13, based on the determined scene type, adaptively match the scene linkage control strategy.

[0021] S14: Based on the matched scene linkage control strategy, multiple devices coordinate and issue linkage control commands.

[0022] The concept of intelligent driving has entered people's lives. The application of intelligent driving relies on the precise data collection of various sensors in the cockpit, as well as the precise control actions of various controllers based on the collected data.

[0023] However, existing data acquisition and controller operation processes inevitably have the following problems: there is a lack of linkage between various sensors and controllers, and the actual control actions of each controller are still not precise enough.

[0024] In this embodiment, after acquiring the raw data from each sensor, the system first accurately identifies the current vehicle scene based on this data. Then, based on the scene identification results, it further executes the control actions of each controller. Through accurate scene identification and judgment, and precise association of control strategies within that scene, the system achieves mutual linkage between various controllers in the cockpit, thereby solving the problem of lack of linkage between various sensors and controllers in the cockpit, and significantly improving the response speed of controller actions.

[0025] In this embodiment, the raw data originally collected by the multi-source sensors not only has the characteristics of multiple sources, but also has the characteristics of heterogeneity.

[0026] The term "multi-source" refers to the diverse sources of the raw data collected. Any data sensor related to the vehicle's cockpit can be a source of data for cockpit data collection.

[0027] Heterogeneous data refers to the fact that the original collected data has a very different structure.

[0028] Next, based on the original multi-source heterogeneous data, the current scene of the vehicle is determined.

[0029] It should be understood that in actual use, vehicles may encounter multiple different scenarios. For example, a vehicle may be traveling at high speed on a highway. This scenario can be called a high-speed driving scenario. Another example is when the vehicle is not moving at all; this scenario can be called a parking scenario.

[0030] It should also be understood that, in different vehicle scenarios, the various controllers equipped in the vehicle cabin should be matched with linkage control strategies that are appropriate for the current scenario.

[0031] For example, if the vehicle is currently in a rainy outdoor environment, then the appropriate control strategy should first consider turning on the windshield wipers.

[0032] For example, suppose the outdoor environment where the vehicle is located is sunny. Furthermore, the passengers inside the vehicle's cabin have chosen to ventilate the cabin. In this case, opening the ventilation windows on both sides of the cabin should be the preferred method of ventilation.

[0033] Therefore, after determining the current scenario of the vehicle, a linkage control strategy of the controller that matches the current scenario should be selected.

[0034] The selection of linkage control strategy is based on the features extracted from the current scene recognition results.

[0035] It should be understood that each vehicle's current scenario has corresponding scene characteristic values. For example, in a rainy scenario, there are generally weak sunlight outside the cabin and high air humidity. In a sunny scenario, the light intensity outside the cabin is usually relatively high, while the air humidity is relatively low.

[0036] To select the appropriate linkage control strategy for the vehicle's current scenario, the first step is to identify the corresponding scenario feature values. Then, by utilizing these scenario feature values, the appropriate linkage control strategy can be selected; this process can also be called linkage control strategy matching.

[0037] After matching the linkage control strategy corresponding to the current scenario of the vehicle, the linkage control strategy that each controller should apply in the current scenario is determined.

[0038] Interlocking control strategies define the rules for coordination between different types of controllers. For example, in a single session, it specifies the order in which the first controller should send instructions, and the next controller should send instructions. In other words, it defines the timing sequence in which different controllers should perform sequential control within the same session.

[0039] It is important to note that in the timing logic of control, different control commands may correspond to different priority configurations. Furthermore, different controllers may also correspond to different priority configurations.

[0040] Next, all that is needed is to apply the established linkage control strategy to the corresponding controller and perform the corresponding control operations on the various parameters in the vehicle cabin.

[0041] The solution provided in this embodiment can automatically adapt and adjust the parameters and status of the entire set of cabin equipment according to real-time driving conditions, external environment and user behavior, without requiring users to manually adjust each item. This greatly simplifies the driving and riding operation process, eliminates the defects of cumbersome operation and low intelligence level in the traditional discrete control mode, and significantly improves the overall driving and riding experience and intelligence level.

[0042] Moreover, it solves the problems of poor data interoperability, high bus forwarding latency, and weak anti-interference capability of existing technologies. It can meet the millisecond-level adaptive linkage control requirements in complex dynamic driving scenarios, adapt to the real-time control requirements of intelligent vehicles in dynamic working conditions such as high-speed driving and instantaneous scene switching, and significantly improve the system response accuracy and operational stability.

[0043] Figure 2This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 2 The scene linkage control method includes the following operation steps: S21 collects multi-source heterogeneous data in real time from multiple different data sources and performs fusion preprocessing on the collected multi-source heterogeneous data.

[0044] S22, extract features from the pre-processed multi-source heterogeneous data and determine the scene based on the extracted features.

[0045] S23, based on the determined scene type, adaptively match the scene linkage control strategy.

[0046] S24, based on the matched scene linkage control strategy, multiple devices coordinate and issue linkage control commands.

[0047] S25, obtain the status feedback of the device command execution after the linkage control command is issued.

[0048] S26. Based on the status feedback, perform closed-loop verification of the execution effect.

[0049] Based on the foregoing embodiments of the present invention, this embodiment further provides a solution for obtaining status feedback after the linkage control strategy is executed, that is, after the linkage control command is issued, and verifying the execution effect based on the obtained status feedback.

[0050] It should be understood that after some control commands are issued and executed, the actual feedback received may not match the expectations of the passengers in the cabin.

[0051] If there is a mismatch between the execution effect and the execution expectation, it indicates that there is a problem with the internal links of the above-mentioned linkage control process, and further improvements to the linkage control process are needed.

[0052] In this embodiment, after the linkage control command is issued, the status feedback of the command execution is collected in real time, and the collected status feedback is compared with the expected status before execution, thereby realizing closed-loop verification of the execution effect.

[0053] By conducting closed-loop verification of the execution results, we can discover discrepancies between the actual execution results and the previous execution expectations, thus achieving closed-loop verification of the execution results.

[0054] Figure 3 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 3 The scene linkage control method includes the following operation steps: S31 collects multi-source heterogeneous data in real time from multiple different data sources and performs fusion preprocessing on the collected multi-source heterogeneous data.

[0055] S32 extracts features from the pre-processed multi-source heterogeneous data and determines the scene based on the extracted features.

[0056] S33, based on the determined scene type, adaptively match the scene linkage control strategy.

[0057] S34, based on the matched scene linkage control strategy, enables multiple devices to work together and issue linkage control commands.

[0058] S35: Obtain the status feedback of the device command execution after the linkage control command is issued.

[0059] S36, Based on the status feedback value, determine whether there is an execution deviation.

[0060] S37. If there is an execution deviation, the control parameters in the linkage control strategy shall be corrected.

[0061] By obtaining the status feedback value of the device command execution, it is possible to clearly determine whether there is a deviation between the status feedback value and the previous execution expectation.

[0062] Once a deviation is detected, the control parameters in the linkage control strategy need to be corrected accordingly.

[0063] It is important to note that when correcting control parameters, adjustments should be made based on the direction of the deviation.

[0064] For example, the airflow speed at the air conditioner vent is too high compared to the user's desired speed. In this case, the control parameters should be adjusted to make the airflow speed at the vent lower than originally expected. In other words, the motor speed controlling the vent airflow speed can be reduced.

[0065] Figure 4 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 4 The scene linkage control method includes the following operation steps: S41 collects multi-source heterogeneous data in real time from multiple different data sources and performs fusion preprocessing on the collected multi-source heterogeneous data.

[0066] S42 extracts features from the pre-processed multi-source heterogeneous data and determines the scene based on the extracted features.

[0067] S43, based on the determined scene type, adaptively match the scene linkage control strategy.

[0068] S44, based on the matched scene linkage control strategy, enables multiple devices to work together and issue linkage control commands.

[0069] S45: Obtain the status feedback of the device command execution after the linkage control command is issued.

[0070] S46, based on the status feedback value, determine whether there is a dynamic scene update.

[0071] S47. If there is dynamic scene update, update the standard threshold in scene determination.

[0072] It should be understood that while applying different scenario-based linkage control strategies, there may be dynamic updates to the scenarios for different scenarios.

[0073] Whether a scene dynamic update exists is determined based on the state feedback value. If the state feedback value indicates that a scene dynamic update is warranted, then that update should be executed. Specifically, the standard thresholds used in the scene determination should be updated according to the scene dynamic update criteria.

[0074] Figure 5 This is a flowchart of the matching operation in the scene linkage control method provided in one or more embodiments of the present invention. See also Figure 5 Based on the determined scene type, an adaptive matching scene linkage control strategy is implemented, including: S51, obtain the current scene type.

[0075] S52, Obtain the linkage control strategies used by the cockpit equipment under the aforementioned scenario type.

[0076] S53, by statistically analyzing the linkage control strategies, the linkage control strategy with the highest frequency of use under the aforementioned scenario type is obtained.

[0077] S54, the most frequently used linkage control strategy under the aforementioned scenario type is applied as the matched linkage control strategy.

[0078] The adaptive matching process of the scene linkage control strategy given in this embodiment is a matching process based on historical data.

[0079] Specifically, it involves identifying which scenario-linked control strategies have been historically applied for this scenario type, and then using the scenario-linked control strategy with the highest frequency of use for this scenario type as the current scenario-linked control strategy.

[0080] Figure 6 This is a flowchart of the matching operation in the scene linkage control method provided by one or more embodiments of the present invention. See also Figure 6 Based on the determined scene type, an adaptive matching scene linkage control strategy is implemented, including: S61, obtain the current scene type.

[0081] S62, obtain the linkage control strategy matched by the online model for the current scene type.

[0082] S63 applies the linkage control strategy matched by the online model as the matched linkage control strategy.

[0083] The scene linkage control strategy matching process provided in this embodiment is a process of providing a matching scene linkage control strategy based on an online model.

[0084] Specifically, this involves querying the online model based on the current scenario type, obtaining the scenario linkage control strategy suggestions provided by the online model, and then applying the suggestions provided by the online model as the scenario linkage control strategy for the current scenario.

[0085] Figure 7 This is a flowchart of the matching operation in the scene linkage control method provided by one or more embodiments of the present invention. See also Figure 7 Based on the determined scene type, an adaptive matching scene linkage control strategy is implemented, including: S71, obtain the current scene type.

[0086] S72, obtain the linkage control strategy matched by the online model for the current scene type.

[0087] S73 applies the linkage control strategy matched by the online model as the matched linkage control strategy.

[0088] S74, obtain user feedback on the linkage control strategy.

[0089] S75 optimizes the application's linkage control strategy based on user feedback.

[0090] In this embodiment, not only is the matching of scene linkage control strategies based on the online model completed, but further, a process of optimizing the linkage control strategies based on user feedback is also added.

[0091] For example, if user feedback suggests that the control cycle should be shortened, then the application frequency of the original linkage control strategy should be adjusted to better meet user requirements.

[0092] Figure 8 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 8 The scene linkage control method includes the following operation steps: S81 collects multi-source heterogeneous data in real time from multiple different data sources and performs fusion preprocessing on the collected multi-source heterogeneous data.

[0093] S82 extracts features from the pre-processed multi-source heterogeneous data and determines the scene based on the extracted features.

[0094] S83 adaptively matches scene linkage control strategies based on the determined scene type.

[0095] S84 compares the facial information captured by the DMS camera to determine whether it is a certain facial information that has been recorded.

[0096] In this embodiment, during the issuance and execution of the linkage control strategy, some verification operations need to be performed to ensure the security of the issued linkage control strategy.

[0097] Specifically, it involves verifying the facial information collected by the DMS camera. Only after successful verification will the joint control strategy be considered secure.

[0098] Figure 9 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 9 The scene linkage control method includes the following operation steps: The entire execution process involves multiple perception layers, vehicle bus transmission layers, and the core processing layer of the cockpit domain controller.

[0099] The multi-layer perception system includes perception of the vehicle's driving conditions, perception of the external environment, perception of the cabin interior, and perception of user behavior.

[0100] The vehicle driving condition perception is used to sense vehicle speed, gear, and driving mode.

[0101] External environment perception is used to sense light, weather, temperature and humidity, as well as day and night conditions.

[0102] The cabin interior sensing is used to detect cabin temperature, humidity, and voice.

[0103] User behavior perception is used to detect voice, touch, seat and air conditioning operations.

[0104] The vehicle bus transmission layer includes the CAN / LIN bus and the signal transmission interface.

[0105] The core processing layer of the cockpit domain controller includes a multi-source data fusion preprocessing module, an intelligent scene recognition module, an adaptive matching module, a multi-device collaborative scheduling module, multiple different execution devices, and a cyclic monitoring and correction module.

[0106] The various actuators include: lighting equipment, air conditioning equipment, multimedia equipment, seat actuators, driving alert equipment, and window actuators.

[0107] The multi-source data fusion preprocessing module performs filtering and noise reduction, deduplication and alignment, and anomaly removal.

[0108] The intelligent scene recognition module performs feature extraction and comparison between single and composite scenes.

[0109] The adaptive matching module performs scenario application and user preference matching.

[0110] The multi-device collaborative scheduling module performs instruction generation, timing control, and priority scheduling.

[0111] The cyclic monitoring and correction module performs status comparison, deviation correction, and status update.

[0112] The signals sent from the multi-layer perception layer to the vehicle bus transmission layer are the raw perception data.

[0113] The data sent from the vehicle bus transmission layer to the cockpit domain controller core processing layer is standardized bus data.

[0114] The data sent from the multi-source data fusion preprocessing module to this scene recognition module is the fused standard data.

[0115] The data sent from the intelligent scene recognition module to the adaptive matching module is the scene recognition data.

[0116] The data sent from the adaptive matching module to the multi-device collaborative scheduling module is the matching and linkage strategy.

[0117] The instructions sent by the multi-device collaborative scheduling module to each device are synchronous control instructions.

[0118] The signals sent by each device to the cyclic monitoring and correction module are feedback on the device's execution status.

[0119] Figure 10 This is a flowchart of a scene linkage control method provided in one or more embodiments of the present invention. See also... Figure 10 The scene linkage control method includes the following operation steps: S101, real-time acquisition and fusion preprocessing of multi-source data.

[0120] S102, intelligent driving scene recognition feature extraction and scene determination.

[0121] S103, Adaptive matching scenario linkage control strategy.

[0122] S104, Multi-device collaborative scheduling issues linkage control commands.

[0123] S105, Device status feedback collection and execution effect, closed-loop verification.

[0124] S106. Is there any execution deviation or dynamic scenario update? If yes, proceed to S107; otherwise, proceed to S101.

[0125] S107, dynamically correct control parameters and update linkage strategy, continue executing S104.

[0126] Figure 11 This is a structural diagram of a scene linkage control device provided in one or more embodiments of the present invention. See also... Figure 11 The scene linkage control device includes: The acquisition module 111 is used to acquire multi-source heterogeneous data in real time from multiple different data sources and to perform fusion preprocessing on the acquired multi-source heterogeneous data.

[0127] The determination module 112 is used to extract features from the multi-source heterogeneous data after fusion preprocessing and to determine the scene based on the extracted features.

[0128] The matching module 113 is used to adaptively match the scene linkage control strategy according to the determined scene type.

[0129] The sending module 114 is used to send out linkage control commands to multiple devices in a coordinated manner according to the matched scene linkage control strategy.

[0130] It is worth noting that although only some basic functional modules are disclosed in the embodiments of this invention, it does not mean that the composition of this system is limited to the above-mentioned basic functional modules. On the contrary, what this embodiment intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. The fact that this embodiment only discloses a few basic functional modules should not be considered as the scope of protection of the claims of this invention being limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above device is described separately according to its functions as various units and modules. Of course, in implementing this invention, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0131] like Figure 12 As shown, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the scene linkage control method.

[0132] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. For example... Figure 12 The structure shown in this embodiment of the invention includes an electronic device comprising one or more processors 1210 and a memory 1220; the processors 1210 in this electronic device may be one or more. Figure 12 Taking a processor 1210 as an example; the memory 1220 is used to store one or more programs; the one or more programs are executed by the one or more processors 1210, so that the one or more processors 1210 implement the scene linkage control method as described in any one of the embodiments of the present invention.

[0133] The electronic device may also include an input device 1230 and an output device 1240.

[0134] The processor 1210, memory 1220, input device 1230, and output device 1240 in this electronic device can be connected via a bus or other means. Figure 12 Taking the example of a connection between China and Israel via a bus.

[0135] The memory 1220 in this electronic device serves as a computer-readable storage medium, capable of storing one or more programs. These programs can be software programs, computer-executable programs, or modules, such as the program instructions / modules corresponding to the scene linkage control method provided in this embodiment. The processor 1210 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the memory 1220, thereby implementing the scene linkage control method described in the above embodiment.

[0136] Memory 1220 may include a program storage area and a data storage area, wherein the program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the electronic device, etc. Furthermore, memory 1220 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, memory 1220 may further include memory remotely located relative to processor 1210, and these remote memories may be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0137] Input device 1230 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the electronic device. Output device 1240 may include display devices such as a display screen.

[0138] The present invention also provides a computer-readable storage medium, comprising: storing a computer program executable by a vehicle, wherein when the computer program is run on the vehicle, the vehicle performs the steps of the scene linkage control method.

[0139] Specifically, the computer storage medium in this embodiment of the invention can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0140] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A scene linkage control method, characterized in that, The scenario linkage control method includes: Collect multi-source heterogeneous data in real time from a plurality of different data sources, and perform fusion preprocessing on the collected multi-source heterogeneous data; Perform feature extraction on the multi-source heterogeneous data after fusion preprocessing, and perform scenario determination according to the extracted features; Adaptively match a scenario linkage control strategy according to the determined scenario type, wherein the scenario linkage control strategy includes a timing control strategy and a priority scheduling strategy; According to the matched scenario linkage control strategy, a plurality of devices perform coordinated linkage to issue a linkage control instruction.

2. The method according to claim 1, characterized in that, The method further includes: Acquire the state feedback of device instruction execution after the linkage control instruction is issued; Perform closed-loop verification of the execution effect according to the state feedback.

3. The method according to claim 2, characterized in that, Performing closed-loop verification of the execution effect according to the state feedback includes: Judging whether there is an execution deviation according to the state feedback value; If an execution deviation exists, correcting the control parameter in the linkage control strategy.

4. The method according to claim 2, characterized in that, Performing closed-loop verification of the execution effect according to the state feedback includes: Judging whether there is dynamic scenario update according to the state feedback value; If dynamic scenario update exists, updating the standard threshold in scenario determination.

5. The method according to claim 1, characterized in that, Adaptively matching a scenario linkage control strategy according to the determined scenario type includes: Acquire the currently determined scenario type; Acquire the linkage control strategy that has been adopted by the cockpit device under the scenario type; Obtain the linkage control strategy with the highest use frequency under the scenario type by performing statistics on the linkage control strategies; Applying the linkage control strategy with the highest use frequency under the scenario type as the matched linkage control strategy.

6. The method according to claim 1, characterized in that, Adaptively matching a scenario linkage control strategy according to the determined scenario type includes: Acquire the currently determined scenario type; Acquire the linkage control strategy matched by the online model for the current scenario type; Applying the linkage control strategy matched by the online model as the matched linkage control strategy.

7. The method according to claim 6, characterized in that, Adaptively matching a scenario linkage control strategy according to the determined scenario type further includes: Acquire user feedback of the linkage control strategy; Optimize the applied linkage control strategy according to the user feedback.

8. The method according to claim 1, characterized in that, According to the matched scenario linkage control strategy, a plurality of devices perform coordinated linkage to issue a linkage control instruction includes: Comparing the face information collected by the DMS camera, and judging whether it is a certain pre-registered face information.

9. A scene linkage control device, characterized in that, The scenario linkage control apparatus includes: A collection module, configured to collect multi-source heterogeneous data in real time from a plurality of different data sources, and perform fusion preprocessing on the collected multi-source heterogeneous data; A determination module, configured to perform feature extraction on the multi-source heterogeneous data after fusion preprocessing, and perform scenario determination according to the extracted features; A matching module, configured to adaptively match a scenario linkage control strategy according to the determined scenario type, wherein the scenario linkage control strategy includes a timing control strategy and a priority scheduling strategy; An issuing module, configured to, according to the matched scenario linkage control strategy, enable a plurality of devices to perform coordinated linkage and issue a linkage control instruction.

10. An electronic device, characterized in that, The electronic device includes: A processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus; The memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the scene linkage control method according to any one of claims 1 to 8.

Images