Self-adaptive control method and device for vehicle-mounted entertainment information system

Abstract

The invention relates to a self-adaptive control method and device for a vehicle-mounted entertainment information system, and belongs to the technical field of vehicle control, and the self-adaptive control method for the vehicle-mounted entertainment information system comprises the steps: obtaining the video stream data of an area where a target child is located, determining the metadata of a target picture book based on the video stream data, the metadata comprises a picture book theme, a picture book name and a picture book tone, the efficiency value is used for representing the positive degree or negative degree of emotion, the wake-up degree is used for representing the intense degree of emotion, and the concentration degree is used for representing the cognitive input degree; based on the metadata of the target picture book, determining a first control instruction used for controlling a vehicle-mounted audio system and a second control instruction used for controlling a vehicle-mounted atmosphere lamp system; and adjusting the first control instruction and the second control instruction based on the efficiency value, the wake-up degree and the concentration degree of the target child. According to the invention, the riding experience and riding safety of children are effectively improved.

Description

Technical Field

[0001] This invention relates to the field of vehicle control technology, and in particular to an adaptive control method and apparatus for an in-vehicle entertainment information system. Background Technology

[0002] With the rapid development of intelligent vehicle technology, in-vehicle infotainment systems are increasingly becoming a core component in enhancing the driving experience. For families with children, providing safe, immersive, and educational entertainment experiences while driving, and simultaneously ensuring safety supervision, is an important need.

[0003] Existing technologies for child safety monitoring use cameras or sensors to monitor children's status inside the vehicle, determine if a child has been left behind, and send alerts to guardians, focusing on passive safety warnings. In terms of content generation, artificial intelligence is used to analyze story text, automatically recommend and synthesize matching voices and sound effects to generate personalized audio stories. It also supports the creation of non-linear audio stories with branching plots and interactive options, enhancing the content's appeal. While in-vehicle ambient lighting technology is relatively mature, current ambient lighting controls are mostly used for decoration, driving mode indication, or to synchronize with music. Existing in-vehicle infotainment systems suffer from limited functionality and poor coordination.

[0004] Therefore, how to coordinate and control different functions of in-vehicle infotainment systems to improve children's riding experience and safety has become an urgent technical problem to be solved. Summary of the Invention

[0005] In view of this, it is necessary to provide an adaptive control method and device for an in-vehicle entertainment information system to improve children's riding experience and safety.

[0006] To achieve the above objectives, in a first aspect, the present invention provides an adaptive control method for an in-vehicle infotainment system, comprising: Acquire video stream data of the area where the target children are located, and determine the metadata of the target picture book, as well as the effectiveness value, arousal and concentration of the target children based on the video stream data. The metadata includes the picture book theme, picture book name and picture book color. Effectiveness value is used to indicate the positive or negative degree of emotion, arousal is used to indicate the intensity of emotion, and concentration is used to indicate the degree of cognitive engagement. Based on the metadata of the target picture book, a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system are determined. Based on the effectiveness, arousal, and concentration of the target child, the first and second control commands are adjusted.

[0007] In one possible implementation, determining the metadata of the target picture book based on video stream data includes: The image of the target picture book is obtained from the video stream data, and the picture book image features are extracted from the image of the target picture book. The image features of the picture book are matched with the picture book feature library to determine the metadata of the target picture book.

[0008] In one possible implementation, the determination of the target child's effectiveness, arousal, and focus includes: Facial images of the target child are obtained from video stream data. The facial images of the target child are used as input to the emotion classification model to obtain the emotion probability distribution of the target child. The emotion classification model is trained on a convolutional neural network containing an attention mechanism, using a set of facial image samples as samples and the corresponding emotion probability distribution of the facial image sample set as labels. The emotion probability distribution includes the probability distribution of anger, disgust, fear, happiness, sadness, surprise and neutral emotions. Based on the emotional probability distribution of the target children, the effectiveness value, arousal level, and focus level of the target children are determined.

[0009] In one possible implementation, determining the target child's effectiveness, arousal, and focus based on the target child's emotional probability distribution includes: The target children's emotional probability distribution is weighted and fused based on preset weight coefficients to determine the target children's effectiveness value, arousal level, and concentration level.

[0010] In one possible implementation, determining a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system based on the metadata of the target picture book includes: Based on the metadata of the target picture book, the control rules for the in-vehicle audio system and the in-vehicle ambient lighting system are determined in the preset control rule base; Based on the control rules of the vehicle audio system and the vehicle ambient lighting system, a first control command for controlling the vehicle audio system and a second control command for controlling the vehicle ambient lighting system are determined.

[0011] In one possible implementation, adjusting the first and second control commands based on the target child's effectiveness, arousal, and focus includes: Based on the metadata of the target picture book, determine the benchmark effectiveness value, benchmark arousal level, and benchmark focus level corresponding to the target picture book; Based on the first deviation value, the second deviation value, and the third deviation value, the first control command and the second control command are adjusted. The first deviation value is the difference between the effectiveness value of the target child and the benchmark effectiveness value. The second deviation value is the difference between the arousal level of the target child and the benchmark arousal level. The third deviation value is the difference between the focus level of the target child and the benchmark focus level.

[0012] In one possible implementation, adjusting the first control command and the second control command based on the first deviation value, the second deviation value, and the third deviation value includes: Based on the first deviation value, the second deviation value, and the third deviation value, as well as the preset adjustment rules for the in-vehicle audio system and the in-vehicle ambient lighting system corresponding to the deviation values, the first control command and the second control command are adjusted.

[0013] On the other hand, the present invention also provides an adaptive control device for an in-vehicle infotainment system, comprising: The acquisition module is used to acquire video stream data of the area where the target child is located, and to determine the metadata of the target picture book, as well as the effectiveness value, arousal and concentration of the target child based on the video stream data. The metadata includes the picture book theme, picture book name and picture book color. The effectiveness value is used to indicate the positive or negative degree of emotion, the arousal value is used to indicate the intensity of emotion, and the concentration is used to indicate the degree of cognitive engagement. The determination module is used to determine, based on the metadata of the target picture book, a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system; The adjustment module is used to adjust the first and second control commands based on the effectiveness, arousal, and focus of the target child.

[0014] Secondly, the present invention also provides a control device, including a memory and a processor, wherein, The memory is used to store programs; The processor, coupled to the memory, is used to execute the program stored in the memory to implement the steps in the adaptive control method of the in-vehicle infotainment system described in any of the above implementations.

[0015] Thirdly, the present invention also provides a computer-readable storage medium for storing a computer-readable program or instructions, which, when executed by a processor, can implement the steps of the adaptive control method of the in-vehicle entertainment information system described in any of the above implementations.

[0016] The beneficial effects of this invention are as follows: The adaptive control method and apparatus for an in-vehicle entertainment information system provided by this invention, by acquiring video stream data of the area where the target child is located, determines the metadata of the target picture book, as well as the effectiveness, arousal level, and concentration level of the target child, thereby determining the target child's direction of interest and the real-time emotional state of the target child while reading the target picture book. This provides a baseline for the control of the in-vehicle entertainment information system and a basis for fine-tuning the system. Then, based on the metadata of the target picture book, the in-vehicle audio system and the in-vehicle ambient lighting system are controlled, making the operating modes of the in-vehicle audio system and the in-vehicle ambient lighting system closely resemble those of the target picture book. The metadata of the book encourages children to become more immersed in reading picture books, thereby improving their riding experience and preventing them from moving around freely in the car, thus indirectly improving their riding safety. Finally, by adjusting the first and second control commands based on the effectiveness value, arousal level, and concentration level that reflect the real-time emotional state of the target child, the in-vehicle audio system and in-vehicle ambient lighting system can be adjusted according to the target child's emotions, thereby further improving the target child's immersion. In short, this invention effectively improves both the riding experience and the safety of children. Attached Figure Description

[0017] Figure 1 A schematic flowchart of an embodiment of the adaptive control method for an in-vehicle entertainment information system provided by the present invention; Figure 2 A schematic diagram of an embodiment of the adaptive control architecture of the in-vehicle entertainment information system provided by the present invention; Figure 3 A schematic diagram of an embodiment of the adaptive control process of the in-vehicle entertainment information system provided by the present invention; Figure 4 A schematic diagram of an embodiment of the adaptive control device for an in-vehicle entertainment information system provided by the present invention; Figure 5 A schematic diagram of an embodiment of the control device provided by the present invention. Detailed Implementation

[0018] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0019] In the description of the embodiments of the present invention, unless otherwise stated, "multiple" means two or more. "And / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone.

[0020] The terms "first," "second," etc., used in the embodiments of this invention are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, a technical feature defined with "first" or "second" may explicitly or implicitly include at least one of that feature.

[0021] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of the invention. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0022] This invention provides an adaptive control method and apparatus for an in-vehicle infotainment system, which will be described below.

[0023] Figure 1 This is a schematic flowchart of an embodiment of the adaptive control method for an in-vehicle infotainment system provided by the present invention, as shown below. Figure 1 As shown, the adaptive control method for in-vehicle infotainment systems includes: S101. Obtain video stream data of the area where the target child is located, and determine the metadata of the target picture book, as well as the effectiveness value, arousal and concentration of the target child based on the video stream data. The metadata includes the picture book theme, picture book name and picture book color. The effectiveness value is used to indicate the positive or negative degree of emotion, the arousal is used to indicate the intensity of emotion, and the concentration is used to indicate the degree of cognitive engagement.

[0024] It should be noted that the adaptive control method for in-vehicle entertainment information systems provided by this invention can be applied to control scenarios of in-vehicle entertainment information systems, especially when there are children in the vehicle.

[0025] When performing adaptive control of an in-vehicle infotainment system, the control device (such as an in-vehicle controller or terminal) first acquires video stream data of the area where the target child is located. This video stream data can be obtained through an in-vehicle camera. Next, the metadata of the target picture book (i.e., the picture book the child is reading), as well as the child's effectiveness, arousal, and focus, can be determined using this video stream data. Metadata may include the picture book's theme, title, and color scheme, reflecting the child's interests and providing a tone for the control of the in-vehicle infotainment system. Secondly, the video stream data can also be used to determine the child's effectiveness, arousal, and focus. Effectiveness can represent the degree of positivity or negativity of emotion, arousal can represent the intensity of emotion, and focus can represent the level of cognitive engagement. By analyzing the child's effectiveness, arousal, and focus, the real-time emotional state of the child while reading the target picture book can be determined, providing a basis for fine-tuning the in-vehicle infotainment system.

[0026] S102. Based on the metadata of the target picture book, determine the first control command for controlling the in-vehicle audio system and the second control command for controlling the in-vehicle ambient lighting system.

[0027] It should be noted that after determining the metadata of the target picture book, a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system can be determined based on this metadata. This, in turn, controls the in-vehicle audio and ambient lighting systems, ensuring their operating modes closely match the metadata of the target picture book. This promotes greater immersion for children in reading the book, thereby improving their car travel experience. Furthermore, increased immersion in reading also prevents children from moving around freely in the car, thus indirectly improving their safety while traveling.

[0028] S103. Adjust the first and second control instructions based on the effectiveness, arousal, and concentration of the target child.

[0029] It should be noted that, since children's emotions are changeable, in order to enable the target children to be more immersed in picture book reading, the first and second control commands can be adjusted by reflecting the effectiveness, arousal, and concentration of the target children's real-time emotional state. This allows the operation mode of the in-vehicle audio system and the in-vehicle ambient lighting system to not only closely match the metadata of the target picture book, but also adjust according to the target children's emotions, thereby further improving the children's immersion and enhancing both the children's riding experience and their safety.

[0030] In summary, the adaptive control method for an in-vehicle entertainment information system provided in this embodiment of the invention obtains video stream data of the area where the target child is located, determines the metadata of the target picture book, and the effectiveness, arousal, and concentration of the target child. This, in turn, determines the target child's area of ​​interest and their real-time emotional state while reading the picture book, providing a baseline for the control of the in-vehicle entertainment information system and a basis for fine-tuning it. Then, based on the metadata of the target picture book, the method controls the in-vehicle audio system and the in-vehicle ambient lighting system, ensuring that their operating modes closely match the metadata of the target picture book. Data is used to encourage children to become more immersed in reading picture books, thereby improving their riding experience and preventing them from moving around freely in the car, thus indirectly improving their riding safety. Finally, by adjusting the first and second control commands based on the effectiveness value, arousal level, and concentration level that reflect the real-time emotional state of the target children, the in-vehicle audio system and in-vehicle ambient lighting system can be adjusted according to the target children's emotions, thereby further improving the children's immersion. In short, this invention effectively improves both the children's riding experience and their riding safety.

[0031] In some embodiments of the present invention, determining the metadata of the target picture book based on video stream data includes: The image of the target picture book is obtained from the video stream data, and the picture book image features are extracted from the image of the target picture book. The image features of the picture book are matched with the picture book feature library to determine the metadata of the target picture book.

[0032] It should be noted that when determining the metadata of a target picture book based on video stream data, images of the target picture book can be obtained from the video stream data. Then, picture book image features can be extracted from these images (for example, using VGG networks or ResNet networks). These image features are then matched against a picture book feature library to determine the target picture book's metadata. The picture book feature library compiles image features for various picture books and can be updated in real-time by downloading the latest picture book data from the cloud.

[0033] In some embodiments of the present invention, the determination of the effectiveness, arousal, and focus of the target child includes: Facial images of the target child are obtained from video stream data. The facial images of the target child are used as input to the emotion classification model to obtain the emotion probability distribution of the target child. The emotion classification model is trained on a convolutional neural network containing an attention mechanism, using a set of facial image samples as samples and the corresponding emotion probability distribution of the facial image sample set as labels. The emotion probability distribution includes the probability distribution of anger, disgust, fear, happiness, sadness, surprise and neutral emotions. Based on the emotional probability distribution of the target children, the effectiveness value, arousal level, and focus level of the target children are determined.

[0034] It should be noted that when determining the effectiveness, arousal, and focus of the target child, facial images of the target child can be obtained from video stream data. These facial images are used as input to an emotion classification model to obtain the emotion probability distribution of the target child (e.g., by extracting facial action unit (AU) keypoints from the facial images to determine the emotion probability distribution). The emotion classification model is trained on a convolutional neural network that incorporates attention mechanisms, using a set of facial image samples as samples and the corresponding emotion probability distribution as labels. The emotion probability distribution can include the probability distributions of anger, disgust, fear, happiness, sadness, surprise, and neutral emotions. After determining the emotion probability distribution of the target child, the effectiveness, arousal, and focus of the target child can be further determined based on this distribution.

[0035] In some embodiments of the present invention, determining the effectiveness, arousal, and focus of the target child based on the emotional probability distribution of the target child includes: The target children's emotional probability distribution is weighted and fused based on preset weight coefficients to determine the target children's effectiveness value, arousal level, and concentration level.

[0036] It should be noted that when determining the effectiveness value, arousal level, and focus level of a target child based on the emotional probability distribution of the target child, the emotional probability distribution of the target child can be weighted and fused according to preset weight coefficients to determine the effectiveness value, arousal level, and focus level of the target child.

[0037] In some embodiments of the present invention, determining a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system based on the metadata of the target picture book includes: Based on the metadata of the target picture book, the control rules for the in-vehicle audio system and the in-vehicle ambient lighting system are determined in the preset control rule base; Based on the control rules of the vehicle audio system and the vehicle ambient lighting system, a first control command for controlling the vehicle audio system and a second control command for controlling the vehicle ambient lighting system are determined.

[0038] It should be noted that when determining the first control command for controlling the vehicle audio system and the second control command for controlling the vehicle ambient lighting system based on the metadata of the target picture book, the control rules for the vehicle audio system and the vehicle ambient lighting system can be determined from the preset control rule library using the metadata of the target picture book (the preset control rule library stores the control rules for the vehicle audio system and the vehicle ambient lighting system corresponding to different picture book metadata). Then, based on the determined control rules for the vehicle audio system and the vehicle ambient lighting system, the first control command for controlling the vehicle audio system and the second control command for controlling the vehicle ambient lighting system are determined.

[0039] In some embodiments of the present invention, adjusting the first and second control commands based on the effectiveness, arousal, and focus of the target child includes: Based on the metadata of the target picture book, determine the benchmark effectiveness value, benchmark arousal level, and benchmark focus level corresponding to the target picture book; Based on the first deviation value, the second deviation value, and the third deviation value, the first control command and the second control command are adjusted. The first deviation value is the difference between the effectiveness value of the target child and the benchmark effectiveness value. The second deviation value is the difference between the arousal level of the target child and the benchmark arousal level. The third deviation value is the difference between the focus level of the target child and the benchmark focus level.

[0040] It should be noted that when adjusting the first and second control instructions based on the effectiveness, arousal, and concentration of the target child, the baseline effectiveness, arousal, and concentration of the target picture book can be determined first by using the target picture book's metadata. Then, the deviations between the target child's effectiveness, arousal, and concentration and the baseline effectiveness, arousal, and concentration (i.e., the first deviation value, the second deviation value, and the third deviation value) can be determined. Finally, the first and second control instructions can be adjusted based on the first deviation value, the second deviation value, and the third deviation value.

[0041] In some embodiments of the present invention, adjusting the first control command and the second control command based on the first deviation value, the second deviation value, and the third deviation value includes: Based on the first deviation value, the second deviation value, and the third deviation value, as well as the preset adjustment rules for the in-vehicle audio system and the in-vehicle ambient lighting system corresponding to the deviation values, the first control command and the second control command are adjusted.

[0042] It should be noted that when adjusting the first control command and the second control command based on the first deviation value, the second deviation value and the third deviation value, the adjustment strategy corresponding to the first deviation value, the second deviation value and the third deviation value can be determined from the preset adjustment rules of the vehicle audio system and the vehicle ambient lighting system corresponding to the deviation value, and then the first control command and the second control command can be adjusted.

[0043] This invention establishes a hierarchical fusion decision-making framework: the first layer uses picture book recognition to establish an unchangeable service theme and core experience framework, and the second layer uses emotion recognition as a dynamic fine-tuning factor to optimize environmental parameters within this framework.

[0044] Combination Figure 2 The adaptive control architecture specifically includes: 1. Picture Book-Driven Context Construction Module: This module identifies specific picture books using in-vehicle visual sensors and extracts their thematic metadata. The output of this module is the initialization conditions and thematic baseline for the entire system's operation.

[0045] 2. Emotion Perception Fine-Tuning Module: This module uses lightweight visual or audio analysis to obtain a score of the child's current emotional state. This signal is not used to reverse or switch the theme; it is only used to characterize the user's real-time experience within a given theme.

[0046] 3. Integrated Decision-Making and Collaborative Control Module: Receives the above two inputs. Its decision-making logic is as follows: First, based on the picture book's theme metadata, it generates a complete set of theme-consistent audio and lighting environment construction instructions to establish the "base experience." Second, it introduces emotion scoring as a correction coefficient to smoothly fine-tune the adjustable parameters in the "base experience" (such as volume, speech rate, light brightness, and dynamic rhythm).

[0047] 4. Theme Consistency Multi-Dimensional Execution Module: This module includes an audio content engine and an ambient light field rendering module responsible for executing instructions after fusion decisions, ultimately outputting an immersive cockpit environment with a unified theme that dynamically adapts to the user's state.

[0048] Combination Figure 3 The adaptive control process of an in-vehicle infotainment system includes the following steps: 1. System initialization and triggering.

[0049] Triggering conditions: The system listens for signals from the vehicle's Controller Area Network (CAN) bus, including when the vehicle is powered on and the rear seat pressure sensors are activated.

[0050] Initialization action: The picture book recognition layer is activated, the in-vehicle camera is activated, and the video stream facing the child seat area is started.

[0051] 2. Picture book-based identification and base creation (main path).

[0052] Object detection: Real-time analysis of video streams to locate objects such as "books".

[0053] Feature matching: After detecting a book, fine-grained features are extracted from the book area image and matched against the "picture book feature library". This process is completed within 500ms, and the result is confirmed by identifying three consecutive consistent frames, thus improving accuracy.

[0054] Decision-making and dissemination: Success: Generate a base building instruction containing metadata such as picture book ID, theme, and main color scheme, and send it to the fusion control center with high priority.

[0055] Failure: The system exits silently or prompts parents via the dashboard that "no picture book was recognized".

[0056] Base environment locked: Lock the topic: Set the core topic of this service as an immutable variable, and all subsequent operations will be performed within this framework.

[0057] Parallel delivery: Initial parameters are delivered to the audio and lighting engines.

[0058] The mapping logic table from picture book themes to lighting patterns is as follows:

[0059] The mapping logic table from picture book themes to audio is as follows:

[0060] 3. Emotion perception and dynamic fine-tuning (auxiliary circulation).

[0061] Asynchronous startup: After the base environment is built, a startup command is sent to the emotion perception system to clarify the subordinate relationship between the emotion perception system and the already built theme experience.

[0062] Continuous sensing and fine-tuning: operates at a fixed frequency.

[0063] Calculation: Analyze facial features and output continuous emotion values.

[0064] The system uses a classification model based on convolutional neural networks (CNN) and attention mechanisms. Based on 17 key AU intensity vectors, it outputs a probability distribution of 7 basic emotions, P=[p_anger, p_disgust, p_fear, p_happy, p_sad, p_surprise, p_neutral].

[0065] The rule-based AU-sentiment mapping relationship is shown in the table below:

[0066] The discrete emotion categories are converted into continuous dimensions using a probability-weighted mapping method, and valence (the degree of positivity / negativity of emotion), arousal (the intensity of emotion), and focus (the degree of cognitive engagement) are calculated.

[0067] The effectiveness value is calculated as valence = Σ(w_i × p_i), where the weights w = [-0.9, -0.7, -0.8, +0.9, -0.6, +0.3, 0.0], corresponding to anger, disgust, fear, happiness, sadness, surprise, and neutrality, respectively; the range is [-1, 1]. Valence > 0.6 represents "very positive", Valence > 0.3 represents "relatively positive", Valence > -0.3 represents "neutral", Valence > -0.6 represents "relatively negative", and others represent "very negative".

[0068] Arousal is calculated as Arousal = Σ(a_i × p_i), where the weights a = [0.8, 0.6, 0.9, 0.7, 0.4, 0.9, 0.1], corresponding to anger, disgust, fear, happiness, sadness, surprise, and neutrality, respectively; the range is [0, 1]. Arousal > 0.7 represents "high arousal", Arousal > 0.4 represents "moderate arousal", and others represent "low arousal".

[0069] Attention is calculated as Attention=f(AU45,AU61,AU63); the range is [0,1]. Attention>0.7 represents “high focus”, Attention>0.4 represents “moderate focus”, and others represent “distracted attention”.

[0070] Generate fine-tuning vectors: Compare the emotion value with the preset tone of the picture book, calculate the deviation, and adjust the parameters of each actuator for fusion execution: valence deviation △V=V_E-V_B; arousal deviation △A=A_E-A_B; valence deviation △Att=Att_E-Att_B.

[0071] The audio parameter adjustment matrix is ​​as follows:

[0072] The lighting parameter adjustment matrix is ​​as follows:

[0073] Dynamic nature: This circulation continues throughout the service, allowing the cabin environment to "breathe" and "adapt," rather than remaining static.

[0074] 4. Closed-loop feedback and adaptive optimization.

[0075] Feedback collection: The system not only outputs data but also continuously monitors the effectiveness of the intervention.

[0076] Strategy Evaluation and Adjustment: The Integration Control Center evaluates the effectiveness of the current fine-tuning strategy.

[0077] If effective: Maintain the current fine-tuning coefficient.

[0078] If ineffective (e.g., persistent irritability): slowly increase the fine-tuning coefficient to enhance the fine-tuning intensity, or try switching the fine-tuning strategy (e.g., from "reducing stimulation" to "increasing fun interaction").

[0079] The rules for adjusting interaction and security policies are as follows:

[0080] 5. Service terminated.

[0081] Triggering conditions: The vehicle is powered off or the seat pressure sensor has no pressure for an extended period of time.

[0082] Graceful Exit: The integrated control center coordinates a smooth exit for all engines. Audio fades out and lighting gently transitions to default settings, avoiding abrupt changes that might startle children.

[0083] This invention enables service content to be precisely anchored to children's current interests (picture books), while dynamically optimizing the presentation based on their emotions. Through the collaborative construction of a multi-dimensional environment around the same theme, it significantly enhances the immersiveness and attractiveness of the entertainment experience. By attracting children's attention through immersive experiences, it reduces crying and dangerous behaviors. Combined with contextualized safety prompts, it realizes a safety paradigm shift from passive monitoring to proactive guidance, forming a complete perception-decision-execution closed loop, demonstrating a high level of system integration and intelligence.

[0084] This invention revolutionizes the interaction paradigm of in-vehicle child services. It uses physical picture book recognition as the unique and deterministic service trigger and theme framework definer, constructing a consistent audio, lighting, and safety base environment within seconds. Simultaneously, it introduces emotion perception as a real-time auxiliary fine-tuning loop, dynamically optimizing base environment parameters without altering the established theme. This not only solves the problems of misinterpretation of intent and fragmented experience caused by a single signal source (such as emotion alone or manual selection alone), but also, through a "base locking + parameter fine-tuning" mechanism, ensures service accuracy and theme immersion while achieving continuous adaptation to the child's state. Ultimately, it establishes a proactive and intelligent collaborative relationship between safety monitoring and entertainment experience.

[0085] To better implement the adaptive control method for the in-vehicle infotainment system in this embodiment of the invention, based on the adaptive control method for the in-vehicle infotainment system, correspondingly, as follows: Figure 4 As shown, this embodiment of the invention also provides an adaptive control device for an in-vehicle infotainment system. The adaptive control device 400 for the in-vehicle infotainment system includes: The acquisition module 401 is used to acquire video stream data of the area where the target child is located, and determine the metadata of the target picture book, as well as the effectiveness value, arousal and concentration of the target child based on the video stream data. The metadata includes the picture book theme, picture book name and picture book color. The effectiveness value is used to indicate the positive or negative degree of emotion, the arousal is used to indicate the intensity of emotion, and the concentration is used to indicate the degree of cognitive engagement. The determination module 402 is used to determine, based on the metadata of the target picture book, a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system. The adjustment module 403 is used to adjust the first control command and the second control command based on the effectiveness, arousal and concentration of the target child.

[0086] The adaptive control device 400 of the in-vehicle infotainment system provided in the above embodiments can realize the technical solutions described in the embodiments of the adaptive control method of the in-vehicle infotainment system. The specific implementation principles of each module or unit can be found in the corresponding content in the embodiments of the adaptive control method of the in-vehicle infotainment system, which will not be repeated here.

[0087] like Figure 5 As shown, the present invention also provides a control device 500. The control device 500 includes a processor 501, a memory 502, and a display 503. Figure 5 Only some components of the control device 500 are shown, but it should be understood that it is not required to implement all of the components shown, and more or fewer components may be implemented instead.

[0088] In some embodiments, processor 501 may be a central processing unit (CPU), microprocessor, or other data processing chip, used to run program code stored in memory 502 or process data, such as the adaptive control method of the in-vehicle infotainment system in this invention.

[0089] In some embodiments, processor 501 may be a single server or a group of servers. The server group may be centralized or distributed. In some embodiments, processor 501 may be local or remote. In some embodiments, processor 501 may be implemented on a cloud platform. In one embodiment, the cloud platform may include a private cloud, public cloud, hybrid cloud, community cloud, distributed cloud, internal cloud, multi-cloud, etc., or any combination thereof.

[0090] In some embodiments, memory 502 may be an internal storage unit of control device 500, such as a hard disk or memory of control device 500. In other embodiments, memory 502 may also be an external storage device of control device 500, such as a pluggable hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., provided on control device 500.

[0091] Furthermore, the memory 502 may include both internal storage units of the control device 500 and external storage devices. The memory 502 is used to store application software and various types of data installed on the control device 500.

[0092] In some embodiments, display 503 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, or an organic light-emitting diode (OLED) touchscreen. Display 503 is used to display information from control device 500 and to display a visual user interface. Components 501-503 of control device 500 communicate with each other via a system bus.

[0093] In one embodiment, when processor 501 executes the adaptive control program for the in-vehicle infotainment system in memory 502, the following steps can be implemented: Acquire video stream data of the area where the target children are located, and determine the metadata of the target picture book, as well as the effectiveness value, arousal and concentration of the target children based on the video stream data. The metadata includes the picture book theme, picture book name and picture book color. Effectiveness value is used to indicate the positive or negative degree of emotion, arousal is used to indicate the intensity of emotion, and concentration is used to indicate the degree of cognitive engagement. Based on the metadata of the target picture book, a first control command for controlling the in-vehicle audio system and a second control command for controlling the in-vehicle ambient lighting system are determined. Based on the effectiveness, arousal, and concentration of the target child, the first and second control commands are adjusted.

[0094] It should be understood that when the processor 501 executes the adaptive control program of the in-vehicle infotainment system in the memory 502, in addition to the functions mentioned above, it can also perform other functions, as detailed in the description of the corresponding method embodiments above.

[0095] Furthermore, this embodiment of the invention does not specifically limit the type of control device 500 mentioned. Control device 500 can be a portable electronic device such as a mobile phone, tablet computer, personal digital assistant (PDA), wearable device, or laptop computer. Exemplary embodiments of portable electronic devices include, but are not limited to, portable electronic devices running iOS, Android, Microsoft, or other operating systems. The aforementioned portable electronic devices can also be other portable electronic devices, such as laptop computers with touch-sensitive surfaces (e.g., touch panels). It should also be understood that in some other embodiments of the invention, control device 500 may not be a portable electronic device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0096] Accordingly, this application also provides a computer-readable storage medium for storing computer-readable programs or instructions. When the programs or instructions are executed by a processor, they can implement the steps or functions of the adaptive control method of the in-vehicle entertainment information system provided in the above-described method embodiments.

[0097] Those skilled in the art will understand that all or part of the processes of the methods described in the above embodiments can be implemented by a computer program instructing related hardware (such as a processor, controller, etc.), and the computer program can be stored in a computer-readable storage medium. The computer-readable storage medium may be a disk, optical disk, read-only memory, or random access memory, etc.

[0098] The adaptive control method and device for the in-vehicle entertainment information system provided by the present invention have been described in detail above. Specific examples have been used to illustrate the principle and implementation of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core idea of ​​the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation and application scope based on the idea of ​​the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A method of adaptive control of an in-vehicle infotainment system, characterized in that, The method comprises: obtaining video stream data of a region where a target child is located, determining metadata of a target picture book, and valence, arousal and focus of the target child based on the video stream data, the metadata comprising a picture book theme, a picture book name and a picture book color tone, the valence being used to represent a positive or negative degree of emotion, the arousal being used to represent an intensity of emotion, and the focus being used to represent a cognitive input degree; determining a first control instruction for controlling a vehicle-mounted audio system and a second control instruction for controlling a vehicle-mounted atmosphere lamp system based on the metadata of the target picture book; adjusting the first control instruction and the second control instruction based on the valence, the arousal and the focus of the target child.

2. The method of adaptive control of an in-vehicle infotainment system of claim 1, wherein, The method further comprises: obtaining an image of the target picture book from the video stream data, and extracting picture book image features from the image of the target picture book; matching the picture book image features with a picture book feature library to determine the metadata of the target picture book.

3. The method of adaptive control of an in-vehicle infotainment system of claim 1, wherein, The method further comprises: obtaining a facial image of the target child from the video stream data, inputting the facial image of the target child into an emotion classification model to obtain an emotion probability distribution of the target child, the emotion classification model being trained based on a facial image sample set and an emotion probability distribution corresponding to the facial image sample set, the emotion probability distribution comprising probability distributions of angry, disgusted, fearful, happy, sad, surprised and neutral emotions; determining the valence, the arousal and the focus of the target child based on the emotion probability distribution of the target child.

4. The method of adaptive control of an in-vehicle infotainment system of claim 3, wherein, The method further comprises: weighting and fusing the emotion probability distribution of the target child based on preset weight coefficients to determine the valence, the arousal and the focus of the target child.

5. The method of adaptive control of an in-vehicle infotainment system of claim 1, wherein, The method further comprises: determining control rules of the vehicle-mounted audio system and the vehicle-mounted atmosphere lamp system in a preset control rule library based on the metadata of the target picture book; determining the first control instruction for controlling the vehicle-mounted audio system and the second control instruction for controlling the vehicle-mounted atmosphere lamp system based on the control rules of the vehicle-mounted audio system and the vehicle-mounted atmosphere lamp system.

6. The method of adaptive control of an in-vehicle infotainment system of claim 1, wherein, The method further comprises: determining reference valence, reference arousal and reference focus corresponding to the target picture book based on the metadata of the target picture book; adjusting the first control instruction and the second control instruction based on a first deviation value, a second deviation value and a third deviation value, the first deviation value being a difference between the valence of the target child and the reference valence, the second deviation value being a difference between the arousal of the target child and the reference arousal, and the third deviation value being a difference between the focus of the target child and the reference focus.

7. The method of adaptive control of an in-vehicle infotainment system of claim 6, wherein, The method further comprises: Based on the first deviation value, the second deviation value and the third deviation value, and a preset adjustment rule of the vehicle-mounted audio system and the vehicle-mounted atmosphere lamp system corresponding to the deviation value, the first control instruction and the second control instruction are adjusted.

8. An adaptive control device for an in-vehicle entertainment information system, characterized by comprising: Comprise: An acquisition module is used to acquire video stream data of a region where a target child is located, determine metadata of a target picture book, and the effectiveness value, the arousal degree and the concentration degree of the target child based on the video stream data, the metadata comprising the picture book theme, the picture book name and the picture book color tone, the effectiveness value being used to represent the positive or negative degree of emotion, the arousal degree being used to represent the intensity of emotion, and the concentration degree being used to represent the cognitive input degree; A determination module is used to determine a first control instruction for controlling a vehicle-mounted audio system and a second control instruction for controlling a vehicle-mounted atmosphere lamp system based on the metadata of the target picture book; An adjustment module is used to adjust the first control instruction and the second control instruction based on the effectiveness value, the arousal degree and the concentration degree of the target child.

9. A control device, characterized by Comprise a memory and a processor, wherein, The memory is used to store programs; The processor is coupled with the memory and is used to execute the programs stored in the memory to realize the steps in the adaptive control method of the vehicle-mounted entertainment information system in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, A computer readable program or instruction is used to store the steps in the adaptive control method of the vehicle-mounted entertainment information system in any one of claims 1 to 7 when executed by a processor.

Images