In-vehicle passenger relaxing method, electronic equipment and storage medium

Abstract

The invention provides an in-vehicle passenger relaxing method, electronic equipment and a storage medium, and relates to the technical field of vehicles. The method for relaxing the passengers in the vehicle comprises the steps that at least one candidate relaxation course is determined according to the passenger identity and the passenger state of a target passenger in the vehicle; displaying the at least one candidate relaxation course through a first interface; and in response to a selection operation for a target relaxation course, step-by-step training guidance is provided for the target passenger based on the target relaxation course, and the target relaxation course is a course in the at least one candidate relaxation course. According to the invention, differentiated guiding processes can be provided for different passengers and different states, active and personalized cabin interaction can be realized, and the matching degree between a relaxation course and actual demands of the passengers is improved, so that the relaxation experience of the passengers is improved.

Description

Technical Field

[0001] This invention relates to the field of vehicle interaction technology, and more specifically, to a method for relaxing in-vehicle occupants, an electronic device, and a storage medium. Background Technology

[0002] During long drives, traffic jams, or long journeys, passengers often experience physical fatigue, muscle stiffness, boredom, and emotional tension. Mainstream cars are generally equipped with a variety of comfort functions such as seat heating, seat ventilation, seat massage, air conditioning adjustment, interior lighting adjustment, and music playback to enhance passenger comfort and relaxation.

[0003] However, existing solutions typically trigger fixed actions automatically after detecting fatigue or stress, and the adjustment logic is generally based on simple status labels and fixed mapping relationships to provide passengers with a uniform service, which cannot provide passengers with a matching interaction mode, resulting in a poor experience. Summary of the Invention

[0004] The problem addressed by this invention is how to provide passengers with a comfortable and relaxing experience.

[0005] To address the aforementioned problems, the present invention provides a method for relaxing occupants inside a vehicle, an electronic device, and a storage medium.

[0006] In a first aspect, the present invention provides a method for relaxing occupants inside a vehicle, comprising: Based on the occupant identity and occupant status of the target passenger in the vehicle, at least one candidate relaxation tutorial is determined; The at least one candidate relaxation tutorial is displayed through a first interface; In response to the selection of a target relaxation tutorial, step-by-step guidance is provided to the target occupant based on the target relaxation tutorial, which is one of the at least one candidate relaxation tutorials.

[0007] Optionally, before determining at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle, the method further includes: Facial recognition is performed on the target occupant, and the occupant's identity is determined based on the facial recognition data; The target occupant is identified in terms of status, and the occupant's status is determined based on the status identification data.

[0008] Optionally, determining at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle includes: At least one candidate relaxation tutorial is selected from a preset tutorial library based on the occupant's identity and occupant status. The preset tutorial library includes relaxation tutorials that match different occupant identities and occupant statuses. The selection rules include: removing relaxation tutorials that do not match the scene safety requirements corresponding to the occupant's identity, removing relaxation tutorials that are not suitable for the occupant's status, and removing relaxation tutorials whose status adjustment intensity and direction do not match the occupant's status.

[0009] Optionally, displaying the at least one candidate relaxation tutorial via the first interface includes: Determine the recommended score for each of the candidate relaxation tutorials; The display sequence of each candidate relaxation tutorial is determined according to the recommended scores, and the candidate relaxation tutorials are displayed on the first interface according to the display sequence.

[0010] Optionally, determining the recommendation score for each of the candidate relaxation tutorials includes: The recommendation score for each candidate relaxation tutorial is determined based on at least one of the following: target semantic relevance, target historical completion rate, target preference record, target mood improvement index, and a third reference value. The target semantic relevance is the semantic similarity between the occupant's state and the description of each candidate relaxation tutorial. The target historical completion rate is the target occupant's historical completion rate of the candidate relaxation tutorial. The target preference record is the target occupant's preference record for the candidate relaxation tutorial. The target mood improvement index is the target occupant's mood improvement index for the candidate relaxation tutorial. The third reference value is a third score for the candidate relaxation tutorial determined based on historical behavioral data of other occupants similar to the target occupant.

[0011] Optionally, providing step-by-step guidance to the target occupant based on the target relaxation tutorial includes: The target relaxation tutorial is played in stages through at least two linked components inside the vehicle, so that the target passenger can complete the actions corresponding to the target relaxation tutorial based on the guidance of the at least two linked components.

[0012] Optionally, the linkage component includes at least one of the following in the vehicle: display screen, speaker, ambient lighting, audio system, seat, air conditioner, head-up display, instrument panel display component, and window sunshade.

[0013] Optionally, the step-by-step playback of the target relaxation tutorial via at least two linked components within the vehicle includes: The second interface displays a demonstration of the movements corresponding to the target relaxation tutorial. Play voice prompts and / or background music corresponding to the action demonstration screen, wherein the voice prompts include guidance on the action details of the action demonstration screen; The ambient lighting changes are linked to the start or completion phase of the action demonstration screen.

[0014] Optionally, the in-vehicle occupant relaxation method further includes: updating the historical behavior data of the target occupant after completing the step-by-step follow-up guidance, and / or optimizing the generation strategy of the target relaxation tutorial list based on the historical behavior data of each occupant.

[0015] Optionally, the first interface is a display screen deployed on the vehicle, and / or the first interface is a user terminal connected to the vehicle.

[0016] In a second aspect, the present invention provides an electronic device, including a memory and a processor; The memory is used to store computer programs; The processor is configured to implement the occupant relaxation method as described in the first aspect when executing the computer program.

[0017] Thirdly, the present invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the occupant relaxation method as described in the first aspect.

[0018] The beneficial effects of the in-vehicle occupant relaxation method of the present invention are as follows: At least one candidate relaxation tutorial is determined based on the occupant identity and status of the target passenger in the vehicle. This allows the system to fully consider the differences in identity, role, and current status of different occupants during the relaxation tutorial selection phase, avoiding the recommendation of relaxation tutorials unsuitable for the target passenger's identity and status, thereby improving the matching degree between the candidate relaxation tutorials and the actual needs of the target occupant. Then, at least one candidate relaxation tutorial is displayed through a first interface, enabling the target occupant to intuitively obtain information on available relaxation tutorials and complete the selection operation of the target relaxation tutorial based on the first interface, thereby reducing operational complexity and improving the usability and interaction efficiency of the in-vehicle relaxation function. After the target relaxation tutorial is selected, step-by-step guidance is provided to the target occupant based on the target relaxation tutorial, allowing the target occupant to complete the corresponding actions of the relaxation tutorial under the step-by-step prompts, avoiding the relaxation effect being affected by the complexity of the tutorial content or unclear actions, thereby improving the execution completion rate and guidance effect of the relaxation tutorial. It can provide differentiated guidance processes for different occupants and different statuses, enabling proactive and personalized cabin interaction, improving the matching degree between the relaxation tutorial and the actual needs of the occupant, and thus enhancing the occupant's relaxation experience. Attached Figure Description

[0019] Figure 1 This is a schematic flowchart of the vehicle occupant relaxation method according to an embodiment of the present invention; Figure 2 This is a schematic diagram illustrating the process of determining passenger identity and passenger status according to an embodiment of the present invention; Figure 3 This is a schematic diagram illustrating the process of displaying candidate relaxation tutorials according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the process for determining the recommendation score according to an embodiment of the present invention; Figure 5 This is a schematic diagram of the step-by-step follow-up guidance process according to an embodiment of the present invention; Figure 6 This is a system architecture diagram of the in-vehicle occupant relaxation device according to an embodiment of the present invention; Figure 7 This is a system architecture diagram of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0020] To make the above-mentioned objects, features, and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Although some embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present invention. It should be understood that the accompanying drawings and embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of protection of the present invention.

[0021] It should be understood that the various steps described in the method embodiments of the present invention may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present invention is not limited in this respect.

[0022] The term "comprising" and its variations as used herein are open-ended, meaning "including but not limited to"; the term "based on" means "at least partially based on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments"; and the term "optionally" means "optional embodiments". Definitions of other terms will be given in the following description. It should be noted that the concepts of "first," "second," etc., mentioned in this invention are used only to distinguish different devices, modules, or units, and are not intended to limit the order of functions performed by these devices, modules, or units or their interdependencies.

[0023] It should be noted that the terms "a" and "a plurality of" used in this invention are illustrative rather than restrictive. Those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0024] The names of the messages or information exchanged between the multiple devices in the embodiments of the present invention are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0025] like Figure 1 As shown in the figure, an embodiment of the present invention provides a method for relaxing vehicle occupants, comprising: S100: Determine at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle.

[0026] Specifically, the state perception module continuously collects preset data such as image data and environmental audio data of the target occupants in the vehicle. For example, it collects image data and environmental audio data through the in-vehicle OMS camera (Occupancy Monitoring System) and microphone. It uses a facial recognition model to extract the occupant's facial feature vector from the image data and compares it with the user profile database in the vehicle or in the cloud to determine the occupant's identity, such as "Passenger A: Elderly Male" or "Visitor 1". Then, it uses an emotion recognition model and a posture recognition model to determine the occupant's current state, such as "fatigue", "boredom", "stiff neck" etc. After identifying the occupant's identity and state, the personalized recommendation module determines at least one candidate relaxation tutorial from the relaxation tutorial library based on the occupant's identity and state.

[0027] S200: Display at least one candidate relaxation tutorial through a first interface.

[0028] Specifically, at least one candidate relaxation tutorial is displayed on the first interface (such as the vehicle's infotainment screen) for passengers to select and confirm.

[0029] S300: In response to the selection of a target relaxation tutorial, provide the target occupant with step-by-step practice guidance based on the target relaxation tutorial, wherein the target relaxation tutorial is one of the at least one candidate relaxation tutorials.

[0030] Specifically, when a passenger taps the vehicle's infotainment screen or selects a relaxation tutorial from the candidate options displayed on the first interface via voice, the system loads the resource files for that relaxation tutorial, including animations, voice guidance text, and background music, and enters a step-by-step follow-up guidance mode to provide step-by-step follow-up guidance based on the target relaxation tutorial.

[0031] In this embodiment, at least one candidate relaxation tutorial is determined based on the passenger's identity and status within the vehicle. This allows the system to fully consider the differences in identity, role, and current status among different passengers during the relaxation tutorial selection phase, avoiding the recommendation of relaxation tutorials unsuitable for the target passenger's identity and status. This improves the matching degree between candidate relaxation tutorials and the actual needs of the target passenger. Then, at least one candidate relaxation tutorial is displayed through a first interface, allowing the target passenger to intuitively obtain information on available relaxation tutorials and select the target relaxation tutorial based on the first interface. This reduces operational complexity and improves the usability and interaction efficiency of the in-vehicle relaxation function. After the target relaxation tutorial is selected, step-by-step guidance is provided to the target passenger based on the tutorial. This allows the target passenger to complete the corresponding actions of the relaxation tutorial with step-by-step prompts, avoiding the relaxation effect being affected by complex tutorial content or unclear actions. This improves the completion rate and guidance effect of the relaxation tutorial, providing differentiated guidance processes for different passengers and statuses. It enables proactive and personalized cabin interaction, improving the matching degree between relaxation tutorials and the actual needs of passengers, thereby enhancing the passenger's relaxation experience.

[0032] Optionally, before determining at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle, the in-vehicle occupant relaxation method further includes: S001: Perform facial recognition on the target occupant and determine the occupant's identity based on the facial recognition data.

[0033] Specifically, in combination Figure 2 As shown, the system collects image data of the target occupant through the OMS camera inside the vehicle, calls the face recognition module to extract facial features, matches them with the user feature templates stored in the vehicle, and determines the occupant's identity as "elderly male" or other identities based on the similarity. This allows the system to recommend small-range, safe joint activity tutorials for the elderly and more energetic stretching tutorials for the young.

[0034] S002: Perform state identification on the target occupant and determine the occupant's state based on the state identification data.

[0035] Specifically, in combination Figure 2As shown, the system performs state recognition on the target occupant and determines the occupant's state based on the state recognition data. For example, it uses a computer vision model to analyze facial expressions, eye states, and body posture, and outputs emotional state labels (such as "fatigue" and "boredom") and behavioral state labels (such as "restlessness" and "frequent neck rubbing"). For example, face detection and key point localization can be used to align the face and track key points. The eyelid aspect ratio can be calculated based on eye key points, and the percentage of eye closure can be calculated on a sliding window to determine signs of fatigue. Facial expression features are obtained by inputting the facial image into a lightweight convolutional network and output emotional probabilities through softmax. The upper body key point sequence is input into a bidirectional LSTM (Long Short-Term Memory) network model to output behavioral probabilities.

[0036] In this optional embodiment, by identifying and obtaining facial recognition data and status recognition data, the identity recognition and status recognition process becomes more accurate and automated. It can reliably and in real time know the identity and current status of passengers without the need for active user input, enhance the system's perception capabilities, and provide more accurate input conditions for subsequent personalized recommendations.

[0037] Optionally, the state recognition data includes at least one of facial expression, eye state, and body posture, and / or the occupant state includes at least one of emotional state and behavioral state.

[0038] Specifically, exemplary state recognition data includes facial expressions, eye states, and body postures. Exemplary occupant states include emotional states and behavioral states. The emotional and behavioral states of a target occupant can be determined by analyzing facial expressions, eye states, and body postures.

[0039] In this optional embodiment, the emotional state or behavioral state is determined based on facial expressions, eye state, and body posture, making the identity recognition and state recognition process more accurate and automated, and providing more precise input conditions for subsequent personalized recommendations.

[0040] Optionally, determining at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle includes: At least one candidate relaxation tutorial is selected from a preset tutorial library based on the occupant's identity and occupant status. The preset tutorial library includes relaxation tutorials that match different occupant identities and occupant statuses. The selection rules include: removing relaxation tutorials that do not match the scene safety requirements corresponding to the occupant's identity, removing relaxation tutorials that are not suitable for the occupant's status, and removing relaxation tutorials whose status adjustment intensity and direction do not match the occupant's status.

[0041] Specifically, the preset tutorial library includes relaxation tutorials matched to different occupant identities and states. Each tutorial has rich metadata tags (e.g., target audience: elderly, women; movement type: neck stretch, deep breathing; intensity: low, medium). First, a rule-based preliminary screening is performed, selecting at least one candidate relaxation tutorial from the preset tutorial library based on the occupant's identity and state. For example, if the occupant's identity is elderly and their state is fatigued, then all tutorials suitable for the elderly and relieving fatigue are selected. Then, further screening follows the principles that the tutorial must be adapted to the current occupant's role and usage permissions, and the tutorial must be compatible with or improve the currently detected occupant state, rather than exacerbating it. For example, if the occupant's identity is a driver, only tutorials usable while driving are retained, excluding those requiring large physical movements or closed-eye meditation. For example, if the passenger is a rear-seat passenger, relaxation tutorials with larger movements can be retained. For instance, if a tutorial is suitable for fatigue or mild anxiety, but not for intense tension or motion sickness, then the tutorial can be retained if the passenger is fatigued or mildly anxious, and removed if the passenger is intensely tense or motion sickness. For instance, passenger states also have corresponding intensity levels; for example, fatigue levels can be divided into level one, two, and three, corresponding to low, medium, and high tutorial intensities respectively. Therefore, if the passenger is at level one fatigue, low-intensity and medium-intensity tutorials can be retained, while high-intensity tutorials can be removed. For instance, if the passenger state itself implies a regulatory goal, for example, when the passenger is fatigued, the regulatory goal is to awaken or refresh, and a tutorial, such as "stretching," has an awakening effect, then that tutorial can be retained, and other unsuitable tutorials can be removed.

[0042] In this optional embodiment, by filtering candidate relaxation tutorials from a preset tutorial library based on the occupant's identity and status, the recommendation process can quickly exclude tutorials that are not suitable for the current occupant or current status, thereby narrowing the search scope and improving recommendation efficiency. At the same time, different types of relaxation tutorials are managed in a structured manner, making the recommendation logic clearer, providing a high-quality candidate set for subsequent ranking algorithms, and improving the overall adaptability and reliability of the system.

[0043] Optionally, displaying the at least one candidate relaxation tutorial via the first interface includes: S210: Determine the recommended score for each of the candidate relaxation tutorials.

[0044] Specifically, in combination Figure 3 As shown, each of the candidate relaxation tutorials can be scored to obtain a recommended score for each candidate relaxation tutorial.

[0045] S220: Determine the display sequence of each candidate relaxation tutorial according to the recommended scores, and display each candidate relaxation tutorial according to the display sequence through the first interface.

[0046] Specifically, in combination Figure 3 As shown, the candidate relaxation tutorials are sorted from high to low according to their recommended scores to form a display sequence of candidate relaxation tutorials, and each candidate relaxation tutorial is displayed in the display sequence on the first interface (such as the car screen).

[0047] In this optional embodiment, a recommendation score is calculated for each candidate relaxation tutorial, and a display sequence for each candidate relaxation tutorial is determined based on the recommendation score. The candidate relaxation tutorials are then displayed on the first interface according to the display sequence. This allows the system to quantitatively evaluate the suitability between different tutorials and the needs of passengers, thereby achieving an objective and repeatable sorting process. This avoids the limitations of relying on fixed rules or single-label matching, making the recommendation results more accurate and facilitating subsequent optimization and iteration.

[0048] Optionally, determining the recommendation score for each of the candidate relaxation tutorials includes: The recommendation score for each candidate relaxation tutorial is determined based on at least one of the following: target semantic relevance, target historical completion rate, target preference record, target mood improvement index, and a third reference value. The target semantic relevance is the semantic similarity between the occupant's state and the description of each candidate relaxation tutorial. The target historical completion rate is the target occupant's historical completion rate of the candidate relaxation tutorial. The target preference record is the target occupant's preference record for the candidate relaxation tutorial. The target mood improvement index is the target occupant's mood improvement index for the candidate relaxation tutorial. The third reference value is a third score for the candidate relaxation tutorial determined based on historical behavioral data of other occupants similar to the target occupant.

[0049] Specifically, after obtaining the set of candidate relaxation tutorials, the recommendation score for each candidate relaxation tutorial is calculated. For example, for each candidate relaxation tutorial, at least one of the following is obtained: target semantic relevance, target historical completion rate, target preference record, target emotion improvement index, and third reference value, thereby determining the recommendation score for each candidate relaxation tutorial. The target semantic relevance is determined by semantic analysis of the target occupant's current occupant state description and the tutorial description of the candidate relaxation tutorial; the tutorial description includes the tutorial's text description, tag information, or pre-generated semantic vector representation; the target historical completion rate is the target occupant's completion rate of the candidate relaxation tutorial during historical practice. Furthermore, the completion status includes at least one of the following: completion time, completion rate, or mid-course withdrawal; the target preference record is the target occupant's historical selection behavior record of the candidate relaxation tutorial, and the preference record includes at least one of the following: selection frequency, recent selection time, or selection trend; the target emotion improvement index is the change in the target occupant's emotional state before and after implementing the candidate relaxation tutorial. The emotional state is identified by the in-vehicle occupant monitoring system, and a corresponding emotion improvement index is generated based on the magnitude of the emotion change; the third reference value is a third score calculated based on the historical behavior data of other occupants similar to the target occupant. The historical behavior data includes at least one of the following: completion rate data, selection frequency data, and emotion improvement data.

[0050] In this optional embodiment, the candidate relaxation tutorials are evaluated from multiple dimensions by comprehensively considering the target occupant's immediate occupant status, historical behavioral characteristics, and group behavioral characteristics of similar occupants. This makes the generated candidate relaxation tutorial display sequence more in line with the actual needs of the target occupant, thereby improving the accuracy and personalization of relaxation tutorial recommendations.

[0051] Optionally, determining the recommendation score for each candidate relaxation tutorial based on at least one of the following: target semantic relevance, target historical completion rate, target preference record, target emotion improvement index, and third reference value, includes: S211: Determine a first score for the candidate relaxation tutorial based on the target semantic similarity, wherein the first score is used to characterize the degree of matching between the candidate relaxation tutorial and the occupant state.

[0052] Specifically, in combination Figure 4 As shown, for example, if the occupant's state is "fatigue" or "neck stiffness", the generated vectors are the text descriptions of the occupant's state and the candidate relaxation tutorial, respectively. The semantic similarity score can be obtained through cosine similarity, which is the first score of the candidate relaxation tutorial. The first score is used to characterize the degree of matching between the candidate relaxation tutorial and the occupant's state.

[0053] S212: Determine a second score for the candidate relaxation tutorial based on the target historical completion rate, the target preference record, and the target emotion improvement index. The second score is used to characterize the target occupant's historical behavioral characteristics toward the candidate relaxation tutorial.

[0054] Specifically, in combination Figure 4 As shown, the personal profile database stores the passenger's historical training records, preference settings, completion status, etc. The database retrieves the target passenger's historical completion rate, preference records (e.g., frequency of selection for each tutorial), and mood improvement indicators to calculate a second score for candidate relaxation tutorials. This second score characterizes the target passenger's historical behavioral characteristics towards the candidate relaxation tutorials. For example, historical completion rate can refer to the user's past N participation records of a tutorial, including completion percentage (0–100%), number of interruptions, and skipping behavior. Preference records can refer to the user's past M tutorial selection records, including the number of times a particular tutorial was selected, the total number of selections for all tutorials, and whether recent selections have increased (trend). Mood improvement indicators can be obtained by recording OMS mood recognition values ​​before and after training, including dimensions such as arousal, pleasure, and tension. Combining these three factors, a time-decay weighted and multi-indicator weighted fusion method can be used to obtain the second score for candidate relaxation tutorials. This comprehensively reflects the passenger's long-term behavioral habits, interest trends, and actual physiological / emotional improvement effects, making tutorial recommendations more aligned with the passenger's real needs and improving the effectiveness and personalization of the recommendations.

[0055] S213: Determine a third score for the candidate relaxation tutorial based on the historical behavior data. The third score is used to characterize the group behavior characteristics of other occupants similar to the target occupant on the candidate relaxation tutorial.

[0056] Specifically, in combination Figure 4As shown, multiple passengers with the most similarity are selected from other passenger profiles. For example, a profile vector for each passenger is extracted from the personal profile database. The profile vector includes basic identity features (gender, age group), long-term preference features (tutorial type preference distribution, selection frequency vector), behavioral features (average completion rate, completion time-series trend, pause rate, and follow-up stability), emotional response features (average emotional improvement value corresponding to various types of tutorials), and scene features (peak fatigue frequency, long-distance / short-distance performance differences), etc. Passenger similarity is calculated based on cosine similarity. The closer the similarity is to 1, the more similar the passengers are. The third score of the candidate relaxation tutorial is determined based on the historical behavioral data of the multiple most similar passengers. The third score is used to characterize the group behavioral characteristics of other passengers similar to the target passenger on the candidate relaxation tutorial. For example, the completion statistics of similar passengers on the tutorial, the selection frequency of similar passengers on the tutorial, and the average emotional improvement effect of similar passengers on the tutorial are used to calculate the statistical score at the group level. This score can reflect the overall performance and effect of similar users on the tutorial, thereby providing a more reliable and representative recommendation basis for the target passenger and improving the generalization ability and accuracy of the recommendation algorithm.

[0057] S214: Determine the recommended score for the candidate relaxation tutorial based on the first score, the second score, and the third score.

[0058] Specifically, in combination Figure 4 As shown, the final recommendation score of a candidate relaxation course is determined by the fusion of the first score, the second score, and the third score. For example, the final recommendation score of a candidate relaxation course can be obtained by weighted fusion. Weighted fusion can comprehensively consider immediate needs, individual historical preferences, and group statistical characteristics, making the final recommendation score more objective and accurate, and improving the personalization and reliability of the relaxation course recommendation results.

[0059] In this optional embodiment, by splitting the tutorial recommendation score into semantic similarity score, historical preference score, and collaborative score, and by weighting and fusing the three, a multi-dimensional and multi-source data-driven recommendation mechanism can be formed by comprehensively considering the occupant's immediate state description, long-term behavioral preferences, and group behavior of similar occupants. This makes the final recommendation result more in line with the occupant's real needs, thereby improving the completion rate of the follow-up training and the overall interaction effect.

[0060] Optionally, providing step-by-step guidance to the target occupant based on the target relaxation tutorial includes: The target relaxation tutorial is played in stages through at least two linked components inside the vehicle, so that the target passenger can complete the actions corresponding to the target relaxation tutorial based on the guidance of the at least two linked components.

[0061] Specifically, when a target occupant selects a target relaxation tutorial, the in-vehicle occupant relaxation system provides step-by-step guidance based on the tutorial. This is achieved through the coordinated action of at least two interconnected components within the vehicle, guiding the occupant to gradually complete the actions corresponding to the tutorial. Depending on the occupant's identity and current usage scenario, at least two interconnected components can be selected from multiple available components within the vehicle as output components for this step-by-step guidance. For example, the in-vehicle display screen can show a two-dimensional or three-dimensional animation of the current action, and the system can play voice prompts corresponding to the animation through the speakers. Alternatively, breathing rhythm prompts can be played through the speakers, and the ambient lights can change brightness or color according to the breathing rhythm.

[0062] In this optional embodiment, at least two linked components inside the vehicle are used to present the target relaxation tutorial, enabling the target occupant to complete the corresponding actions of the relaxation tutorial under the coordinated guidance of multiple sensory dimensions such as vision, hearing or touch. This improves the clarity and immersion of the step-by-step guidance, and enhances the interactive effect and practicality of the relaxation method for in-vehicle occupants.

[0063] Optionally, the linkage component includes at least one of the following in the vehicle: display screen, speaker, ambient lighting, audio system, seat, air conditioner, head-up display, instrument panel display component, and window sunshade.

[0064] Specifically, the linkage components can be divided into visual presentation components, auditory presentation components, tactile / body feedback components, environmental adjustment components, and human-computer interaction input components. Visual presentation components include visual presentation components (used to display action rhythm, breathing beats, and step prompts), instrument panel display components (displaying simplified progress bars and completion status), and rear entertainment screens (dedicated guidance for rear passengers), etc. Auditory presentation components include directional speakers (achieving personalization without disturbing other passengers), etc. Tactile / body feedback components include seat vibration modules (slight vibration synchronized with breathing rhythm) and seat massage modules (feedback after step-by-step actions are completed), etc. Environmental adjustment components include air conditioning systems (with a gentle breeze during breathing training), fragrance systems, and window sunshades / sunroof shading devices (reducing visual stimulation), etc. Human-computer interaction input components include touch input devices (central touchscreen), voice input devices (microphone), and steering wheel buttons, etc., used for pausing, skipping steps, changing atmospheres, etc. In this optional embodiment, the target relaxation tutorial is presented through different types of linkage components, enabling the target occupant to complete the corresponding actions of the relaxation tutorial under the coordinated guidance of multiple sensory dimensions such as vision, hearing or touch. This improves the clarity and immersion of the step-by-step guidance and enhances the interactive effect and practicality of the relaxation method for in-vehicle occupants.

[0065] Optionally, the step-by-step playback of the target relaxation tutorial via at least two linked components within the vehicle includes: S310: Display a demonstration screen of the movements corresponding to the target relaxation tutorial on the second interface.

[0066] Specifically, in combination Figure 5 As shown, the multimodal interactive guidance module can display an animation demonstration area corresponding to the target relaxation tutorial through a second interface (such as the vehicle's infotainment screen). The animation demonstration area displays two-dimensional or three-dimensional action demonstration images, such as showing the action breakdown process through two-dimensional animation, decomposing and guiding each relaxation action in real time, greatly reducing the learning cost. This embodiment provides passengers with a set of relaxation tutorials that they can follow and practice (such as stretching exercises and breathing techniques), guiding them to complete a series of targeted physical activities. Compared with existing solutions that only adjust environmental parameters such as seats and air conditioning, this can more effectively relieve physical fatigue and mental stress, fundamentally alleviating muscle stiffness and boredom.

[0067] The first interface and the second interface can be the same or different. The first interface can also be the interface on the user terminal (such as a mobile phone, tablet, etc.).

[0068] S320: Play voice prompts and / or background music corresponding to the action demonstration screen, wherein the voice prompts include guidance on the action details of the action demonstration screen.

[0069] Specifically, in combination Figure 5 As shown, the multimodal interactive guidance module can provide real-time voice guidance on action details, such as "inhale and slowly raise your shoulders," and can also play background music (natural sounds, instrumental music), etc.

[0070] S330: The start or completion phase of the action demonstration screen is linked by the change of ambient lighting.

[0071] Specifically, in combination Figure 5 As shown, the multimodal interactive guidance module can change the ambient light to link the start or end of the action demonstration screen. When the action demonstration screen starts, the ambient light will slowly increase in brightness, and when the action demonstration screen is completed, it will switch to a blue breathing light effect. For example, during the action "shoulder lift for 5 seconds", the ambient light will remain "warm white and slowly change", and flash blue light once as a prompt when it is completed.

[0072] In this optional embodiment, by displaying animated demonstrations, playing voice prompts or background music during the step-by-step follow-up guidance process, and by linking the changes in the ambient lighting inside the car according to the action stages, the presentation of the tutorial guidance process is clearer, the information expression is more intuitive, and the feedback mechanism is more timely. This improves the user's understanding of the key points of the action, reduces the learning cost, and enhances the continuity and immersion of the follow-up process through multimodal information fusion, thereby improving the accuracy of action execution.

[0073] Optionally, the in-vehicle occupant relaxation method further includes: updating the historical behavior data of the target occupant after completing the step-by-step follow-up guidance, and / or optimizing the generation strategy of the target relaxation tutorial list based on the historical behavior data of each occupant.

[0074] Specifically, after completing the step-by-step guided practice, the system records user ID (e.g., A001), tutorial ID (e.g., 108), start time, end time, completion rate, atmosphere, and emotional changes. User preference weights can be updated based on completion rate and emotional improvement. For example, for user A001, choosing ocean sound background music in the afternoon results in higher completion rate and the most significant emotional improvement. When the system detects that a target user consistently demonstrates high completion rate and significant emotional improvement with a particular type of relaxation tutorial in a specific scenario, the system dynamically adjusts the fusion weight of the recommendation score based on the user's actual performance. For example, it increases the weight of the second score in the final recommendation score, decreases the weight of the third score, and maintains the relative stability of the first score's weight. This emphasizes the target user's individual historical preferences, thereby dynamically adjusting the recommendation weights and optimizing the generation strategy for the target relaxation tutorial list.

[0075] In this optional embodiment, by updating the target occupant's historical behavioral data after the training session, and optimizing the generation strategy of the target relaxation tutorial list based on the updated data, the system can accumulate and learn the occupant's behavioral patterns over time, achieving continuous adaptive recommendation capabilities. This dynamically improves the accuracy of the recommendation algorithm, making the system increasingly meet the personalized needs of the occupant during long-term use, and enhancing the intelligent learning capabilities and long-term effectiveness of the cockpit system.

[0076] Optionally, the first interface is a display screen deployed on the vehicle, and / or the first interface is a user terminal connected to the vehicle.

[0077] Specifically, the first interface displays interactive content related to relaxation methods for in-vehicle occupants, including a sequence of candidate relaxation tutorials, step-by-step guidance information, and operation control options. The first interface can be deployed on the vehicle itself or on a user terminal that establishes a communication connection with the vehicle. For example, the first interface can be a display screen deployed on the vehicle, including a central control display screen, an instrument panel display screen, a head-up display, a rear entertainment display screen located in front of the rear seats, a roof-mounted display screen, or other display devices installed inside the vehicle. Alternatively, the first interface can be a user terminal that establishes a communication connection with the vehicle. The user terminal includes, but is not limited to, smartphones, tablets, wearable devices, or other mobile terminals with display functions. The user terminal establishes a communication connection with the vehicle via a wired or wireless connection. Wireless connection methods include Bluetooth connection, wireless... The system utilizes at least one of wired local area network (LAN) or cellular network connections to send interface data related to the target relaxation tutorial to the user terminal via a communication connection. The user terminal displays corresponding screens or other content, allowing occupants to select, control, or interact with the target relaxation tutorial through the user terminal, such as starting, pausing, or switching tutorials. The user terminal's operation results are fed back to the vehicle via the communication connection to control the operation of in-vehicle linkage components. The first interface can also be simultaneously displayed on both the vehicle's onboard display and the user terminal. The main guidance content can be displayed on the vehicle's onboard display, while auxiliary information or control interfaces can be displayed on the user terminal. For example, a step-by-step animated demonstration can be displayed on the cockpit center console display, while a tutorial list, progress information, or atmosphere setting options can be displayed on the user terminal, thus achieving a multi-screen collaborative interaction method.

[0078] In this optional embodiment, the first interface can be deployed on a display screen in different locations inside the vehicle or on a user terminal connected to the vehicle, so that occupants can flexibly obtain guidance information for relaxation tutorials according to actual usage scenarios and equipment conditions, thereby improving the applicability and interactive flexibility of relaxation methods for occupants.

[0079] like Figure 6 As shown, an embodiment of the present invention provides a vehicle occupant relaxation device 600, comprising: The first module 610 is used to determine at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle. The second module 620 is used to display the at least one candidate relaxation tutorial through the first interface; The third module 630 is configured to respond to a selection operation for a target relaxation tutorial, and to provide step-by-step guidance to the target occupant based on the target relaxation tutorial, wherein the target relaxation tutorial is one of the at least one candidate relaxation tutorials.

[0080] like Figure 7As shown, an electronic device 700 provided in this embodiment of the invention includes a memory 720 and a processor 710; the memory 720 is used to store a computer program; the processor 710 is used to implement the vehicle occupant relaxation method as described above when the computer program is executed.

[0081] Alternatively, an electronic device 700 includes a memory 720 and a processor 710 coupled to the memory 720; the memory 720 is configured to store a computer program; and the processor 710 is configured to perform the following operations when the computer program is executed: Based on the occupant identity and occupant status of the target passenger in the vehicle, at least one candidate relaxation tutorial is determined; The at least one candidate relaxation tutorial is displayed on the first interface; In response to the selection of a target relaxation tutorial, step-by-step guidance is provided to the target occupant based on the target relaxation tutorial, which is one of the at least one candidate relaxation tutorials.

[0082] This invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the vehicle occupant relaxation method described above.

[0083] Alternatively, a non-volatile computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to perform the following operations: Based on the occupant identity and occupant status of the target passenger in the vehicle, at least one candidate relaxation tutorial is determined; The at least one candidate relaxation tutorial is displayed on the first interface; In response to the selection of a target relaxation tutorial, step-by-step guidance is provided to the target occupant based on the target relaxation tutorial, which is one of the at least one candidate relaxation tutorials.

[0084] The present invention will now be described an electronic device 700 that can serve as a server or client of the present invention, which is an example of a hardware device that can be applied to various aspects of the present invention. Electronic device 700 is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic device 700 can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the invention described and / or claimed herein.

[0085] Electronic device 700 includes a computing unit that can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) or a computer program loaded from a storage unit into random access memory (RAM). The RAM may also store various programs and data required for device operation. The computing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.

[0086] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc. In this application, the units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of the embodiments of the present invention according to actual needs. Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units can be implemented in hardware or as software functional units.

[0087] While the present invention has been disclosed above, its scope of protection is not limited thereto. Those skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention, and all such changes and modifications will fall within the scope of protection of the present invention.

Claims

1. A method for relaxing occupants inside a vehicle, characterized in that, include: Based on the occupant identity and occupant status of the target passenger in the vehicle, at least one candidate relaxation tutorial is determined; The at least one candidate relaxation tutorial is displayed through a first interface; In response to the selection of a target relaxation tutorial, step-by-step guidance is provided to the target occupant based on the target relaxation tutorial, which is one of the at least one candidate relaxation tutorials.

2. The method for relaxing occupants inside a vehicle according to claim 1, characterized in that, Before determining at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle, the method further includes: Facial recognition is performed on the target occupant, and the occupant's identity is determined based on the facial recognition data; The target occupant is identified in terms of status, and the occupant's status is determined based on the status identification data.

3. The method for relaxing occupants inside a vehicle according to claim 2, characterized in that, The step of determining at least one candidate relaxation tutorial based on the occupant identity and occupant status of the target passenger in the vehicle includes: At least one candidate relaxation tutorial is selected from a preset tutorial library based on the occupant's identity and occupant status. The preset tutorial library includes relaxation tutorials that match different occupant identities and occupant statuses. The selection rules include: removing relaxation tutorials that do not match the scene safety requirements corresponding to the occupant's identity, removing relaxation tutorials that are not suitable for the occupant's status, and removing relaxation tutorials whose status adjustment intensity and direction do not match the occupant's status.

4. The method for relaxing occupants inside a vehicle according to claim 1, characterized in that, The step of displaying the at least one candidate relaxation tutorial through the first interface includes: Determine the recommended score for each of the candidate relaxation tutorials; The display sequence of each candidate relaxation tutorial is determined according to the recommended scores, and the candidate relaxation tutorials are displayed on the first interface according to the display sequence.

5. The method for relaxing occupants inside a vehicle according to claim 4, characterized in that, The determination of the recommended score for each of the candidate relaxation tutorials includes: The recommendation score for each candidate relaxation tutorial is determined based on at least one of the following: target semantic relevance, target historical completion rate, target preference record, target mood improvement index, and a third reference value. The target semantic relevance is the semantic similarity between the occupant's state and the description of each candidate relaxation tutorial. The target historical completion rate is the target occupant's historical completion rate of the candidate relaxation tutorial. The target preference record is the target occupant's preference record for the candidate relaxation tutorial. The target mood improvement index is the target occupant's mood improvement index for the candidate relaxation tutorial. The third reference value is a third score for the candidate relaxation tutorial determined based on historical behavioral data of other occupants similar to the target occupant.

6. The method for relaxing occupants inside a vehicle according to claim 1, characterized in that, The step-by-step guidance provided to the target occupant based on the target relaxation tutorial includes: The target relaxation tutorial is played in stages through at least two linked components inside the vehicle, so that the target passenger can complete the actions corresponding to the target relaxation tutorial based on the guidance of the at least two linked components.

7. The method for relaxing occupants inside a vehicle according to claim 6, characterized in that, The linkage components include at least one of the following in the vehicle: display screen, speaker, ambient lighting, audio system, seat, air conditioner, head-up display, instrument panel display components, and window sunshades.

8. The method for relaxing occupants inside a vehicle according to claim 6, characterized in that, The step-by-step playback of the target relaxation tutorial via at least two linked components within the vehicle includes: The second interface displays a demonstration of the movements corresponding to the target relaxation tutorial. Play voice prompts and / or background music corresponding to the action demonstration screen, wherein the voice prompts include guidance on the action details of the action demonstration screen; The ambient lighting changes are linked to the start or completion phase of the action demonstration screen.

9. The method for relaxing occupants inside a vehicle according to any one of claims 1 to 8, characterized in that, Also includes: After completing the step-by-step follow-up guidance, the historical behavior data of the target occupant is updated, and / or the generation strategy of the target relaxation tutorial list is optimized based on the historical behavior data of each occupant.

10. The method for relaxing occupants inside a vehicle according to claim 1, characterized in that, The first interface is a display screen deployed on the vehicle, and / or the first interface is a user terminal connected to the vehicle.

11. An electronic device, characterized in that, Including memory and processor; The memory is used to store computer programs; The processor is configured to implement the vehicle occupant relaxation method as described in any one of claims 1 to 10 when executing the computer program.

12. A computer-readable storage medium, characterized in that, The storage medium stores a computer program that, when executed by a processor, implements the vehicle occupant relaxation method as described in any one of claims 1 to 10.

Images