Equipment control method and device, vehicle-mounted terminal, vehicle and storage medium

By identifying and regulating user emotions in smart cars, the problem of single and inefficient existing equipment control methods is solved, and more efficient mood regulation and equipment control effects are achieved.

CN119840637APending Publication Date: 2025-04-18BYD CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411414864.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-11
Publication Date
2025-04-18

AI Technical Summary

Technical Problem

The existing equipment control methods are relatively single in identifying and regulating user emotions, and have poor results, resulting in low equipment control efficiency.

Method used

By acquiring the monitoring data and user data of the target device, the user's mood category is identified, and the electronic controller in the target device is adjusted based on the identification results to improve the emotion regulation effect and device control efficiency.

Benefits of technology

Accurate identification and effective adjustment of user emotions in the target equipment is achieved, and the efficiency and effectiveness of equipment control are improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119840637A_ABST
    Figure CN119840637A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses an equipment control method and device, a vehicle-mounted terminal, a vehicle and a storage medium. Monitoring data collected by a monitoring device of target equipment is obtained, and the monitoring device is located in the target equipment and / or connected with the target equipment; acquiring user data of at least one user riding the target equipment; based on the monitoring data and the user data, identifying a target emotion category of at least one target user in the target equipment; and based on the target emotion category, controlling an electronic controller in the target equipment to carry out adjustment. Therefore, the target emotion category of at least one target user in the target equipment can be accurately identified based on the monitoring data and the user data, so that the electronic controller in the target equipment is controlled to perform adjustment based on the target emotion category, and the emotion of the user in the target equipment can be adjusted; the emotion regulation effect on the user in the target equipment is improved, and then the equipment control efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a device control method, apparatus, vehicle-mounted terminal, vehicle and storage medium. Background Art

[0002] With the development of intelligent transportation, the role of cars and other devices in users' lives is also changing. For example, on the basis of transportation, smart cars can have the function of identifying and regulating the driver's emotions. In the existing device control methods, the user's emotions are often identified by judging the user's mood through facial expressions, or judging the user's physiological condition through breathing, heart rate, etc., and then voice reminders are given to the user. However, the existing device control methods are relatively simple, and the emotion regulation effect is poor, which makes the device control efficiency low. Summary of the invention

[0003] The embodiments of the present application provide a device control method, apparatus, vehicle-mounted terminal, vehicle and storage medium, which can accurately identify the emotion category of a user in a target device, thereby adjusting the electronic controller of the target device based on the identified emotion category, thereby adjusting the emotions of the user in the target device, improving the emotion regulation effect on the user in the target device, and thereby improving the device control efficiency.

[0004] In order to achieve the above object, according to a first aspect of the present application, a device control method is provided, the method comprising:

[0005] Acquiring monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or connected to the target device;

[0006] Acquire user data of at least one user riding the target device;

[0007] Based on the monitoring data and the user data, identifying a target emotion category of at least one target user in the target device;

[0008] Based on the target emotion category, an electronic controller in the target device is controlled to make adjustments.

[0009] In some embodiments, identifying the target emotion category of at least one target user in the target device based on the monitoring data and the user data includes: obtaining emotion recognition keywords of at least one target user in the target device based on the monitoring data and the user data; and determining the target emotion category of the target user based on the emotion recognition keywords.

[0010] In some embodiments, obtaining emotion recognition keywords of at least one target user in the target device based on the monitoring data and the user data includes: identifying population category keywords of at least one target user in the target device based on the user data; identifying emotion representation keywords of the target user based on the monitoring data; and using the population category keywords and the emotion representation keywords as emotion recognition keywords of the target user.

[0011] In some embodiments, determining the target emotion category of the target user based on the emotion recognition keyword includes: based on the population category keyword, screening out a target emotion recognition database that matches the target user from a plurality of preset emotion recognition databases, the emotion recognition database storing a plurality of preset emotion categories and keywords matching each emotion category; based on the emotion representation keyword, determining the target emotion category that matches the target user in the target emotion recognition database.

[0012] In some embodiments, the monitoring data includes physiological monitoring data, behavioral monitoring data, and voice monitoring data.

[0013] In some embodiments, the voice monitoring data includes first voice data and second voice data, the first voice data is voice data collected by a monitoring device in the target device, and the second voice data is voice data collected by a monitoring device connected to the target device.

[0014] In some embodiments, controlling the electronic controller in the target device to adjust based on the target emotion category includes: determining the target electronic controller and controller adjustment information corresponding to the target emotion category; and controlling the target electronic controller in the target device to adjust based on the controller adjustment information.

[0015] In some embodiments, determining the target electronic controller and controller adjustment information corresponding to the target emotion category includes: obtaining the seating position of the target user in the target device; and determining the target electronic controller and controller adjustment information corresponding to the target emotion category based on the seating position and the target emotion category.

[0016] In some embodiments, determining the target electronic controller and controller adjustment information corresponding to the target emotion category based on the seating position and the target emotion category includes: screening out a target controller adjustment database matching the target user from a plurality of preset controller adjustment databases based on the user data, the controller adjustment database storing electronic controllers corresponding to a plurality of preset emotion categories and adjustment information for the electronic controllers; and determining, based on the target emotion category and the seating position, controller adjustment information matching the target emotion category and the seating position of the target user in the target controller adjustment database.

[0017] In some embodiments, the target controller adjustment database includes control messages of multiple target electronic controllers associated with the target emotion category; determining the controller adjustment information that matches the target emotion category and the seating position of the target user in the target controller adjustment database based on the target emotion category and the seating position includes: searching the target controller adjustment database for control messages of multiple target electronic controllers that match the target emotion category and the seating position of the target user; and combining the control messages together to obtain a combined message as control adjustment information.

[0018] In some embodiments, controlling the target electronic controller in the target device for adjustment based on the controller adjustment information includes: based on the combined message, transmitting each control message in the combined message to the corresponding target electronic controller through the controller local area network bus of the target device to control each target electronic controller for adjustment.

[0019] According to a second aspect of the present application, there is provided a device control apparatus, the apparatus comprising:

[0020] A first acquisition module, configured to acquire monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or is connected to the target device;

[0021] A second acquisition module, used to acquire user data of at least one user riding the target device;

[0022] an emotion recognition module, configured to identify a target emotion category of at least one target user in the target device based on the monitoring data and the user data;

[0023] The controller adjustment module is used to control the electronic controller in the target device to adjust based on the target emotion category.

[0024] According to a third aspect of the present application, a vehicle-mounted terminal is provided, comprising a processor and a memory, wherein the memory stores an application program, and the processor is used to run the application program in the memory to implement the device control method provided in an embodiment of the present application.

[0025] According to a fourth aspect of the present application, a vehicle is provided, comprising the vehicle-mounted terminal provided by the third aspect of the present application.

[0026] According to a fifth aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and the computer program is suitable for loading by a processor to execute the steps in any device control method provided in the embodiments of the present application.

[0027] According to the sixth aspect of the present application, a computer program product is provided, which includes a computer program, and the computer program is stored in a computer-readable storage medium; when the processor of a vehicle-mounted terminal reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the vehicle-mounted terminal executes the steps in the device control method provided in an embodiment of the present application.

[0028] In the device control method, device, vehicle-mounted terminal, vehicle and storage medium of the embodiment of the present application, by acquiring the monitoring data collected by the monitoring device of the target device, wherein the monitoring device is located in the target device and / or connected to the target device; acquiring the user data of at least one user riding the target device; identifying the target emotion category of at least one target user in the target device based on the monitoring data and the user data; and controlling the electronic controller in the target device to make adjustments based on the target emotion category. In this way, by acquiring the monitoring data collected by the monitoring device of the target device and the user data of at least one user riding the target device, the target emotion category of at least one target user in the target device can be accurately identified based on the monitoring data and the user data, and then the electronic controller in the target device can be controlled to make adjustments based on the identified target emotion category, so that the emotions of the users in the target device can be adjusted, and the emotion adjustment effect on the users in the target device can be improved, thereby improving the device control efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0030] Figure 1It is a schematic diagram of an implementation scenario of a device control method provided in an embodiment of the present application;

[0031] Figure 2 It is a flow chart of a device control method provided in an embodiment of the present application;

[0032] Figure 3a It is a specific flow chart of a device control method provided in an embodiment of the present application;

[0033] Figure 3b is another specific flow chart of a device control method provided in an embodiment of the present application;

[0034] Figure 4 It is a schematic diagram of the overall process of a device control method provided in an embodiment of the present application;

[0035] Figure 5 is a schematic diagram of the structure of the device control device provided in an embodiment of the present application;

[0036] Figure 6 It is a structural diagram of the vehicle-mounted terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0037] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0038] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0039] The embodiments of the present application provide a device control method, device, vehicle-mounted terminal, vehicle and storage medium. The device control device can be integrated in an electronic device, which can be a server or a terminal.

[0040] Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms. Terminals may include but are not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. Terminals and servers can be directly or indirectly connected via wired or wireless communications, and this application does not limit this.

[0041] Among them, the vehicle-mounted terminal can be integrated in a vehicle, and the vehicle can be a fuel vehicle, a plug-in hybrid vehicle or a new energy vehicle, etc. This application does not make specific limitations on this.

[0042] See also Figure 1 , taking the device control device integrated into the vehicle terminal as an example, Figure 1 A schematic diagram of an implementation scenario of the device control method provided in an embodiment of the present application, wherein the vehicle-mounted terminal may be integrated in a vehicle, and the vehicle-mounted terminal may obtain monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or is connected to the target device; obtain user data of at least one user riding the target device; based on the monitoring data and the user data, identify a target emotion category of at least one target user in the target device; and based on the target emotion category, control an electronic controller in the target device to make adjustments.

[0043] It should be noted that Figure 1 The implementation environment scenario diagram of the device control method shown is only an example. The implementation environment scenario of the device control method described in the embodiment of the present application is to more clearly illustrate the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application. It is known to those skilled in the art that with the evolution of data processing and the emergence of new business scenarios, the technical solution provided by the present application is also applicable to similar technical problems.

[0044] The solutions provided by the embodiments of the present application are specifically described by the following embodiments. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0045] This embodiment will be described from the perspective of a device control apparatus, which may be specifically integrated in a terminal.

[0046] See also Figure 2 , Figure 2: is a flow chart of a device control method provided in an embodiment of the present application. The device control method includes:

[0047] Step S101, acquiring monitoring data collected by a monitoring device of a target device.

[0048] The monitoring device is located in the target device and / or is connected to the target device.

[0049] The target device may be a vehicle, ship, airplane or other vehicle, and the monitoring device may be a device for collecting data corresponding to the target device. The monitoring device may be located in the target device, for example, various sensors, or may be a device connected to the target device and may not be located in the target device, for example, a mobile phone, a watch or other device. The monitoring data may be data collected by a user who monitors the target device, and the user may include a driver and a passenger of the target device.

[0050] Optionally, the monitoring data may include physiological monitoring data, behavioral monitoring data, and voice monitoring data. The physiological monitoring data may be data indicating the physiological state of the user of the target device based on the monitoring device, for example, it may include data such as the user's heart rate, blood pressure, respiratory rate, skin humidity, skin physiological electrical properties, facial expression camera, etc. The behavioral monitoring data may be data indicating the behavioral state of the user of the target device based on the monitoring device, for example, it may include data such as the force of opening and closing the door, seat gravity sensing, etc., wherein, for the user sitting in the driver's seat, the behavioral monitoring data may also include data such as key force, accelerator force, stability, horn frequency, horn force, etc., and these monitoring data may be stored in the form of an information table.

[0051] Optionally, for users sitting in passenger seats, the data collected by the seat gravity sensor can be used to divide the users into approximate age groups, and global voice monitoring can be used to further distinguish passenger groups and seating positions for subsequent further emotion category recognition.

[0052] The voice monitoring data may be data based on the voice content indicating the user of the target device monitored by the monitoring device. Optionally, the voice monitoring data may include first voice data and second voice data. The first voice data may be voice data collected by the monitoring device in the target device, and the second voice data may be voice data collected by the monitoring device connected to the target device.

[0053] By collecting the first voice data and the second voice data, the user's emotional state can be judged based on keyword retrieval in the first voice data and the second voice data, providing more sufficient basis and higher-level emotional attention for emotion prediction, which is conducive to improving the intelligence level of emotion prediction of the target device and giving users a more humane driving experience.

[0054] Optionally, the first voice data may be used to obtain the seating position of the user in the target device, and the seating position may be the position of the user in the target device.

[0055] For example, when the target device is a vehicle, the first voice data can be the voice data recorded in the vehicle by the monitoring device of the target vehicle, and the voice of the driver and the passenger can be recorded by the intelligent adjustment system of the vehicle. The intelligent adjustment system can implement the intelligent hardware and software electronic control system of the device control method provided in the embodiment of the present application, and can have the main control chip control function, sensor information collection function, voice recording function, data storage function, data transmission function, data processing function, vehicle CAN message receiving and sending function, and can be used to adjust the electronic controller of the target device based on the user's emotions to achieve emotional adjustment of the user of the target device. The second voice data can be the voice data recorded outside the vehicle, for example, it can be recorded by a monitoring device such as a smart phone or a smart watch, and then transmitted to the intelligent adjustment system of the target vehicle. After the intelligent adjustment system obtains the recording, it can perform text conversion and keyword extraction for emotional category prediction.

[0056] Step S102, obtaining user data of at least one user riding the target device.

[0057] The user may include a driver and a passenger riding in the target device. The user data may be data describing the user, for example, may include basic information such as the destination, occupation, age, preferences, and relationship between the user riding in the target device and other users. Thus, based on the user data of the user riding in the target device, information describing the driving environment of the target vehicle may be obtained more comprehensively and specifically, thereby more accurately predicting the emotional category of the user of the target device.

[0058] Optionally, the user data can be pre-customized input data. For example, the driver or passenger can input the destination, occupation, age, preferences and other user data in advance through a mobile phone application (APP) to help more accurately predict the emotions of each user in the target device. For example, taking the target device as a vehicle, for car use scenarios that can be predicted in advance, such as family cars and business cars, in order to make the subsequent emotional adjustment method more accurate, the user can input the user data in the mobile phone APP in advance. In the family car scenario, the user can set the relationship between the passenger and the driver in advance. In the business car scenario, the user can input the passenger's car use habits and personality data. The user data can be kept in memory in the central processing unit (CPU) to facilitate rapid emotional adjustment next time. In this way, the user can customize the user data that describes the environmental factors of the target device. After obtaining the input user data, it can be parsed and transmitted to the intelligent adjustment system for subsequent emotional adjustment processing.

[0059] Among them, the personality input by the user in the user data can be determined according to the Myers-Briggs Personality (MBTI) type theory model. For example, the user can take a test according to the Myers-Briggs Personality Type Theory model in advance to determine the user's specific personality, thereby improving the accuracy of emotion recognition. Targeted emotion regulation methods for users with specific personalities are helpful to provide emotion regulation effects.

[0060] Step S103: identifying a target emotion category of at least one target user in the target device based on the monitoring data and the user data.

[0061] The target user may be a user riding on the target device, including a passenger and a driver. The target emotion category may be an emotion category of the target user predicted based on monitoring data and user data, and the emotion category may include emotion categories such as joy, anger, sadness, fear, surprise, and love.

[0062] Among them, there can be multiple ways to identify the target emotion category of at least one target user in the target device based on the monitoring data and user data. For example, based on the monitoring data and user data, emotion recognition keywords of at least one target user in the target device can be obtained; and the target emotion category of the target user can be determined based on the emotion recognition keywords.

[0063] The emotion recognition keyword may be a keyword for identifying emotion categories obtained based on monitoring data and user data. In this way, the monitoring data and user data corresponding to each user in the target device may be obtained, so that the target emotion category of each target user may be identified based on the monitoring data and user data corresponding to the user.

[0064] Among them, there can be multiple ways to obtain emotion recognition keywords of at least one target user in the target device based on monitoring data and user data. For example, based on user data, the population category keywords of at least one target user in the target device can be identified; based on monitoring data, the emotion representation keywords of the target user can be identified; and the population category keywords and emotion representation keywords can be used as emotion recognition keywords for the target user.

[0065] Among them, the crowd category keyword can be a keyword describing the crowd category to which the target user belongs. The crowd category can include crowd categories such as children, youth, and the elderly, and can also include crowd categories of various age groups such as 0-18 years old, 19-28 years old, 29-45 years old, 46-60 years old, and over 60 years old, and can also include crowd categories of various occupations, etc. The specific crowd category can be set according to actual needs, and the embodiment of the present application is not limited here. The emotion representation keyword can be a keyword used to indicate the possible emotion category of the target user. For example, keywords such as "angry", "unlucky", "losing money", "frowning" can represent that the user may have angry and angry emotions, "sick", "layoffs", "regret" and other keywords can represent that the user may have sad and sad emotions, "finally got it", "winning the prize", "praise" and other keywords can represent that the user may have joy and excitement emotions, etc.

[0066] Among them, based on user data, there can be multiple ways to identify the population category keywords of at least one target user in the target device. For example, when the target user's occupation is described as a teacher in the user data, the population category keyword "teacher" can be obtained. When the target user's age is described as 44 years old in the user data, the population category keyword of the age group "29-45 years old" can be obtained.

[0067] There are many ways to identify the target user's emotion representation keywords based on the monitoring data. For example, in the physiological monitoring data of the monitoring data, when it is detected that the target user's heartbeat is greater than threshold A, the breathing rate is greater than threshold B, and frowning, the emotion representation keywords that can be obtained may be "heartbeat greater than threshold A", "breathing rate greater than threshold B", "frown" and other keywords. If it is detected in the behavioral monitoring data that the user's door closing force is greater than a certain threshold or the horn pressing frequency is greater than a certain frequency threshold, the emotion representation keywords such as "the user's door closing force is greater than a certain threshold" and "the horn pressing frequency is greater than a certain frequency threshold" can be obtained. If voice data such as "It's always raining, so annoying, I have to get wet in the rain after get off work later" is detected in the voice monitoring data, the emotion representation keywords such as "so annoying" and "getting wet in the rain" can be obtained.

[0068] After obtaining the emotion recognition keywords of at least one target user in the target device based on the monitoring data and the user data, the target emotion category of the target user can be determined based on the emotion recognition keywords. There are multiple ways to determine the target emotion category of the target user based on the emotion recognition keywords. For example, based on the crowd category keywords, a target emotion recognition database matching the target user can be screened out from multiple preset emotion recognition databases; based on the emotion representation keywords, a target emotion category matching the target user can be determined in the target emotion recognition database.

[0069] The emotion recognition database stores multiple preset emotion categories and keywords matching each emotion category, which can be used to predict the emotion category of the user. Since the emotion categories generated by users of different age groups, different occupations, etc. may vary greatly, an emotion recognition database corresponding to different groups of people can be constructed to improve the accuracy of emotion recognition results for different groups of people.

[0070] For example, when monitoring data and user data are input, the crowd category keywords can be obtained first, so that the crowd category of the currently monitored user can be determined based on the crowd category keywords to perform preliminary screening of the database. For example, the emotion recognition database can be first screened according to the age group to obtain an emotion recognition database that matches the age group of the current user, and obtain the emotion recognition database after the first screening. Then, a second screening can be performed based on the user's occupation to obtain the target emotion recognition database after the second screening, and then the target emotion category that best matches the target user can be screened in the target emotion recognition database based on the user's frowning action, "so annoying" voice command and other emotion representation keywords.

[0071] Step S104, based on the target emotion category, controlling the electronic controller in the target device to make adjustments.

[0072] The electronic controller may be an electronic control unit (ECU), for example, it may include controllers for seats, windows, media devices, ambient lights, air conditioners, sunroofs, etc. of the target device.

[0073] Among them, based on the target emotion category, there can be multiple ways to control the electronic controller in the target device for adjustment. For example, the target electronic controller and controller adjustment information corresponding to the target emotion category can be determined; based on the controller adjustment information, the target electronic controller in the target device is controlled for adjustment.

[0074] The target electronic controller may be an electronic controller that needs to be adjusted under the target emotion category, and the user's emotion may be adjusted by adjusting the target electronic controller. For example, when the target emotion category is sadness, the user's sadness may be alleviated with a greater probability by adjusting the target electronic controller corresponding to the target emotion category. When the target emotion category is joy, the user may be more cheerful by adjusting the target electronic controller corresponding to the target emotion category. The controller adjustment information may be adjustment information indicating an adjustment method for the target electronic controller, for example, an adjustment method for the electronic controller may be indicated such as increasing the air conditioner temperature by one degree, playing cheerful music, and opening the sunroof.

[0075] For example, please refer to the following Table 1. Assume that there are electronic controllers for seat heating (A), seat ventilation (B), seat massage (C), seat zero gravity (D), music (E), voice playback (F), ambient light (G), air conditioning (H), sunroof (I), central control video (J) and custom items (K) under the emotion category. The electronic controllers have three adjustment modes, namely adjustment one (a), adjustment two (b) and adjustment three (c). For example, for seat heating A, the adjustment mode of adjustment one is slight heat, the adjustment mode of adjustment two is medium heat, and the adjustment mode of adjustment two is warm heat. Then, the identifier Aa can be indicated as the electronic controller corresponding to the seat heating executes the adjustment mode corresponding to adjustment one, that is, the seat is heated to slight heat. The identifier Cb can be indicated as the electronic controller corresponding to the seat massage is controlled to execute the adjustment mode corresponding to adjustment two, that is, the seat is controlled to massage with intensity two, etc.

[0076]

[0077] Table 1

[0078] There are many ways to determine the target electronic controller and controller adjustment information corresponding to the target emotion category. For example, the seating position of the target user in the target device can be obtained; based on the seating position and the target emotion category, the target electronic controller and controller adjustment information corresponding to the target emotion category can be determined.

[0079] Among them, the seating positions may include the driver's seat, the co-driver's seat, the left side of the rear seat, and the right side of the rear seat.

[0080] Among them, there can be many ways to obtain the seating position of the target user in the target device. For example, the seating position of the target user in the target device can be obtained based on information pre-customized and input by users such as the driver or passengers, or the seating position of the target user in the target device can be identified based on monitoring data such as voice monitoring data, etc.

[0081] Among them, there can be multiple ways to determine the target electronic controller and controller adjustment information corresponding to the target emotion category according to the seating position and the target emotion category. For example, based on the user data, a target controller adjustment database matching the target user can be screened out from multiple preset controller adjustment databases; based on the target emotion category and the seating position, the controller adjustment information matching the target emotion category and the seating position of the target user can be determined in the target controller adjustment database.

[0082] The controller adjustment database stores preset electronic controllers corresponding to multiple emotion categories and adjustment information for the electronic controllers, and the adjustment information can indicate the adjustment method for the electronic controller.

[0083] Among them, there can be many ways to filter out a target controller adjustment database that matches the target user from multiple preset controller adjustment databases based on user data. For example, the population category to which the target user belongs can be determined based on user data, and then, based on the population category, a target controller adjustment database that matches the population category can be filtered out from multiple preset controller adjustment databases.

[0084] Since different groups of people may have different ways of regulating emotions, the electronic controller adjustment preferences of different groups of people under different emotion categories can be used, and the adjustment information of various target electronic controllers that need to be adjusted under various emotion categories under each group of people can be obtained, so as to obtain a controller adjustment database corresponding to different groups of people. In this way, the controller adjustment database can be screened according to the group of people, so as to more accurately determine the controller adjustment information that matches the target user under the target emotion category, improve the controller adjustment accuracy, and thus improve the emotion regulation effect.

[0085] Among them, based on the target emotion category and riding position, there may be multiple ways to determine the controller adjustment information that matches the target emotion category and riding position of the target user in the target controller adjustment database. For example, the target controller adjustment database may include control messages of multiple target electronic controllers associated with the target emotion category. In this way, the control messages of multiple target electronic controllers that match the target emotion category and riding position of the target user can be searched in the target controller adjustment database, and the control messages can be combined together to obtain the combined message as the control adjustment information.

[0086] The control message may be a message for controlling the target electronic controller, and the message may be a data unit exchanged and transmitted in the network. The combined message may be a message obtained by combining the control messages of the target electronic controllers. For example, assuming that the control message of the target electronic controller 1 is 01, the control message of the target electronic controller 2 is 02, the control message of the target electronic controller 3 is 01, and the control message of the target electronic controller 4 is 00, then the combined message may be [1:01, 2:02, 3:01, 4:00]. If the order of the target electronic controllers is known by default, then the combined message may be [01, 02, 01, 00].

[0087] There are many ways to search the target controller adjustment database for control messages of multiple target electronic controllers that match the target emotion category and the seating position of the target user. For example, the control messages of the electronic controllers that match the target emotion category can be screened out in the target controller adjustment database, and then, among the control messages of the screened electronic controllers, the control messages of the target electronic controllers that match the seating position can be screened out. For example, assuming that the seating position of the target user is on the left side of the rear row, and assuming that the target controller adjustment database is screened according to the target emotion category, it can be determined that the target emotion category requires emotional adjustment by opening the car window and adjusting the temperature of the air conditioner, so that according to the seating position of the target user, it can be determined that the car window on the left side of the rear row needs to be opened and the temperature of the air conditioner adjacent to the left side of the rear row needs to be adjusted.

[0088] Among them, based on the controller adjustment information, there can be multiple ways to control the target electronic controller in the target device for adjustment. For example, based on the combined message, each control message in the combined message can be transmitted to the corresponding target electronic controller through the controller local area network bus of the target device to control each target electronic controller for adjustment.

[0089] The controller area network bus may be a serial communication protocol bus (Controller Area Network, CAN bus for short).

[0090] For example, please refer to the following Table 2, which lists the message IDs of the electronic controllers of modules such as seat heating (A), seat ventilation (B), seat massage (C), seat zero gravity (D), music (E), voice playback (F), ambient light (G), air conditioning (H), sunroof (I), central control video (J) and custom items (K), as well as the messages in each adjustment mode such as adjustment one (a), adjustment two (b) and adjustment three (c). For example, the message of the electronic controller corresponding to seat zero gravity in the adjustment mode of adjustment two is 0x02, and the message of the electronic controller corresponding to air conditioning in the adjustment mode of adjustment three is 0x03, etc.

[0091]

[0092] Table 2

[0093] For example, please refer to the following Table 3, which illustrates the combination messages corresponding to the emotion category "joy" and the emotion category "anger". For the emotion category "joy", the combination message sent to the electronic controller ECU (ID = 0x101 ~ 0x10B) of AK under the adjustment mode of adjustment 1 is:

[0094] Action1=[01,01,01,00,01,02,02,01,01,01,00]

[0095] For the emotion category "anger", the combined message sent to the AK ECU (ID = 0x101-0x10B) under the adjustment mode of adjustment 2 is:

[0096] Action2=[00,03,03,03,03,03,01,03,03,03,00]

[0097]

[0098] Table 3

[0099] In one embodiment, please refer to Figure 3a , Figure 3a It is a specific flow chart of a device control method provided by an embodiment of the present application. The driver's emotion can be monitored through a driver emotion prediction model, so that the target emotion category of the driver in the target device can be identified based on the monitoring data and user data, and then the emotion regulation model can be used to control the electronic controller in the target device to adjust based on the target emotion category, so as to adjust the driver's emotion. Similarly, the passenger's emotion can be monitored through a passenger emotion prediction model, so that the target emotion category of the passenger in the target device can be identified based on the monitoring data and user data, and then the emotion regulation model can be used to control the electronic controller in the target device to adjust based on the target emotion category, so as to adjust the passenger's emotion. Optionally, the driver emotion prediction model and the passenger emotion prediction model can be the same model, which can be used to identify the emotion category of the driver or passenger in the target device based on the input monitoring data and user data. The emotion regulation model can be a model for determining the controller regulation information corresponding to the target user based on the target emotion category. The emotion regulation model can be established for the purpose of controlling the ECU, with emotion category, crowd category, and riding position as parameter basis. The final calculation result can be accurate to the working mode of each ECU, achieving more accurate, more efficient, and more reasonable controller regulation, thereby improving the effect of emotion regulation. For example, please refer to Figure 3b , Figure 3b It is another specific flow chart of a device control method provided in an embodiment of the present application. Emotional categories such as joy, anger, sadness, fear, shock, and love can be input into the emotion regulation model QG(x), so as to determine the music, ambient light, seat, air conditioner, fragrance, window, sunroof and other control object ECUs that need to be adjusted and the corresponding adjustment methods through the calculation and processing of the emotion regulation model, so as to obtain a combined message.

[0100] Optionally, different ECUs have different influencing factors on emotion regulation. The core of establishing the emotion regulation model can be based on these influencing factors, with existing electronic controllers as control objects, to control ECUs such as seats, media, air conditioning, ambient lights, sunroofs, driving modes, windows, etc. In addition, the establishment of the emotion regulation model also needs to rely on the characteristics and influence range of different ECUs, for example, the usage preferences and usage frequencies of different groups of people for different ECUs.

[0101] By adjusting the working mode of the electronic controller in the target device, it can help regulate the user's emotions, thereby improving the user's riding experience. For example, the impact of different colors of the ambient light ECU on emotions, for example, red is often associated with energy, passion, danger and power. It can cause people's excitement and strong emotional reactions. Bold, enthusiastic, and eye-catching colors project power and confidence, giving people a passionate psychological feeling. Blue is often associated with calmness, stability, trust and professionalism. It can help people relax and reduce stress. Green is related to nature, balance, growth and regeneration. It has a soothing effect on the eyes and can help relieve stress and anxiety. A green environment can improve people's mood and enhance mental resilience, which is conducive to relieving irritability and fatigue. Yellow is often seen as a color of sunshine and vitality, and is related to happiness, optimism and creativity. The happiest one will inspire joy. Black is often associated with authority, elegance and mystery. Black can be used to convey a sense of seriousness and formality. In terms of emotional therapy, black has the effect of clearing heat and calming the mind, making people calm. White is usually associated with purity, freshness and simplicity. It can bring a sense of space and openness, make people feel fresh and clean, and evoke a sense of youth and modernity. It can gradually calm down emotional people and has a significant calming effect on people with large emotional fluctuations and impatient personalities. Orange is a color of vitality and enthusiasm, and is related to creativity, adventure and self-confidence. It can inspire people and stimulate people's positive emotions. Orange can make those depressed and lack of vitality pessimists active. Purple is related to luxury, wisdom, mystery and spirituality. It can stimulate people's imagination and creativity, often making people meditate and give in. It has a significant calming effect. Pink is often associated with tenderness, love and care. Light pink can soothe the soul, while bright pink may stimulate the spirit, especially for women, creating a happy mood for women. In this way, the user's emotions can be adjusted by adjusting the color of the ambient light ECU according to the target emotion category.

[0102] For example, media ECU can also have an impact on emotions. For example, soothing music can bring people a sense of tranquility and relaxation. For example, after a day of hard work, listening to a soft piano piece can help people release tension, relieve stress, and calm their mood. Cheerful music usually has a fast rhythm and bright melody, which can stimulate people's excitement and pleasure. When people hear this kind of music, they often feel cheerful, positive and energetic, relieving the fatigue of the day. For example, when we hear pop music and rock music, we often unconsciously shake our bodies to the rhythm and feel the passion and vitality in the music. Sad music has a slower rhythm and sad melody, which can often evoke people's deep emotions. When in a low mood, listening to some sad music can provide a channel for venting emotions, allowing people to talk and seek comfort. Sad music helps to transform people's emotions from negative to positive. Inspiring music is a type of music that is full of movement and vitality. It can inspire people's enthusiasm and self-confidence. When people encounter challenges and difficulties at work, encounter setbacks, and feel listless, listening to some inspiring music, such as electronic music and motivational music, can help them change their negative emotions, enhance their perseverance and fighting spirit, and stimulate positive energy. Classical music refers to those musical works with traditional and historical significance. Classical music is often known for its profound and solemn style, which can make people enter a state of tranquility and thinking. When you are restless, you can play some classical music to relax your body and mind and relieve stress.

[0103] In one embodiment, please refer to Figure 4 , Figure 4This is a schematic diagram of the overall flow of a device control method provided by an embodiment of the present application. Taking the target device as a vehicle as an example, in the data collection step, physical data such as behavior monitoring data and physiological monitoring data can be collected, voice monitoring data can be collected, and user data input by the user can be obtained. Therefore, the user data such as the user's custom input destination information, occupation, age, personality, physical data, and voice monitoring data can be input into the emotion prediction model, and the user's emotion category can be predicted in advance based on the destination information. Then, based on the comprehensive detection data such as voice monitoring data, behavior monitoring data, physiological detection data, personality model detection, and custom user information, the emotion prediction method is enriched, and the user's emotion category is further accurately predicted. The obtained emotion prediction model can better and more comprehensively control the emotional state of target users such as drivers and passengers, thereby predicting the target emotion category of the target user, and outputting the target user's riding position and corresponding user information, so that the target emotion category, riding position, and user data such as occupation, age, and hobbies can be input into the emotion regulation model to calculate the electronic controller regulation method, so that the combined message corresponding to the target electronic controller matching the target emotion category and riding position can be obtained, and the control message in the combined message is transmitted to the corresponding target electronic controller through the CAN bus for regulation, so as to achieve accurate and detailed regulation of the user's emotions and improve the emotion regulation effect of the user in the target device. In this way, the emotions of the users in the car can be linked to the intelligent electronic devices of the car, and the vehicle ECU components can be conveniently controlled by adopting the combined message method to regulate the user's emotions. The device control method provided in the embodiment of the present application no longer only focuses on the driver's emotion regulation, but can meet the emotion regulation of various users such as passengers, greatly improving the efficiency of device control.

[0104] As can be seen from the above, the embodiment of the present application obtains the monitoring data collected by the monitoring device of the target device, wherein the monitoring device is located in the target device and / or connected to the target device; obtains the user data of at least one user riding the target device; identifies the target emotion category of at least one target user in the target device based on the monitoring data and the user data; and controls the electronic controller in the target device to make adjustments based on the target emotion category. In this way, by obtaining the monitoring data collected by the monitoring device of the target device and the user data of at least one user riding the target device, the target emotion category of at least one target user in the target device can be accurately identified based on the monitoring data and the user data, and then the electronic controller in the target device can be controlled to make adjustments based on the identified target emotion category, so as to achieve the adjustment of the emotions of the users in the target device, improve the emotion adjustment effect of the users in the target device, and thus improve the control efficiency of the device.

[0105] In order to better implement the device control method provided in the embodiment of the present application, the embodiment of the present application also provides a device based on the above device control method. The meanings of the terms are the same as those in the above device control method, and the specific implementation details can refer to the description in the method embodiment.

[0106] For example, Figure 5 As shown, it is a schematic diagram of the structure of the device control device provided in the embodiment of the present application. The device control device may include a first acquisition module 201, a second acquisition module 202, an emotion recognition module 203 and a controller adjustment module 204, as follows:

[0107] A first acquisition module 201 is used to acquire monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or is connected to the target device;

[0108] A second acquisition module 202 is used to acquire user data of at least one user riding on the target device;

[0109] An emotion recognition module 203, configured to identify a target emotion category of at least one target user in a target device based on the monitoring data and the user data;

[0110] The controller adjustment module 204 is used to control the electronic controller in the target device to adjust based on the target emotion category.

[0111] In one embodiment, the emotion recognition module 203 includes:

[0112] A keyword acquisition submodule, used to acquire emotion recognition keywords of at least one target user in a target device based on monitoring data and user data;

[0113] The emotion recognition submodule is used to determine the target emotion category of the target user based on the emotion recognition keywords.

[0114] In one embodiment, the keyword acquisition submodule is used to:

[0115] Based on the user data, identifying a population category keyword of at least one target user in the target device;

[0116] Identify target users’ emotion-representing keywords based on monitoring data;

[0117] Crowd category keywords and emotion representation keywords are used as emotion recognition keywords for target users.

[0118] In one embodiment, the emotion recognition submodule is used to:

[0119] Based on the crowd category keywords, a target emotion recognition database matching the target user is screened out from a plurality of preset emotion recognition databases, where the emotion recognition database stores a plurality of preset emotion categories and keywords matching each emotion category;

[0120] Based on the emotion representation keywords, the target emotion category matching the target user is determined in the target emotion recognition database.

[0121] In one embodiment, the monitoring data includes physiological monitoring data, behavioral monitoring data, and voice monitoring data.

[0122] In one embodiment, the voice monitoring data includes first voice data and second voice data, the first voice data is voice data collected by a monitoring device in the target device, and the second voice data is voice data collected by a monitoring device connected to the target device.

[0123] In one embodiment, the controller adjustment module 204 includes:

[0124] A determination submodule, for determining a target electronic controller corresponding to a target emotion category and controller adjustment information;

[0125] The regulating submodule is used to control the target electronic controller in the target device to perform regulation based on the controller regulation information.

[0126] In one embodiment, determining a submodule includes:

[0127] A location acquisition unit, used to acquire the riding location of the target user in the target device;

[0128] The adjustment information determination unit is used to determine the target electronic controller and the controller adjustment information corresponding to the target emotion category according to the seating position and the target emotion category.

[0129] In one embodiment, the adjustment information determining unit includes:

[0130] A screening subunit is used to screen out a target controller adjustment database matching the target user from a plurality of preset controller adjustment databases according to the user data, wherein the controller adjustment database stores electronic controllers corresponding to a plurality of preset emotion categories and adjustment information for the electronic controllers;

[0131] The determination subunit is used to determine controller adjustment information matching the target emotion category and the seating position of the target user in a target controller adjustment database based on the target emotion category and the seating position.

[0132] In one embodiment, the target controller adjustment database includes control messages for a plurality of target electronic controllers associated with a target emotion category, and determines a subunit for:

[0133] Searching a target controller adjustment database for control messages of a plurality of target electronic controllers that match the target emotion category and the seating position of the target user;

[0134] The control messages are combined together to obtain a combined message as control adjustment information.

[0135] In one embodiment, the regulating submodule is used to:

[0136] Based on the combined message, each control message in the combined message is transmitted to the corresponding target electronic controller through the controller area network bus of the target device to control each target electronic controller to perform adjustment.

[0137] As can be seen from the above, the embodiment of the present application is configured with a message distribution component in the kernel, and the kernel is implemented based on the first core of the target chip, and the monitoring data collected by the monitoring device of the target device is obtained through the first acquisition module 201, wherein the monitoring device is located in the target device and / or connected to the target device; the second acquisition module 202 obtains the user data of at least one user riding the target device; the emotion recognition module 203 identifies the target emotion category of at least one target user in the target device based on the monitoring data and the user data; the controller adjustment module 204 controls the electronic controller in the target device to adjust based on the target emotion category. In this way, by obtaining the monitoring data collected by the monitoring device of the target device and the user data of at least one user riding the target device, the target emotion category of at least one target user in the target device can be accurately identified based on the monitoring data and the user data, and the electronic controller in the target device can be controlled to adjust based on the identified target emotion category, so as to achieve the adjustment of the emotion of the user in the target device, improve the emotion adjustment effect of the user in the target device, and then improve the control efficiency of the device.

[0138] Accordingly, the embodiment of the present application also provides a vehicle-mounted terminal, such as Figure 6 As shown, Figure 6 A schematic diagram of the structure of the vehicle-mounted terminal provided in an embodiment of the present application. The vehicle-mounted terminal 300 includes a processor 301 having one or more processing cores, a memory 302 having one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 is electrically connected to the memory 302. Those skilled in the art will appreciate that the vehicle-mounted terminal structure shown in the figure does not constitute a limitation on the vehicle-mounted terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently.

[0139] The processor 301 is the control center of the vehicle terminal 300, and uses various interfaces and lines to connect various parts of the entire vehicle terminal 300. It executes various functions and processes data of the vehicle terminal 300 by running or loading software programs and / or units stored in the memory 302, and calling data stored in the memory 302. The processor 301 can be a processor CPU, a graphics processor GPU, a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0140] In the embodiment of the present application, the processor 301 in the vehicle terminal 300 will load instructions corresponding to the processes of one or more application programs into the memory 302 according to the following steps, and the processor 301 will run the application programs stored in the memory 302 to implement various functions, such as:

[0141] Acquire monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or connected to the target device; acquire user data of at least one user riding the target device; identify a target emotion category of at least one target user in the target device based on the monitoring data and the user data; and control an electronic controller in the target device to make adjustments based on the target emotion category.

[0142] Furthermore, various functions implemented by running the application program stored in the memory 302 can also be found in the description of the aforementioned embodiment, which will not be repeated here.

[0143] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0144] Optional, such as Figure 6 As shown, the vehicle terminal 300 also includes: a touch screen 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306 and a power supply 307. Among them, the processor 301 is electrically connected to the touch screen 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306 and the power supply 307 respectively. Those skilled in the art can understand that Figure 6 The vehicle-mounted terminal structure shown in the figure does not constitute a limitation on the vehicle-mounted terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0145] The touch display screen 303 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 303 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the vehicle terminal, which can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-Emitting Diode), etc. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or accessory such as a finger, stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute the corresponding program. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 301, and can receive the command sent by the processor 301 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 301 to determine the type of touch event, and then the processor 301 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 303 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 303 can also be used as a part of the input unit 306 to realize the input function.

[0146] The RF circuit 304 may be used to send and receive RF signals, so as to establish wireless communication with a network device or other vehicle-mounted terminals through wireless communication, and to send and receive signals with the network device or other vehicle-mounted terminals.

[0147] The audio circuit 305 can be used to provide an audio interface between the user and the vehicle-mounted terminal through a speaker and a microphone. The audio circuit 305 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 305 and converted into audio data, and then the audio data is output to the processor 301 for processing, and then sent to another vehicle-mounted terminal through the radio frequency circuit 304, or the audio data is output to the memory 302 for further processing. The audio circuit 305 may also include an earplug jack to provide communication between an external headset and the vehicle-mounted terminal.

[0148] The input unit 306 may be used to receive input target video and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0149] The power supply 307 is used to supply power to various components of the vehicle-mounted terminal 300. Optionally, the power supply 307 can be logically connected to the processor 301 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 307 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0150] although Figure 6 Not shown, the vehicle terminal 300 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0151] In the above embodiments, the description of each embodiment has its own emphasis. For the parts not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. It should be noted that the vehicle-mounted terminal provided in the embodiment of the present application and the device control method in the above embodiment belong to the same concept. The specific implementation process is detailed in the above method embodiment and will not be repeated here.

[0152] As can be seen from the above, the vehicle-mounted terminal provided in the embodiment of the present application can obtain the monitoring data collected by the monitoring device of the target device, wherein the monitoring device is located in the target device and / or connected to the target device; obtain the user data of at least one user riding the target device; identify the target emotion category of at least one target user in the target device based on the monitoring data and the user data; and control the electronic controller in the target device to make adjustments based on the target emotion category. In this way, by obtaining the monitoring data collected by the monitoring device of the target device and the user data of at least one user riding the target device, the target emotion category of at least one target user in the target device can be accurately identified based on the monitoring data and the user data, and then the electronic controller in the target device can be controlled to make adjustments based on the identified target emotion category, so as to achieve the adjustment of the emotions of the users in the target device, improve the emotion adjustment effect of the users in the target device, and thus improve the control efficiency of the device.

[0153] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0154] To this end, an embodiment of the present application provides a computer-readable storage medium, which includes a computer program. When the computer program is run on a vehicle-mounted terminal, the computer program is used to enable the vehicle-mounted terminal to execute any device control method provided in the embodiment of the present application. For example, the computer program can execute the following steps of the device control method:

[0155] Acquire monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or connected to the target device; acquire user data of at least one user riding the target device; identify a target emotion category of at least one target user in the target device based on the monitoring data and the user data; and control an electronic controller in the target device to make adjustments based on the target emotion category.

[0156] Furthermore, for the detailed steps of the above method steps, reference can be made to the description in the above embodiments, which will not be repeated here.

[0157] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0158] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0159] Since the computer program stored in the computer-readable storage medium can execute any device control method provided in the embodiments of the present application, the beneficial effects that can be achieved by any device control method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0160] According to one aspect of the present application, a computer program product is also provided, including a computer program, which is stored in a computer-readable storage medium; when the processor of a vehicle-mounted terminal reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the vehicle-mounted terminal executes the methods provided in the various optional implementation methods in the above-mentioned embodiments.

[0161] In the above-mentioned device control device, computer-readable storage medium, vehicle-mounted terminal, and computer program product embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the above-described device control device, computer-readable storage medium, computer program product, vehicle-mounted terminal and its corresponding units can refer to the description of the device control method in the above embodiment, and will not be repeated here.

[0162] The above is a detailed introduction to a device control method, apparatus, vehicle-mounted terminal, vehicle, computer-readable storage medium and computer program product provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A device control method, characterized in that: include: Acquiring monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or connected to the target device; Acquire user data of at least one user riding the target device; Based on the monitoring data and the user data, identifying a target emotion category of at least one target user in the target device; Based on the target emotion category, an electronic controller in the target device is controlled to make adjustments.

2. The device control method according to claim 1, characterized in that: The step of identifying a target emotion category of at least one target user in the target device based on the monitoring data and the user data includes: Based on the monitoring data and the user data, obtaining emotion recognition keywords of at least one target user in the target device; A target emotion category of the target user is determined based on the emotion recognition keyword.

3. The device control method according to claim 2, characterized in that: The acquiring, based on the monitoring data and the user data, an emotion recognition keyword of at least one target user in the target device comprises: Based on the user data, identifying a population category keyword of at least one target user in the target device; Identifying emotion representation keywords of the target user based on the monitoring data; The crowd category keyword and the emotion representation keyword are used as emotion recognition keywords of the target user.

4. The device control method according to claim 3, characterized in that: The determining the target emotion category of the target user based on the emotion recognition keyword includes: Based on the crowd category keywords, a target emotion recognition database matching the target user is screened out from a plurality of preset emotion recognition databases, wherein the emotion recognition database stores a plurality of preset emotion categories and keywords matching each emotion category; Based on the emotion representation keywords, a target emotion category matching the target user is determined in the target emotion recognition database.

5. The device control method according to claim 1, characterized in that: The monitoring data includes physiological monitoring data, behavioral monitoring data and voice monitoring data.

6. The device control method according to claim 5, characterized in that: The voice monitoring data includes first voice data and second voice data, the first voice data is voice data collected by a monitoring device in the target device, and the second voice data is voice data collected by a monitoring device connected to the target device.

7. The device control method according to any one of claims 1 to 6, characterized in that: The step of controlling an electronic controller in the target device to adjust the target emotion category comprises: Determining a target electronic controller and controller adjustment information corresponding to the target emotion category; Based on the controller adjustment information, the target electronic controller in the target device is controlled to perform adjustments.

8. The device control method according to claim 7, characterized in that: The step of determining the target electronic controller and controller adjustment information corresponding to the target emotion category includes: Acquire the riding position of the target user in the target device; According to the seating position and the target emotion category, a target electronic controller and controller adjustment information corresponding to the target emotion category are determined.

9. The device control method according to claim 8, characterized in that: The step of determining a target electronic controller and controller adjustment information corresponding to the target emotion category according to the seating position and the target emotion category includes: According to the user data, a target controller adjustment database matching the target user is screened out from a plurality of preset controller adjustment databases, wherein the controller adjustment database stores electronic controllers corresponding to a plurality of preset emotion categories and adjustment information for the electronic controllers; Based on the target emotion category and the seating position, controller adjustment information matching the target emotion category and the seating position of the target user is determined in the target controller adjustment database.

10. The device control method according to claim 9, characterized in that: The target controller adjustment database includes control messages for a plurality of target electronic controllers associated with the target emotion category; The determining, in the target controller adjustment database, controller adjustment information matching the target emotion category and the seating position of the target user based on the target emotion category and the seating position includes: Searching the target controller adjustment database for control messages of a plurality of target electronic controllers that match the target emotion category and the seating position of the target user; The control messages are combined together to obtain a combined message as control adjustment information.

11. The device control method according to claim 10, characterized in that: The step of controlling the target electronic controller in the target device to perform adjustment based on the controller adjustment information includes: Based on the combined message, each control message in the combined message is transmitted to the corresponding target electronic controller via the controller area network bus of the target device, so as to control each target electronic controller to perform adjustment.

12. A device control device, characterized in that: include: A first acquisition module, configured to acquire monitoring data collected by a monitoring device of a target device, wherein the monitoring device is located in the target device and / or is connected to the target device; A second acquisition module, used to acquire user data of at least one user riding the target device; an emotion recognition module, configured to identify a target emotion category of at least one target user in the target device based on the monitoring data and the user data; The controller adjustment module is used to control the electronic controller in the target device to adjust based on the target emotion category.

13. A vehicle-mounted terminal, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any one of the methods of claims 1 to 11.

14. A vehicle, characterized in that: The vehicle includes the vehicle-mounted terminal as claimed in claim 13.

15. A computer-readable storage medium, characterized in that: The method comprises a computer program. When the computer program is run on a vehicle-mounted terminal, the computer program is used to enable the vehicle-mounted terminal to execute the steps of any method described in claims 1 to 11.