A smart terminal system that changes interface skins according to environmental changes

Abstract

This invention discloses an intelligent terminal system that changes the interface skin according to environmental changes, relating to the field of communication technology. The system includes the following steps: acquiring the driver's gender information and determining the main color scheme of the interface based on the gender information; collecting the driver's facial emotions and generating a face recognition result; collecting the brightness value inside the bus and comparing the brightness value with a set threshold to obtain the current brightness level; acquiring the current location information of the bus and connecting to a server to obtain the current weather conditions based on the location information; comprehensively analyzing the obtained data and searching and configuring it with an interface database, outputting the configured result, and changing the current interface skin to the updated interface skin to complete the skin change; judging the driver's emotional state based on the skin change result and providing reminders to the driver accordingly. This invention not only changes the traditional impression left by in-vehicle terminal devices on customers but also improves vehicle driving safety and enhances user satisfaction.

Description

Technical Field

[0001] This invention relates to the field of communication technology, and more specifically to an intelligent terminal system that changes its interface based on environmental changes. Background Technology

[0002] With societal development, public transportation is receiving increasing attention, making in-vehicle terminal equipment, as an indispensable component of public transportation, increasingly important. However, existing in-vehicle terminal equipment suffers from monotonous display interfaces, dull themes, inconvenient operation, lack of flexible skinning, inability to adapt to actual usage scenarios and user moods, and a failure to provide driver alerts based on skin changes. Furthermore, many in-vehicle terminal devices currently only offer one or two display interfaces, preventing users from changing them according to their preferences. This results in a poor visual and user experience, ultimately impacting the market competitiveness of in-vehicle terminal products.

[0003] Currently, users not only demand higher performance from in-vehicle terminals, but also require more aesthetically pleasing, diverse, intelligent, and user-friendly themes. In response to market changes and user needs, the inventors of this application, after in-depth research, propose a method for in-vehicle terminals to change their interface themes according to environmental changes. Summary of the Invention

[0004] The purpose of this invention is to provide a smart terminal system that can change the interface skin according to environmental changes, and to solve the following technical problems: 1) Existing in-vehicle terminal equipment displays a monotonous and boring interface with a dull theme. It is inconvenient to operate, cannot be flexibly skinned, cannot be skinned according to actual usage scenarios and user emotions, and cannot remind the driver based on skin changes. 2) Many in-vehicle terminal devices only have one or two display interfaces, and users cannot change the interface according to their preferences.

[0005] The objective of this invention can be achieved through the following technical solutions: A smart terminal system that allows for interface skinning based on environmental changes includes the following steps: Step S1: Obtain the driver's gender information and determine the main color scheme of the interface based on the gender information; Step S2: Collect the driver's facial emotions, generate facial recognition results, and search and match the results with the facial feature database to obtain the current emotional state; Step S3: Collect the brightness value inside the bus and compare the brightness value with the set threshold to obtain the current brightness level; Step S4: Obtain the current location information of the bus and connect to the server to obtain the current weather conditions based on the location information; Step S5: After comprehensively analyzing the obtained data, perform a search configuration with the interface database, output the configured results, and change the current interface skin to the updated interface skin to complete the skin change. Step S6: Based on the skin change result, determine the driver's emotional state and remind the driver accordingly.

[0006] Preferably, step S1, obtaining the driver's gender information, specifically includes two methods: a1. Users log in to the vehicle terminal device via facial recognition, and the device can directly obtain the user's gender; a2. Users log in to the terminal device using their account or work badge. The terminal device reports the user information to the server, queries the employee's gender in the employee information database, and the server sends the employee information back to the vehicle terminal.

[0007] Preferably, step S2 further includes establishing a face recognition database, which encapsulates data such as a person's gender and facial emotions, and classifying images of various facial emotions in the face database into seven emotions including anger, disgust, fear, happiness, calmness, sadness, and surprise. At regular intervals, facial key points are collected, facial image processing is performed, and facial image key points are extracted to generate facial recognition result images. The extracted facial image feature data is searched and matched with feature templates stored in the database. By setting a threshold, when the similarity exceeds this threshold, the matching result is output, and the current emotion category of the face is obtained.

[0008] Preferably, step S3 further includes classifying the brightness values ​​of the light inside the vehicle into five brightness levels from high to low, and setting a threshold for each level.

[0009] Preferably, in step S4, the on-board terminal device will determine the latitude and longitude coordinates of the current location, determine the city where the bus is located based on the latitude and longitude, and obtain the weather conditions and weather changes of the location from the server in real time.

[0010] Preferably, in step S5, the user learns and comprehensively analyzes four states: user gender, in-vehicle light brightness, user facial emotion, and weather conditions, to establish a terminal device interface skin database. Based on the data collected in the above steps, a comprehensive analysis is performed, and a search configuration is performed with the interface database. By setting a threshold, when the threshold is reached, the configured result is output, and the current interface skin is changed to the updated interface skin, thus completing the skin change.

[0011] Preferably, in step S6, the interface database contains multiple interfaces. By using different types of interfaces, the current state of the driver can be determined, and corresponding reminders can be given to the driver based on the changes in the interface.

[0012] A vehicle-mounted terminal, the vehicle-mounted terminal including a face recognition module, a communication module, a positioning module and a processor; The facial recognition module is used for device login, facial emotion recognition, and acquisition of in-vehicle light brightness. The positioning module is used to obtain the current location information of the bus. The communication module is used to connect to the network in order to obtain weather conditions from the server and to interact with the server.

[0013] Preferably, the processor determines the main color scheme of the interface based on the driver's gender information from the face recognition module. The facial recognition module collects the driver's facial emotions, generates facial recognition results, searches and matches the results with the facial feature database to obtain the current emotional state, collects the brightness value inside the bus, and compares the brightness value with the set threshold to obtain the current brightness level. The positioning module obtains the current location information of the bus and connects to the server to obtain the current weather conditions based on the location information. After comprehensively analyzing the obtained data, the interface database is searched and configured. The results are then output, and the current interface skin is changed to the updated interface skin to complete the skin change. Based on the results of the skin change, the driver's emotional state is assessed, and reminders are given accordingly.

[0014] Preferably, obtaining the driver's emotions also includes the following steps: b1. When the driver is within the shooting range of the face recognition module, the acquisition device will automatically search for and capture the user's face image and extract key facial information; b2. The face recognition module preprocesses the acquired face images; b3. The processor models the face preprocessing results and extracts certain key features of the face to obtain a face representation image; b4. The extracted facial image feature data is searched and matched with the feature templates stored in the facial database. By setting a threshold, when the similarity exceeds this threshold, the matching result is output. b5. The current driver's emotional state can be determined from the output results.

[0015] The beneficial effects of this invention are: (1) This invention comprehensively analyzes the user's gender, the brightness of the light inside the vehicle, the user's mood, and the weather changes, selects the most suitable interface skin for the user, and gives the driver corresponding reminders based on the changes in the interface skin; through this invention, not only can the traditional impression left by the vehicle terminal equipment be changed, but also the beautiful and diverse interface skins can be presented to the user, providing the user with intelligent and humanized services, while improving the safety of vehicle driving and enhancing user satisfaction. (2) Different types of interfaces can determine the current state of the driver and provide corresponding reminders to the driver based on the changes in the interface. For example, when an interface is generated based on a comprehensive analysis of emotions such as anger and resentment and the external environment, it means that the driver's current state is not very good. The device will remind the driver to adjust his driving state, which can improve driving safety. Attached Figure Description

[0016] The invention will now be further described with reference to the accompanying drawings.

[0017] Figure 1 This is a schematic diagram of the structure of an intelligent terminal system that can change the interface skin according to environmental changes according to the present invention; Figure 2 This is a schematic diagram of a vehicle-mounted terminal processing flow according to the present invention; Detailed Implementation The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] This invention relates to an intelligent terminal system that allows for interface skinning based on environmental changes. Please refer to [link / reference]. Figure 1 Specifically, it includes the following steps: Step S1: Obtain the driver's gender information and determine the main color scheme of the interface based on the gender information; Specifically, in this embodiment, step S1, obtaining the driver's gender information, includes two methods: a1. Users log in to the vehicle terminal device via facial recognition, and the device can directly obtain the user's gender.

[0019] a2. Users log in to the terminal device using their account or work badge. The terminal device reports the user information to the server 105, queries the employee's gender in the employee information database, and the server 105 sends the employee information back to the vehicle terminal.

[0020] Step S2: Collect the driver's facial emotions, generate facial recognition results, and search and match the results with the facial feature database to obtain the current emotional state; Specifically, in this embodiment, step S2 further includes establishing a face recognition database, which encapsulates data such as a person's gender and facial emotions. The images of various facial emotions in the face database are classified into seven emotions, including anger, disgust, fear, happiness, calmness, sadness, and surprise. Furthermore, facial key points are collected, facial image processing is performed, and facial image key points are extracted at regular intervals to generate facial recognition result images. The extracted facial image feature data is searched and matched with the feature templates stored in the database. By setting a threshold, when the similarity exceeds this threshold, the matching result is output, and the current emotion type of the face is obtained. Step S3: Collect the brightness value inside the bus and compare the brightness value with the set threshold to obtain the current brightness level; Specifically, in this embodiment, step S3 further includes classifying the brightness values ​​of the light inside the vehicle into five brightness levels from high to low, and setting a threshold for each level.

[0021] Step S4: Obtain the current location information of the bus and connect to server 105 to obtain the current weather conditions based on the location information; Specifically, in this embodiment, in step S4, the vehicle terminal device will determine the latitude and longitude coordinates of the current location, determine the city where the bus is located based on the latitude and longitude, and obtain the weather conditions and weather changes of the location from the server 105 in real time. Step S5: After comprehensively analyzing the obtained data, perform a search configuration with the interface database, output the configured results, and change the current interface skin to the updated interface skin to complete the skin change. Specifically, in this embodiment, step S5 involves learning and comprehensively analyzing four states: user gender, in-vehicle light brightness, user facial emotions, and weather conditions, to establish a terminal device interface skin database. Furthermore, based on the data collected in the above steps, a comprehensive analysis is performed, and a search configuration is performed with the interface database. By setting a threshold, when the threshold is reached, the obtained results are output, and the current interface skin is changed to the updated interface skin, thus completing the skin change.

[0022] Step S6: Based on the skin change result, determine the driver's emotional state and remind the driver accordingly; Specifically, in this embodiment, step S6 involves a database containing various interfaces. Different types of interfaces can be used to determine the current state of the driver, and corresponding reminders can be given to the driver based on changes in the interface. For example, an interface derived from a comprehensive analysis of emotions such as anger and resentment, as well as the external environment, indicates that the driver's current state is not particularly good. The device will then remind the driver to adjust their driving state, thereby improving driving safety.

[0023] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of a vehicle-mounted terminal provided in an embodiment of the present invention. The vehicle-mounted terminal includes a face recognition module 102, a communication module 103, and a positioning module 104. The face recognition module 102 is used for logging into the device, collecting facial emotion recognition data, and acquiring the brightness of the light inside the vehicle. The positioning module 104 is used to obtain the current location information of the bus. The communication module 103 is used to connect to the network so as to obtain weather conditions from the server 105 and to interact with the server 105.

[0024] Specifically, in this embodiment, the processor 101 determines the main color scheme of the interface based on the driver's gender information from the face recognition module 102, collects the driver's facial emotions, generates a face recognition result, searches and matches the result with the face feature database to obtain the current emotional state, collects the brightness value inside the bus, compares the brightness value with a set threshold to obtain the current brightness level, obtains the current location information of the bus from the positioning module 104, connects to the server 105 to obtain the current weather conditions based on the location information, comprehensively analyzes the obtained data, searches and configures it with the interface database, outputs the configured result, changes the current interface skin to the updated interface skin, completes the skin change, judges the driver's emotional state based on the skin change result, and reminds the driver according to the state.

[0025] Furthermore, when driving a bus, the driver first needs to log in to the onboard terminal via facial recognition. This method not only allows the driver to log in to the onboard terminal but also serves as a basis for driver attendance, thereby preventing dangerous behaviors such as designated driving. The driver's facial information is collected and compared with facial information in the database to identify the driver. The main color of the terminal interface can be determined based on the driver's identity information.

[0026] Specifically, in this embodiment, obtaining the driver's emotions also includes the following steps: b1. When the driver is within the shooting range of the face recognition module 102, the acquisition device will automatically search for and capture the user's face image; and extract key facial information. b2. The face recognition module 102 preprocesses the acquired face images; b3. The processor 101 models the face preprocessing results and extracts certain key features of the face to obtain a face representation image; b4. The extracted facial image feature data is searched and matched with the feature templates stored in the facial database. By setting a threshold, when the similarity exceeds this threshold, the matching result is output. b5. The current driver's emotional state can be determined from the output results.

[0027] Specifically, in this embodiment, the face recognition module 102 collects the brightness value inside the vehicle, compares the brightness value with a set threshold, and obtains the current brightness level inside the vehicle. Furthermore, an external brightness sensor can be connected to the in-vehicle terminal device to obtain the current brightness level inside the vehicle.

[0028] Furthermore, the system learns and comprehensively analyzes four states—user gender, in-vehicle lighting level, user facial emotion, and weather conditions—to establish a database of interface skins for terminal devices. For example, if the current driver is male, the in-vehicle lighting level is three, the user's facial emotion is calm, and the weather is sunny, the in-vehicle terminal will search and match the established interface database based on these four states and switch to the most suitable skin, such as an interface skin with moderate brightness and a blue tone.

[0029] Furthermore, the in-vehicle terminal does not switch the skin in real time. Instead, when there is a significant change in the light level, facial expression, or weather conditions, reaching a preset threshold, the terminal device will switch the interface skin.

[0030] Furthermore, after the interface is skinned, the vehicle terminal will also determine the driver's current emotional state. If the driver's current state is problematic, the device will give the driver a voice reminder to adjust his driving state. If the driver's state is seriously problematic, the vehicle terminal will report the problem to the monitoring center, which can prevent driving safety issues caused by emotional problems.

[0031] The foregoing has provided a detailed description of one embodiment of the present invention, but this description is merely a preferred embodiment and should not be construed as limiting the scope of the invention. All equivalent variations and modifications made within the scope of the claims of this invention should still fall within the patent coverage of this invention.

Claims

1. An intelligent terminal system for interface skinning according to environmental changes, characterized in that, Specifically comprising the following steps: Step S1, obtaining driver gender information, determining interface main tone according to gender information; Step S2, collecting driver facial emotion, generating face recognition result, searching and matching the result with face feature database to obtain current emotional state; Step S3, collecting interior bus vehicle brightness value, comparing the brightness value with the set threshold to obtain current brightness level; Step S4, obtaining current bus vehicle position information, connecting server according to position information to obtain current weather condition; Step S5, after comprehensive analysis of the obtained data, searching and configuring the interface database, outputting the matched result, replacing the current interface skin with the updated interface skin, and completing the skin replacement; Step S6, judging the emotional state of the driver according to the skin replacement result, and reminding the driver according to the state. 2.The intelligent terminal system of claim 1, wherein, The step S1, obtaining driver gender information specifically includes two obtaining methods: a1, the user logs in the vehicle terminal device through face recognition, and the device can directly obtain the gender of the user; a2, the user logs in the terminal device through an account or a work card, the terminal device reports the user information to the server, queries the employee gender in the employee information database, and the server returns the employee information to the vehicle terminal. 3.The intelligent terminal system of claim 1, wherein, The step S2 further includes establishing a face recognition database, which encapsulates the gender of the person, the facial emotion of the person and other data, classifying various facial emotions in the face database, and classifying seven emotions including anger, disgust, fear, happiness, calmness, sadness and surprise; Every time interval, collect face key points, face image processing, face image key point extraction, generate face recognition result image, search and match the feature data of the extracted face image with the feature template stored in the database, set a threshold, when the similarity exceeds the threshold, output the matched result, and get the current facial emotion type. 4.The intelligent terminal system of claim 1, wherein, The step S3 further includes classifying the light brightness value inside the vehicle, and setting the threshold value of the corresponding level from high to low. 5.The intelligent terminal system of claim 1, wherein, The step S4, the vehicle terminal device judges the latitude and longitude coordinate value of the current position, determines the city where the bus vehicle is located according to the latitude and longitude, and real-time obtains the weather condition and weather change of the position from the server. 6.The intelligent terminal system of skinning interface according to environmental changes according to claim 1, characterized in that, The step S5, learning and comprehensively analyzing four states including user gender, vehicle light brightness value, user facial emotion and weather condition, and establishing a terminal device interface skin database; Based on the data collected in the above steps, after comprehensive analysis, search and configure the interface database, set a threshold, when the threshold is reached, output the matched result, replace the current interface skin with the updated interface skin, and complete the skin replacement. 7.The intelligent terminal system of claim 1, wherein, The step S6, the interface database has multiple interfaces, through different types of interfaces, the state of the current driver can be determined, and the driver is reminded accordingly according to the change of the interface.

8. A vehicle terminal, characterized by comprising: The vehicle terminal includes a face recognition module, a communication module, a positioning module and a processor; The face recognition module is used for logging in the device, collecting facial emotion recognition and collecting vehicle light brightness; The positioning module is used to obtain the current location information of the bus. The communication module is used to connect to the network in order to obtain weather conditions from the server and to interact with the server.

9. The vehicle terminal according to claim 8, wherein The processor determines the main color scheme of the interface based on the driver's gender information from the facial recognition module. The facial recognition module collects the driver's facial emotions, generates facial recognition results, searches and matches the results with the facial feature database to obtain the current emotional state, collects the brightness value inside the bus, and compares the brightness value with the set threshold to obtain the current brightness level. The positioning module obtains the current location information of the bus and connects to the server to obtain the current weather conditions based on the location information. After comprehensively analyzing the obtained data, the interface database is searched and configured. The results are then output, and the current interface skin is changed to the updated interface skin to complete the skin change. Based on the results of the skin change, the driver's emotional state is assessed, and reminders are given accordingly.

10. The vehicle terminal according to claim 9, wherein Obtaining the driver's emotions also includes the following steps: b1. When the driver is within the shooting range of the face recognition module, the acquisition device will automatically search for and capture the user's face image and extract key facial information; b2. The face recognition module preprocesses the acquired face images; b3. The processor models the face preprocessing results and extracts certain key features of the face to obtain a face representation image; b4. The extracted facial image feature data is searched and matched with the feature templates stored in the facial database. By setting a threshold, when the similarity exceeds this threshold, the matching result is output. b5. The current driver's emotional state can be determined from the output results.

Images