Screen theme switching method, device, equipment and storage medium
By obtaining and matching user information and automatically switching screen themes of in-car multimedia, the problem of manual operation in the existing technology is solved, and intelligent screen theme management is realized, which improves user experience and flexibility.
Patent Information
- Application Number
- CN202210051376.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-17
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-01-17
AI Technical Summary
The screen theme switching of existing vehicle multimedia requires manual operation by users and cannot meet the needs of intelligence.
By obtaining user information, including user gender, age, expressions and status, using image recognition technology and sensor detection, automatically match and switch screen themes to match user information.
It realizes intelligent automatic switching of screen themes, improves user experience and flexibility, and meets the personalized needs of multiple screens.
Smart Images

Figure CN114416253B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle control technology, and in particular to a method, device, equipment and storage medium for switching screen themes. Background Art
[0002] With the development of vehicle control technology, the functions that can be realized by in-vehicle multimedia are becoming more and more abundant. For example, in-vehicle multimedia can switch to different screen themes.
[0003] In the related art, the screen theme of the in-vehicle multimedia is manually switched by the user. For the in-vehicle multimedia with multiple screens, the screen theme is also manually switched by the user, and when the user manually switches the screen theme, the themes of all screens are switched.
[0004] However, the method for switching screen themes in the related art requires manual operation by the user, which cannot meet the intelligent requirements of in-vehicle multimedia. Summary of the invention
[0005] The present application provides a method, device, equipment and storage medium for switching screen themes, which can solve the problems in related technologies.
[0006] In a first aspect, a method for switching a screen theme is provided, the method comprising:
[0007] Acquire first user information, where the first user information is user information of a first user in front of the first screen;
[0008] determining a first topic matching the first user information;
[0009] In response to a current theme of the first screen being different from the first theme, the first screen is controlled to switch a current theme to the first theme.
[0010] In a possible implementation manner, the obtaining the first user information includes:
[0011] Acquire a captured image containing the first user;
[0012] Perform image recognition on the collected image containing the first user, and determine first user information corresponding to the first user according to the recognition result.
[0013] In a possible implementation manner, obtaining the captured image of the first user includes:
[0014] Acquire detection data of a first sensor, where the first sensor is used to detect the first user;
[0015] When the detection data of the first sensor indicates that the first user is detected, the image acquisition device is controlled to perform image acquisition to obtain the acquired image containing the first user.
[0016] In a possible implementation manner, determining the first topic matching the first user information includes:
[0017] Determine a first user identifier corresponding to the first user information;
[0018] Based on the correspondence between the user identifier and the topic, a first topic corresponding to the first user identifier is determined.
[0019] In a possible implementation, the method further includes:
[0020] Acquire second user information, where the second user information is user information of a second user located in front of the second screen, and the second screen is associated with the first screen;
[0021] determining a second topic matching the second user information;
[0022] In response to the current theme of the second screen being different from the second theme, the second screen is controlled to switch the current theme to the second theme.
[0023] In a possible implementation manner, after controlling the first screen to switch the current theme to the first theme, the method further includes:
[0024] In response to a current theme of a second screen being different from the first theme, the second screen is controlled to switch a current theme to the first theme, and the second screen is associated with the first screen.
[0025] In a possible implementation, the first user information includes at least one of user gender, user age, user expression, user status or user account.
[0026] In a second aspect, a device for switching a screen theme is provided, the device comprising:
[0027] An acquisition module, used to acquire first user information, where the first user information is user information of a first user located in front of the first screen;
[0028] A determination module, used to determine a first topic matching the first user information;
[0029] The switching module is used for controlling the first screen to switch a current theme to the first theme in response to the current theme of the first screen being different from the first theme.
[0030] In a possible implementation, the acquisition module is configured to acquire a captured image containing the first user; perform image recognition on the captured image containing the first user, and determine first user information corresponding to the first user according to the recognition result.
[0031] In a possible implementation, an acquisition module is used to acquire detection data of a first sensor, where the first sensor is used to detect the first user; when the detection data of the first sensor indicates that the first user is detected, the image acquisition device is controlled to perform image acquisition to obtain the captured image containing the first user.
[0032] In a possible implementation, the determination module is configured to determine a first user identifier corresponding to the first user information; and determine a first topic corresponding to the first user identifier based on a correspondence between the user identifier and the topic.
[0033] In a possible implementation, the acquisition module is further used to acquire second user information, where the second user information is user information of a second user located in front of the second screen, and the second screen is associated with the first screen;
[0034] The determination module is further used to determine a second topic matching the second user information;
[0035] The switching module is further used to control the second screen to switch the current theme to the second theme in response to the current theme of the second screen being different from the second theme.
[0036] In a possible implementation, the switching module is further configured to control the second screen to switch its current theme to the first theme in response to the current theme of the second screen being different from the first theme, and the second screen is associated with the first screen.
[0037] In a possible implementation, the first user information includes at least one of user gender, user age, user expression, user status or user account.
[0038] In a third aspect, a computer device is also provided, comprising a processor and a memory, wherein the memory stores at least one program code, and the at least one program code is loaded and executed by the processor so that the computer device implements any of the above-mentioned methods for switching screen themes.
[0039] In a fourth aspect, a computer-readable storage medium is also provided, wherein at least one program code is stored in the computer-readable storage medium, and the at least one program code is loaded and executed by a processor to enable a computer to implement any of the above-mentioned methods for switching screen themes.
[0040] In a fifth aspect, a computer program product or a computer program is also provided, wherein the computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes any of the above-mentioned methods for switching screen themes.
[0041] The technical solution provided by this application can at least bring the following beneficial effects:
[0042] The technical solution provided in the present application automatically switches the theme of the first screen according to the obtained first user information, so that the theme of the first screen matches the first user information, better meets the user's usage needs, improves the flexibility of screen theme switching, and realizes intelligent screen theme switching. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0044] Figure 1 It is a schematic diagram of an implementation environment of a method for switching screen themes provided in an embodiment of the present application;
[0045] Figure 2 is a flow chart of a method for switching screen themes provided in an embodiment of the present application;
[0046] Figure 3 is a schematic diagram of a display interface of a screen theme provided in an embodiment of the present application;
[0047] Figure 4 is a schematic diagram of a screen theme switching system provided in an embodiment of the present application;
[0048] Figure 5 It is a flow chart of a method for switching screen themes of an in-vehicle multimedia provided by an embodiment of the present application;
[0049] Figure 6 is a schematic diagram of a screen theme switching device provided in an embodiment of the present application;
[0050] Figure 7 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0051] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.
[0052] Figure 1 A schematic diagram of an implementation environment of the method for switching screen themes provided in an embodiment of the present application is shown. The implementation environment includes: a terminal 101 and a server 102. The terminal 101 and the server 102 can be directly or indirectly connected via a wired or wireless communication mode, and the present application does not limit this.
[0053] The terminal 101 includes at least one screen for displaying content, and optionally, the theme of at least one screen can be switched to different themes or the same theme. The terminal 101 can be, for example, a mobile phone, a tablet computer, a game console, an e-book reader, a multimedia player, a wearable device, a PC (Personal Computer), a vehicle-mounted multimedia, etc.
[0054] The server 102 is used to provide background services for the terminal 101. The server 102 may be a single server, a server cluster consisting of multiple servers, or a cloud computing service center.
[0055] The method for switching the screen theme provided in the embodiment of the present application can be executed by the terminal 101, or by the server 102, or by the terminal 101 and the server 102 together, and the embodiment of the present application does not limit this. In the case where the method for switching the screen theme provided in the embodiment of the present application is jointly executed by the terminal 101 and the server 102, the server 102 undertakes the main computing work, and the terminal 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the terminal 101 undertakes the main computing work; or, the server 102 and the terminal 101 adopt a distributed computing architecture for collaborative computing.
[0056] Those skilled in the art should understand that the above-mentioned terminal 101 and server 102 are only examples, and other existing or future terminals or servers that are applicable to the present application should also be included in the protection scope of the present application and are included here by reference.
[0057] Based on the above Figure 1 In the implementation environment shown, the present application embodiment provides a method for switching screen themes, and takes the method applied to terminal 101 as an example for explanation. Figure 2 As shown, the screen theme switching method provided in the embodiment of the present application includes the following steps 201 to 203.
[0058] Step 201: obtain first user information, where the first user information is user information of a first user located in front of a first screen.
[0059] Optionally, the first user information is user information of a first user in front of the first screen. The first user may be a user who is currently using the first screen in front of the first screen, or a user who is not using the first screen in front of the first screen but may use the first screen. The first user information is used by the terminal to switch the theme of the first screen according to the first user information.
[0060] Exemplarily, taking the terminal as an in-vehicle multimedia, when the first screen is in an on state and the first user sits in a seat position corresponding to the first screen, the first user is a user who is currently using the first screen; when the first screen is in a off state and the first user sits in a seat position corresponding to the first screen, the first user is a user who is not using the first screen but may use the first screen.
[0061] In a possible implementation, the user information includes at least one of user gender, user age, user expression, user status, or user account. Optionally, user gender is used to switch screens that match different genders; user age is used to provide screen themes that match different age groups; user expression is used to switch screen themes that match different moods, for example, user expression can include happy, sad, dull, excited, etc.; user status is used to switch screen themes that match different states, for example, user status can include driving state, leisure state, etc.; user account is used to switch customized personalized themes.
[0062] In the embodiment of the present application, the acquired first user information is used to switch the theme of the first screen, so that the theme of the first screen matches the first user information, and the automatic switching of the screen theme is realized. Optionally, the first user information can be acquired through the captured image in front of the first screen.
[0063] In a possible implementation, obtaining the first user information includes: obtaining a captured image containing the first user; performing image recognition on the captured image containing the first user, and determining the first user information corresponding to the first user according to the recognition result.
[0064] The embodiments of the present application do not limit the implementation method of obtaining the captured image containing the first user. Exemplarily, taking the terminal as an in-vehicle multimedia, an image acquisition device is installed in the cockpit of the vehicle. Optionally, an image acquisition device can be installed on the entire vehicle, and the image acquisition range of the image acquisition device can be adjusted to capture the user image of each seat. Alternatively, an image acquisition device can be installed in front of each seat to capture the user image of the current seat. In another exemplary embodiment, an image acquisition device is installed on the edge of the screen of the first screen. For example, a miniature camera is installed in the middle of the upper edge of the first screen. Since the first screen corresponds to the seat, the image acquisition device can capture the user image of the corresponding seat. The image acquisition device can be any camera, video camera, camera or device with a camera function, which is not limited in the embodiments of the present application.
[0065] It is understandable that performing image recognition on the collected image containing the first user can identify the feature information of the first user, and then the first user information corresponding to the first user can be obtained based on the feature information. The embodiment of the present application does not limit the method used for image recognition. Exemplarily, the image recognition method can be a convolutional neural network (CNN), a hidden Markov model (HMM), a support vector machine (SVM), etc.
[0066] Optionally, the image acquisition device can detect in real time whether there is a user within the image acquisition range. When the appearance of a user is detected, the image acquisition device acquires the acquired image and actively sends the acquired image to the terminal, so that the terminal can acquire the acquired image containing the first user; or, when the terminal receives a acquisition instruction, the acquisition instruction is used to indicate that a user appears in front of the first screen, and then the terminal controls the image acquisition device to perform image acquisition and receives the acquired image, so that the terminal can acquire the acquired image containing the first user.
[0067] In an embodiment of the present application, the acquisition instruction can be actively triggered by the user. For example, when the user triggers the startup operation of the terminal, it indicates that the user begins to use the first screen, that is, the first user appears in front of the first screen, and the terminal receives the acquisition instruction at this time; or, the terminal is connected to a sensor, and when the sensor detects the first user, the acquisition instruction is sent to the terminal, so that the terminal can receive the acquisition instruction. Optionally, the embodiment of the present application does not limit the type of sensor, and it can be any sensor that can detect whether the first user appears in front of the first screen, such as a radar sensor, an infrared sensor, or a human proximity sensor.
[0068] In a possible implementation, obtaining a captured image including the first user includes: obtaining detection data of a first sensor, where the first sensor is used to detect the first user; when the detection data of the first sensor indicates that the first user is detected, controlling an image acquisition device to perform image acquisition to obtain a captured image including the first user.
[0069] For example, taking the terminal as an in-vehicle multimedia, the first sensor is a pressure sensor installed under each seat. When a user sits on a seat in the car, the pressure sensor collects force data. When the force data reaches a force threshold, it indicates that the first user has been detected. At this time, the pressure sensor sends a collection instruction to the terminal, and the terminal controls the image acquisition device to perform image acquisition according to the received collection instruction to obtain a collection image containing the first user.
[0070] Step 202: determine a first topic that matches the first user information.
[0071] After the first user information is obtained, a first theme matching the first user information may be determined according to the first user information, so that when the first user uses the first screen, the theme of the first screen satisfies the needs of the first user.
[0072] In the embodiment of the present application, the theme refers to a general description of the screen function and display style. Optionally, the interface resources included in the theme may include at least one of a background pattern, a font style, a font size, a type of application, an application icon style, or an icon position on the screen. According to the interface resources included in the theme, the screen can be displayed as a display interface corresponding to the theme.
[0073] In a possible implementation, determining the first topic matching the first user information includes: determining the first topic corresponding to the first user information based on the correspondence between the user information and the topic. Optionally, the first user information includes a user account, and the correspondence between the user account and the topic is pre-stored in the terminal, thereby determining the first topic corresponding to the first user account.
[0074] Exemplarily, the terminal receives a face image input by a user and configures a user account for the face image; at this time, the user can set a custom theme on the terminal screen, and in response to receiving the user's confirmation operation, the terminal saves the corresponding relationship between the user account and the custom theme. When the user uses the screen again, the user's face image can be recognized through the captured image, and the corresponding custom theme can be determined through the user account corresponding to the face image.
[0075] In a possible implementation, determining the first topic matching the first user information includes: determining the first user identifier corresponding to the first user information; and determining the first topic corresponding to the first user identifier based on the correspondence between the user identifier and the topic. Optionally, the user information includes user gender, user age, user expression, and user status, and the user is classified by different user information to obtain the corresponding user identifier, and then the corresponding topic is determined by the correspondence between the user identifier and the topic stored in advance.
[0076] Optionally, the user identifier may include children, elderly, women, driving status, leisure status, etc.; accordingly, the theme corresponding to the user identifier may include elderly theme, children theme, women theme, driving theme, entertainment theme, etc. The embodiment of the present application does not limit the correspondence between the user identifier and the theme. It is understandable that the correspondence between the user identifier and the theme can be flexibly adjusted according to the different requirements of the application scenario.
[0077] In the embodiment of the present application, the method of determining the first user identifier corresponding to the first user information is not limited, as long as the first user information can be classified as any user identifier in the corresponding relationship between the user identifier and the subject.
[0078] Exemplarily, when the user information includes the user's age, when the user's age exceeds the age range, the first user identifier corresponding to the first user information is determined to be an elderly person, and when the user's age is lower than the age range, the first user identifier corresponding to the first user information is determined to be a child. Optionally, the age range can be set based on experience, or flexibly adjusted according to the application scenario, for example, the age range is 8-60 years old.
[0079] In another exemplary embodiment, when the user information includes user status, when the user status indicates that the user in the driving position is driving the vehicle, the first user identifier corresponding to the first user information is determined to be in the driving state; when the user status indicates that the user in the driving position is not driving the vehicle, the first user identifier corresponding to the first user information is determined to be in the leisure state.
[0080] Thus, the first theme matching the first user information can be determined. After determining the first theme, it is determined whether the current theme of the first screen is the same as the first theme. If they are the same, no operation is performed. If they are different, step 203 can be executed.
[0081] Step 203: In response to the current theme of the first screen being different from the first theme, controlling the first screen to switch the current theme to the first theme.
[0082] In a possible implementation, controlling the first screen to switch the current theme to the first theme includes: acquiring interface resources corresponding to the first theme; controlling the first screen to replace the current interface resources with interface resources corresponding to the first theme, to obtain a display interface after the theme is switched.
[0083] In the embodiment of the present application, each theme includes corresponding interface resources. For example, the interface resources corresponding to the driving theme are mainly navigation-related applications; the interface resources corresponding to the entertainment theme are mainly video, music, and game-related applications; the interface resources corresponding to the elderly theme have larger fonts and simpler background patterns; the interface resources corresponding to the children's theme are mainly animation, education, and small game-related applications, and the background patterns are animation-related patterns. It is understandable that the settings of the interface resources corresponding to each theme can be flexibly adjusted according to the application scenario.
[0084] For example, see Figure 3 , Figure 3 A schematic diagram of a display interface of a screen theme provided in an embodiment of the present application. Optionally, Figure 3 The screen theme shown is the driving theme. The overall style of the display interface of the driving theme is relatively simple. It mainly includes basic display resources such as time, location, date, weather, and icons of applications such as navigation, radio, air conditioning and Bluetooth, which meet the driver's needs for screen usage while driving.
[0085] In a possible implementation, the terminal includes multiple screens, that is, the first screen is also associated with multiple other screens, and the multiple screens can optionally display different contents. After controlling the first screen to switch themes, the switching methods for the themes of the screens other than the first screen in the multiple screens include but are not limited to the following two methods.
[0086] Method 1: Switch themes on multiple screens simultaneously.
[0087] In the first method, after the first screen is controlled to switch themes, themes of other related screens are synchronously switched so that the themes of multiple screens are the same.
[0088] Optionally, after controlling the first screen to switch the current theme to the first theme, the method further includes: in response to the current theme of the second screen being different from the first theme, controlling the second screen to switch the current theme to the first theme, and the second screen is associated with the first screen.
[0089] Exemplarily, the multiple screens include screen 1, screen 2, and screen 3, and synchronous switching of themes of the multiple screens is implemented, including: when user information is detected in front of any one of the multiple screens, a theme matching the user information is determined based on the user information in front of the screen, and then the themes of screen 1, screen 2, and screen 3 are all switched to themes matching the user information.
[0090] In the process of synchronously switching themes of multiple screens, the themes of multiple screens are switched simultaneously according to the first user information. In this process, there are two situations: one is that the terminal does not obtain the user information of other screens except the first user information in front of the first screen, that is, the theme is determined directly according to the first user information; the other is that the terminal obtains multiple user information of users in front of multiple screens, that is, users appear in front of multiple screens, but the terminal chooses to determine the theme according to the first user information.
[0091] In a possible implementation, multiple user information in front of any multiple screens among the multiple screens is detected simultaneously; the method for switching screen themes also includes: obtaining first user information of a first user located in front of a first screen and second user information of a second user located in front of a second screen; determining a theme to be switched based on the first user information and the second user information; in response to the current themes of the first screen and the second screen being different from the theme to be switched, controlling the first screen and the second screen to switch the current theme to the theme to be switched.
[0092] In an embodiment of the present application, after obtaining the first user information and the second user information, it is necessary to determine the subject to be switched according to the first user information and the second user information. Optionally, determining the subject to be switched according to the first user information and the second user information includes: determining the third user information according to the first user information and the second user information, determining a third subject matching the third user information, and using the third subject as the subject to be switched.
[0093] In a possible implementation, the process of determining the third user information based on the first user information and the second user information may be: selecting one from the first user information and the second user information as the third user information for determining the subject to be switched; or, merging the first user information and the second user information to obtain the third user information for determining the subject to be switched.
[0094] Optionally, one of the first user information and the second user information is selected as the third user information for determining the subject to be switched, which may be a random selection of the first user information and the second user information as the third user information for determining the subject to be switched, or the third user information for determining the subject to be switched is obtained according to the priority of the first user information and the second user information. The priority of the user information may be set based on experience, or may be flexibly adjusted based on the application scenario.
[0095] Optionally, the embodiment of the present application does not limit the way of fusing the first user information with the second user information. For example, the first user information and the second user information are concatenated to obtain the third user information, or the information of the first user information and the second user information whose similarity is higher than a threshold is used as the third user information. The threshold can be set based on experience or flexibly adjusted according to the application scenario. For example, the threshold is 60%.
[0096] For example, the terminal is an in-vehicle multimedia, and the in-vehicle multimedia includes 4 screens. The in-vehicle multimedia simultaneously detects the first user information of the driver's seat and the second user information of the co-pilot seat. Optionally, the priority of the user information corresponding to the driver's seat is higher than the user information corresponding to the co-pilot seat, that is, the priority of the first user information is higher than the second user information, then the first theme matching the first user information can be directly determined, and the four screen themes are switched to the first theme.
[0097] In addition to the above-mentioned method of determining the subject to be switched based on the first user information and the second user information, in an embodiment of the present application, the method of determining the subject to be switched based on the first user information and the second user information can also be: determining a first subject that matches the first user information, and determining a second subject that matches the second user information; determining the subject to be switched based on the priority of the first subject and the second subject, or, merging the first subject and the second subject to obtain the subject to be switched.
[0098] Optionally, the priority of the theme can be set based on experience, or flexibly adjusted according to the application scenario. The embodiment of the present application does not limit the way of fusing the first theme with the second theme, for example, fusing the interface resources corresponding to the first theme with the interface resources corresponding to the second theme to obtain the theme to be switched.
[0099] Exemplarily, taking the terminal as an in-vehicle multimedia, and the in-vehicle multimedia including four screens as an example, if the first theme matching the first user information is a driving theme, and the second theme matching the second user information is an elderly theme, the themes of the four screens are switched to themes that are a fusion of the driving theme and the elderly theme, that is, the interface resources corresponding to the driving theme and the interface resources corresponding to the elderly theme are integrated.
[0100] Method 2: Multiple screens switch themes independently.
[0101] In the second method, after controlling the first screen to switch themes, the first screen is not synchronized with the themes of other associated screens, that is, the theme of each screen can be switched independently. Optionally, each screen uses the screen theme switching method provided in the embodiment of the present application to switch the theme. At this time, the themes of multiple screens used at the same time may be different. This allows the themes of multiple screens to be switched freely and flexibly. For multiple users using multiple screens, it can meet the personalized needs of each user at the same time, further improving the intelligence of screen theme switching.
[0102] In a possible implementation, the method for switching screen themes further includes: obtaining second user information, the second user information being user information of a second user in front of a second screen; determining a second theme that matches the second user information; and in response to the current theme of the second screen being different from the second theme, controlling the second screen to switch the current theme to the second theme. In other words, the terminal switches the themes of multiple screens independently, and switches the theme of the screen for which the user information in front of the screen is obtained, that is, the second user information is used by the terminal to switch the theme of the second screen according to the second user information.
[0103] In the second method, the implementation method of obtaining the second user information can refer to the content in the above step 201, the implementation method of determining the second theme matching the second user information can refer to the content in the above step 202, and the implementation method of controlling the second screen to switch the current theme to the second theme in response to the current theme of the second screen being different from the second theme can refer to the content in the above step 203.
[0104] Optionally, obtaining the second user information includes: obtaining a captured image containing the second user; performing image recognition on the captured image, and determining the second user information corresponding to the second user according to the recognition result.
[0105] In a possible implementation, the captured image containing the second user and the captured image containing the first user are the same captured image, that is, the captured image acquired by the terminal contains both the first user and the second user. At this time, the terminal can respectively acquire the first user information in front of the first screen and the second user information in front of the second screen through the positions of the first screen and the second screen in the captured image, and determine the first theme of the first screen according to the first user information, and determine the second theme of the second screen according to the second user information.
[0106] In another possible implementation, the captured image containing the second user is not the same captured image as the captured image containing the first user, that is, the terminal respectively obtains the captured image containing the first user and the captured image containing the second user. At this time, the terminal respectively obtains the first user information in front of the first screen according to the captured image containing the first user, obtains the second user information in front of the second screen according to the captured image containing the second user, and determines the first theme of the first screen according to the first user information, and determines the second theme of the second screen according to the second user information.
[0107] Optionally, acquiring a captured image including the second user includes: acquiring detection data of a second sensor, the second sensor being used to detect the second user; and when the detection data of the second sensor indicates that the second user is detected, controlling an image acquisition device to perform image acquisition to obtain a second captured image. Optionally, the second sensor may be of the same type as the first sensor, or may be of a different type than the first sensor.
[0108] The screen theme switching method provided in the present application automatically switches the theme of the first screen according to the obtained first user information, so that the theme of the first screen matches the first user information, better meets the user's usage needs, improves the flexibility of screen theme switching, and realizes intelligent screen theme switching.
[0109] Next, taking the terminal as an in-vehicle multimedia as an example, the screen theme switching method provided in the embodiment of the present application is further explained.
[0110] See also Figure 4 , Figure 4 A screen theme switching system provided in an embodiment of the present application includes at least one pressure sensor, at least one image acquisition device, a theme switching controller and at least one screen. The system includes the following functions:
[0111] The number of at least one pressure sensor is the same as that of at least one screen. The at least one pressure sensor is installed under the seat corresponding to the screen and is used to detect whether a user is sitting on the seat, that is, to detect whether a user appears in front of the screen and the user may use or has used the corresponding screen. When the at least one pressure sensor detects that a user is sitting on the seat, the detection information is sent to the theme switching controller, and the theme switching controller controls at least one image acquisition device to acquire an image.
[0112] The at least one image acquisition device may be one or the same as the number of the at least one screen. The at least one image acquisition device is used to acquire an image of the user in front of the screen and send the acquired image to the theme switching controller for control. The theme switching controller controls to obtain user information based on the acquired image recognition and determines a theme matching the user information based on the user information. After the theme switching controller controls to determine the theme, it is determined whether the current theme of the screen is the same as the determined theme. If they are different, the theme is switched to the determined theme.
[0113] At least one screen corresponds to at least one pressure sensor in a one-to-one manner, and the themes of different screens are determined according to data of different pressure sensors.
[0114] It should be noted that the specific implementation process of the screen theme switching system function is as follows Figure 2 The method embodiment shown will not be described in detail here.
[0115] The screen theme switching system provided in the embodiment of the present application switches the theme of the screen corresponding to the seat in real time according to the changes of the user sitting in the seat, so that the screen theme of the in-vehicle multimedia can be matched with the user using the screen in real time, which greatly improves the user experience and improves the intelligence of the in-vehicle multimedia.
[0116] based on Figure 4 The screen theme switching system shown in the figure, the embodiment of the present application provides a flowchart of a method for switching the screen theme of a vehicle-mounted multimedia, the method can be applied to Figure 4 The screen theme switching system shown in the figure can be optionally provided with four screens installed opposite to four seats in the vehicle cabin, four pressure sensors are installed under the four seats in the vehicle cabin for collecting force data of the corresponding seats, and one image acquisition device is installed on the rearview mirror for collecting images of all users in the vehicle.
[0117] See also Figure 5 Taking switching the theme of the first screen corresponding to the driver's seat as an example, the method for switching the screen theme of the in-vehicle multimedia provided in the embodiment of the present application includes the following steps 501-509.
[0118] Step 501: The theme switching controller obtains force data collected by the first pressure sensor.
[0119] Optionally, the first pressure sensor is installed under the driver's seat in the vehicle cabin. When the driver sits on the driver's seat, the first pressure sensor collects force data and sends the collected force data to the theme switching controller.
[0120] Step 502 , the theme switching controller determines whether the received force data indicates that a driver appears in front of the first screen. If so, execute step 503 ; if not, jump to execute step 509 .
[0121] Step 503: the theme switching controller controls the image acquisition device to perform image acquisition to obtain an image including the driver.
[0122] Step 504: The theme switching controller identifies the collected image and obtains the user information of the driver.
[0123] The implementation of step 504 can refer to the content of step 201 and will not be repeated here.
[0124] Step 505 : The theme switching controller determines a first theme that matches the user information of the driver.
[0125] The implementation method of step 505 can refer to the content of step 202, which will not be repeated here.
[0126] Step 506 , the theme switching controller determines whether the current theme of the first screen is the first theme, if so, executes step 507 , if not, jumps to execute step 508 .
[0127] Step 507: The theme switching controller controls the first screen to switch the current theme to the first theme.
[0128] The implementation of step 507 can refer to the content of step 203, which will not be repeated here.
[0129] Step 508, end.
[0130] Step 509: discard the force data.
[0131] See also Figure 6 , an embodiment of the present application provides a device for switching screen themes, the device comprising:
[0132] An acquisition module 601 is used to acquire first user information, where the first user information is user information of a first user located in front of the first screen;
[0133] A determination module 602 is used to determine a first topic matching the first user information;
[0134] The switching module 603 is used to control the first screen to switch the current theme to the first theme in response to the current theme of the first screen being different from the first theme.
[0135] In a possible implementation, the acquisition module 601 is used to acquire a captured image including a first user in front of a first screen; perform image recognition on the captured image including the first user, and determine first user information corresponding to the first user according to the recognition result.
[0136] In a possible implementation, the acquisition module 601 is used to acquire detection data of a first sensor, where the first sensor is used to detect a first user; when the detection data of the first sensor indicates that the first user is detected, the image acquisition device is controlled to perform image acquisition to obtain a captured image containing the first user.
[0137] In a possible implementation, the determination module 602 is configured to determine a first user identifier corresponding to the first user information; and determine a first topic corresponding to the first user identifier based on a correspondence between the user identifier and the topic.
[0138] In a possible implementation, the acquisition module 601 is further configured to acquire second user information, where the second user information is user information of a second user located in front of the second screen, and the second screen is associated with the first screen;
[0139] The determination module 602 is further used to determine a second topic matching the second user information;
[0140] The switching module 603 is further configured to control the second screen to switch the current theme to the second theme in response to the current theme of the second screen being different from the second theme.
[0141] In a possible implementation, the switching module 603 is further configured to control the second screen to switch the current theme to the first theme in response to the current theme of the second screen being different from the first theme, and the second screen is associated with the first screen.
[0142] In a possible implementation, the first user information includes at least one of user gender, user age, user expression, user status, or user account.
[0143] The screen theme switching device provided in the present application automatically switches the theme of the first screen according to the acquired first user information, so that the theme of the first screen matches the first user information, better meets the user's usage needs, improves the flexibility of screen theme switching, and realizes intelligent screen theme switching.
[0144] It should be understood that the device provided in the above embodiment only uses the division of the above functional modules as an example to implement its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and their specific implementation process is detailed in the method embodiment, which will not be repeated here.
[0145] Please refer to Figure 7 , which shows a schematic diagram of the structure of a computer device provided by an embodiment of the present application. The computer device may be a terminal, such as a smart phone, a tablet computer, a vehicle-mounted terminal, a laptop computer or a desktop computer. The terminal may also be called a user device, a portable terminal, a laptop terminal, a desktop terminal or other names.
[0146] Typically, the terminal includes: a processor 701 and a memory 702 .
[0147] The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 701 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 701 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 701 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.
[0148] The memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 702 is used to store at least one instruction, which is used to be executed by the processor 701 to implement the method for switching the screen theme provided in the method embodiment of the present application.
[0149] In some embodiments, the terminal may further optionally include: a peripheral device interface 703 and at least one peripheral device. The processor 701, the memory 702 and the peripheral device interface 703 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 703 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 704, a display screen 705, a camera assembly 706, an audio circuit 707, a positioning assembly 708 and a power supply 709.
[0150] The peripheral device interface 703 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 701 and the memory 702. In some embodiments, the processor 701, the memory 702, and the peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 701, the memory 702, and the peripheral device interface 703 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.
[0151] The radio frequency circuit 704 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 704 communicates with communication networks and other communication devices through electromagnetic signals. The radio frequency circuit 704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 704 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a wireless fidelity (Wireless Fidelity, WiFi) network. In some embodiments, the radio frequency circuit 704 may also include circuits related to NFC (Near Field Communication, short-range wireless communication), which is not limited in this application.
[0152] The display screen 705 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos and any combination thereof. When the display screen 705 is a touch display screen, the display screen 705 also has the ability to collect touch signals on the surface or above the surface of the display screen 705. The touch signal can be input to the processor 701 as a control signal for processing. At this time, the display screen 705 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 705 can be one, set on the front panel of the terminal; in other embodiments, the display screen 705 can be at least two, respectively set on different surfaces of the terminal or in a folding design; in some other embodiments, the display screen 705 can be a flexible display screen, set on the curved surface or folding surface of the terminal. Even, the display screen 705 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 705 can be made of materials such as LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode) and the like.
[0153] The camera assembly 706 is used to capture images or videos. Optionally, the camera assembly 706 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 706 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.
[0154] The audio circuit 707 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 701 for processing, or input them into the radio frequency circuit 704 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 701 or the radio frequency circuit 704 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 707 may also include a headphone jack.
[0155] Positioning component 708 is used to locate the current geographical location of the terminal to implement navigation or LBS (Location Based Service). Positioning component 708 can be a positioning component based on the US GPS (Global Positioning System), China's Beidou system, Russia's Grenas system or the European Union's Galileo system.
[0156] The power supply 709 is used to power various components in the terminal. The power supply 709 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 709 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.
[0157] In some embodiments, the terminal further includes one or more sensors 710 , including but not limited to: an acceleration sensor 711 , a gyroscope sensor 712 , a pressure sensor 713 , a fingerprint sensor 714 , an optical sensor 715 , and a proximity sensor 716 .
[0158] The acceleration sensor 711 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal. For example, the acceleration sensor 711 can be used to detect the components of gravity acceleration on the three coordinate axes. The processor 701 can control the display screen 705 to display the user interface in a horizontal view or a vertical view according to the gravity acceleration signal collected by the acceleration sensor 711. The acceleration sensor 711 can also be used for collecting game or user motion data.
[0159] The gyroscope sensor 712 can detect the body direction and rotation angle of the terminal, and the gyroscope sensor 712 can cooperate with the acceleration sensor 711 to collect the user's 3D actions on the terminal. The processor 701 can implement the following functions based on the data collected by the gyroscope sensor 712: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.
[0160] The pressure sensor 713 can be set in the side frame of the terminal and / or the lower layer of the display screen 705. When the pressure sensor 713 is set in the side frame of the terminal, the user's holding signal of the terminal can be detected, and the processor 701 performs left and right hand recognition or shortcut operation according to the holding signal collected by the pressure sensor 713. When the pressure sensor 713 is set in the lower layer of the display screen 705, the processor 701 controls the operability controls on the UI interface according to the user's pressure operation on the display screen 705. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
[0161] The fingerprint sensor 714 is used to collect the user's fingerprint, and the processor 701 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 714, or the fingerprint sensor 714 identifies the user's identity based on the collected fingerprint. When the user's identity is identified as a trusted identity, the processor 701 authorizes the user to perform relevant sensitive operations, which include unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 714 can be set on the front, back, or side of the terminal. When a physical button or manufacturer logo is set on the terminal, the fingerprint sensor 714 can be integrated with the physical button or manufacturer logo.
[0162] The optical sensor 715 is used to collect the ambient light intensity. In one embodiment, the processor 701 can control the display brightness of the display screen 705 according to the ambient light intensity collected by the optical sensor 715. Specifically, when the ambient light intensity is high, the display brightness of the display screen 705 is increased; when the ambient light intensity is low, the display brightness of the display screen 705 is reduced. In another embodiment, the processor 701 can also dynamically adjust the shooting parameters of the camera assembly 706 according to the ambient light intensity collected by the optical sensor 715.
[0163] The proximity sensor 716, also known as a distance sensor, is usually arranged on the front panel of the terminal. The proximity sensor 716 is used to collect the distance between the user and the front of the terminal. In one embodiment, when the proximity sensor 716 detects that the distance between the user and the front of the terminal is gradually decreasing, the processor 701 controls the display screen 705 to switch from the screen-on state to the screen-off state; when the proximity sensor 716 detects that the distance between the user and the front of the terminal is gradually increasing, the processor 701 controls the display screen 705 to switch from the screen-off state to the screen-on state.
[0164] Those skilled in the art will understand that Figure 7 The structure shown in the figure does not constitute a limitation on the computer device, and may include more or less components than shown in the figure, or combine some components, or adopt a different component arrangement.
[0165] In an exemplary embodiment, a computer device is also provided, the computer device comprising a processor and a memory, wherein at least one program code is stored in the memory. The at least one program code is loaded and executed by one or more processors to enable the computer device to implement any of the above-mentioned methods for switching screen themes.
[0166] In an exemplary embodiment, a computer-readable storage medium is also provided, in which at least one program code is stored. The at least one program code is loaded and executed by a processor of a computer device to enable the computer to implement any of the above-mentioned methods for switching screen themes.
[0167] Optionally, the computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a compact disc (CD-ROM), a magnetic tape, a floppy disk, an optical data storage device, etc.
[0168] In an exemplary embodiment, a computer program product or a computer program is also provided, the computer program product or the computer program includes a computer instruction, and the computer instruction is stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device performs any of the above-mentioned methods for switching the screen theme.
[0169] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0170] The above are only optional embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the principles of the present application should be included in the protection scope of the present application.
Claims
1. A method for switching screen themes, characterized in that: The method is applied to a terminal including multiple screens, and the method includes: When user information in front of any one of the multiple screens is detected, first user information is acquired, where the first user information is user information of a first user in front of the any one screen; determining a first topic matching the first user information; In response to the current theme of the first screen being different from the first theme, controlling the first screen to switch the current theme to the first theme; in response to the current theme of the second screen being different from the first theme, controlling the second screen to switch the current theme to the first theme, and the second screen is associated with the first screen; When multiple user information in front of any multiple screens among the multiple screens is detected at the same time, first user information and second user information are acquired, wherein the first user information is user information of a first user located in front of the first screen, and the second user information is user information of a second user located in front of a second screen, and the second screen is associated with the first screen; selecting one of the first user information and the second user information as the third user information for determining the subject to be switched, or fusing the first user information with the second user information to obtain the third user information for determining the subject to be switched; determining a third subject matching the third user information, and using the third subject as the subject to be switched; In response to the current themes of the first screen and the second screen being different from the theme to be switched, the first screen and the second screen are controlled to switch the current themes to the theme to be switched.
2. The method according to claim 1, characterized in that The obtaining of the first user information includes: Acquire a captured image containing the first user; Perform image recognition on the collected image containing the first user, and determine first user information corresponding to the first user according to the recognition result.
3. The method according to claim 2, characterized in that The acquiring of the captured image of the first user includes: Acquire detection data of a first sensor, where the first sensor is used to detect the first user; When the detection data of the first sensor indicates that the first user is detected, the image acquisition device is controlled to perform image acquisition to obtain the acquired image containing the first user.
4. The method according to claim 1, characterized in that: The determining a first topic matching the first user information includes: Determine a first user identifier corresponding to the first user information; Based on the correspondence between the user identifier and the topic, a first topic corresponding to the first user identifier is determined.
5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: Acquire second user information, where the second user information is user information of a second user located in front of the second screen, and the second screen is associated with the first screen; determining a second topic matching the second user information; In response to the current theme of the second screen being different from the second theme, the second screen is controlled to switch the current theme to the second theme.
6. The method according to any one of claims 1 to 4, characterized in that: The user information includes at least one of user gender, user age, user expression, user status or user account.
7. A device for switching screen themes, characterized in that: The device is applied to a terminal including multiple screens, and the device includes: an acquisition module, configured to acquire first user information when user information in front of any one of the multiple screens is detected, wherein the first user information is user information of a first user in front of the any one screen; A determination module, used to determine a first topic matching the first user information; a switching module, configured to control the first screen to switch its current theme to the first theme in response to the current theme of the first screen being different from the first theme; and control the second screen to switch its current theme to the first theme in response to the current theme of the second screen being different from the first theme, wherein the second screen is associated with the first screen; The acquisition module is further configured to acquire first user information and second user information when multiple user information in front of any multiple screens among the multiple screens is detected simultaneously, wherein the first user information is user information of a first user located in front of the first screen, and the second user information is user information of a second user located in front of a second screen, and the second screen is associated with the first screen; The determination module is further configured to select one of the first user information and the second user information as third user information for determining the subject to be switched, or to merge the first user information with the second user information to obtain third user information for determining the subject to be switched; determine a third subject matching the third user information, and use the third subject as the subject to be switched; The switching module is further configured to control the first screen and the second screen to switch their current themes to the theme to be switched in response to the current themes of the first screen and the second screen being different from the theme to be switched.
8. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one computer program or instruction, and the at least one computer program or instruction is loaded and executed by the processor so that the computer device implements the screen theme switching method as described in any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores at least one program code, and the at least one program code is loaded and executed by the processor to enable the computer to implement the method for switching the screen theme as described in any one of claims 1 to 6.
Citation Information
Patent Citations
Vehicle-mounted intelligent system with virtual instrument and information entertainment terminals
CN104050992A
Subject control method and control device for vehicle-mounted display device
CN109177984A
Account switching method of vehicle-mounted system, vehicle-mounted system and vehicle
CN110061984A
Vehicle-mounted machine theme switching method and vehicle-mounted machine system
CN110297676A
Display method and device, electronic equipment and storage medium
CN110377377A
