Function recommendation method of terminal equipment, electronic equipment and storage medium

Abstract

The invention provides a function recommendation method of terminal equipment, electronic equipment and a storage medium, and relates to the technical field of terminals. The method comprises the following steps: the terminal equipment firstly obtains a target image containing face information of a user; extracting hidden features of the user from the target image; generating a user portrait of the user based on the recessive features of the user; next, according to a pre-configured corresponding relationship between different functions and different types of user portraits, personalized functions are matched for the user based on the type to which the user portraits of the user belong, and a personalized function recommendation list of the user is generated by utilizing the personalized functions; therefore, when the function selling points in the personalized function recommendation list are displayed in the experience application display page of the terminal equipment from high to low according to the recommendation weights, the functions more concerned by the user can be displayed to the user in a more striking manner, so that the purchase interest of the user on the terminal equipment is improved, and the purchase experience of the user is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a function recommendation method for a terminal device, an electronic device, and a storage medium. Background Art

[0002] With the continuous development of science and technology, terminal devices represented by mobile phones and tablet computers are increasingly used in people's lives and work, bringing great convenience to people. For example, people can take photos, make voice calls, watch videos or play games through terminal devices.

[0003] At present, in the scene of displaying mobile phones and other terminal devices in stores, exhibition counters, etc., when users get the prototypes of mobile phones and other terminal devices to experience them, the prototypes often show the functional selling points of the terminal products to users through experience applications, so that users can more intuitively understand the advantages of the terminal products. However, the functional selling points displayed in the experience applications in terminal devices are often fixed, that is, the functional selling points of each terminal device are fixed, and it is impossible to recommend personalized functional selling points for each user, which reduces the user's purchasing experience. Summary of the invention

[0004] In order to solve the above problems, the present application provides a method for recommending functions of a terminal device, an electronic device and a storage medium, the purpose of which is to be able to make personalized recommendations of terminal device functions for different users, so as to enhance the user's purchasing experience of the terminal device.

[0005] In the first aspect, the present application provides a method for recommending functions of a terminal device, the method comprising: the terminal device first obtains a target image containing user facial information; and extracts the user's implicit features (including age, gender, number, etc.) from the target image; then generates a user portrait of the user based on the user's implicit features; then, according to the pre-configured correspondence between different functions and different categories of user portraits, based on the category to which the user's user portrait belongs, matches personalized functions for the user, and uses these personalized functions to generate a personalized function recommendation list for the user. In this way, when the various function selling points in the personalized function recommendation list are displayed in the experience application APP display page of the terminal device according to the recommendation weight from high to low, the functions that the user cares more about can be presented to the user in a more eye-catching way, that is, the function selling points that are more in line with their personalized needs can be recommended to the user.

[0006] It can be seen that in the function recommendation method of the above-mentioned terminal device, if a user views terminal device products such as mobile phones in scenes such as stores and exhibition counters, when the user gets the terminal device prototype for experience, the terminal device in this embodiment no longer displays each function selling point in a fixed manner in the experience application, but recommends function selling points that are more in line with the user's personalized needs based on the user portrait determined by using the user's facial image features, thereby enhancing the purchasing interest of different users in the terminal device and thereby improving their purchasing experience.

[0007] In a possible implementation, extracting the user's implicit features from the target image may include: extracting the user's face image from the target image, and extracting image features of the user's face image; and extracting the user's implicit features based on the image features of the user's face image, thereby improving the accuracy of the user's implicit features.

[0008] In one possible implementation, the implicit characteristics of the user may include but are not limited to the implicit characteristics of the user's gender, age, and quantity, so as to utilize these personalized negative characteristics to more accurately determine the user portrait corresponding to the user.

[0009] In a possible implementation, generating a user portrait of a user based on implicit characteristics of the user may include: calculating a user portrait corresponding to the user according to implicit characteristics of the user such as gender, age, and quantity.

[0010] In one possible implementation, the user portrait corresponding to the user is calculated based on the implicit characteristics of the user's gender, age, and number, which may include: when the number of facial images of the user identified is one, using the age and gender of the user as the age and gender categories of the user portrait corresponding to the final user; or, when the number of facial images of the user identified is greater than one, comprehensively processing the ages of all identified users, and using the processing result as the age category in the user portrait corresponding to the final user; and using the gender of no less than half of all identified users as the gender category in the user portrait corresponding to the final user, so as to accurately calculate the various categories of the user portrait corresponding to the user.

[0011] In one possible implementation, when the user portrait of a user contains N categories, and N is a positive integer greater than 0; according to the correspondence between pre-configured different functions and user portraits of different categories, based on the user portrait of the user, matching personalized functions for the user may include: according to the correspondence between pre-configured different functions and user portraits of different categories, determining the functions and recommendation weights corresponding to each of the N categories of user portraits of the user, so as to further improve the accuracy of the user portrait.

[0012] In one possible implementation, generating a personalized function recommendation list for the user based on the personalized functions matched for the user may include: first, adding the recommendation weights of the same function corresponding to each of the N categories of user portraits of the user, and using the result as the new recommendation weight corresponding to the same function, and then arranging the updated recommendation weights of each function corresponding to each of the N categories of user portraits of the user in descending order, and merging them to generate the user's personalized function recommendation list, so as to ensure that each function in the user's personalized function recommendation list is sorted in a way that better meets the user's personalized needs.

[0013] In one possible implementation, after generating a personalized function recommendation list for the user based on the personalized functions matched for the user, the method further includes: displaying the user's personalized function recommendation list according to the function recommendation weight from high to low through the display page of the experience application on the terminal device, so as to ensure that each function selling point is displayed in a prominent position at different levels for the user to choose and understand.

[0014] In a second aspect, the present application provides an electronic device, the electronic device comprising a memory and a processor, the memory storing a computer program, the processor being used to call and execute the computer program to implement the function recommendation method for a terminal device as described in any one of the first aspects above.

[0015] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor of an electronic device, is used to implement the function recommendation method for a terminal device as described in any one of the first aspects above.

[0016] In a fourth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute a method for recommending functions of a terminal device as described in any one of the first aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A schematic diagram of a scenario provided for an embodiment of the present application;

[0018] Figure 2 A schematic diagram of an electronic device provided in an embodiment of the present application;

[0019] Figure 3 A software structure block diagram of an electronic device provided in an embodiment of the present application;

[0020] Figure 4 Flowchart of the function recommendation method for the terminal device provided in the embodiment of the present application

[0021] Figure 5 An example diagram of a user portrait provided in an embodiment of the present application;

[0022] Figure 6 An example diagram of a scenario for recommending functions of a terminal device provided in an embodiment of the present application. Figure 7 This is a second example diagram of a scenario in which the functions of the terminal device provided in an embodiment of the present application are recommended. DETAILED DESCRIPTION

[0023] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be used as limitations on the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context.

[0024] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0025] The multiple involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0026] In order to enable those skilled in the art to more clearly understand the solution of the present application, the application scenario of the technical solution of the present application is first explained below.

[0027] See also Figure 1 , which shows a scenario schematic diagram provided in an embodiment of the present application.

[0028] In this example scenario, a user is viewing a mobile phone or other terminal device product at a store or exhibition counter. When the user gets a terminal device prototype for experience, the screen of the terminal device prototype often displays its various functional selling points to the user through an experience application (which can be a mobile phone software (application, APP) display page, etc.) (the specific layout, display content and display method of each functional selling point in the display page are not limited), such as Figure 1 As shown, taking a mobile phone displayed on a store counter as an example, when any user picks up the phone for experience, the functional selling point icons of the phone, such as "200 million pixel photo camera", "zero risk dimming eye protection", "ultra-dynamic color display", "GPU Turbo X game engine", etc., will be fixedly displayed on the experience application APP display page of the phone for users to choose. Then, after the user clicks on the icon corresponding to a functional selling point, the specific information of the functional selling point can be displayed in detail on the mobile phone interface in the form of video or image. For example, when the user clicks on the icon corresponding to "zero risk dimming eye protection", a video pop-up window can be used to introduce how "zero risk dimming eye protection" is achieved and what beneficial effects it can bring to users.

[0029] However, under normal circumstances, terminal devices often have many functional selling points, and different users have different requirements for the use of terminal devices. For example, the elderly may be more concerned about the screen clarity of the terminal device, whether the call volume is loud enough, and whether the font displayed on the screen is large enough, but young people may be more concerned about the running smoothness of the terminal device, the clarity of the photo, and whether it is equipped with a game engine, etc. Therefore, the current fixed display method of the functional selling points of the terminal device experience application cannot make personalized functional selling point recommendations for different users, which is not conducive to different users to more quickly and intuitively understand whether the terminal device product meets their personalized purchasing needs, and reduces the user's purchasing experience.

[0030] In order to overcome the above technical problems, the present application provides a method for recommending terminal device functions, an electronic device and a storage medium, which can provide personalized recommendations for terminal device functions for different users, so as to enhance the user's purchasing experience of the terminal device.

[0031] The function recommendation method for a terminal device provided in the embodiment of the present application can be applicable to electronic devices (i.e., terminal devices) such as mobile phones, tablet computers, personal digital assistants (PDA), desktops, laptops, notebook computers, ultra-mobile personal computers (UMPC), handheld computers, netbooks, and wearable devices.

[0032] In order to enable those skilled in the art to more clearly understand the function recommendation method for a terminal device provided in the present application, the hardware architecture and software system architecture of the electronic device are first introduced in detail below.

[0033] See also Figure 2 , which shows a schematic diagram of an electronic device provided in an embodiment of the present application.

[0034] like Figure 2 As shown, the electronic device 200 may include a processor 210, a mobile communication module 220, a wireless communication module 230, a sensor module 240, an internal memory 241, an external memory interface 242, a motor 243, a button 244, a camera 245, a display screen 246, an audio module 247, a speaker 247A, a receiver 247B, a microphone 247C, an earphone interface 247D, an antenna group 1 and an antenna group 2.

[0035] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0036] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0037] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.

[0038] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0039] The internal memory 241 can be used to store computer executable program codes, which include instructions. The internal memory 241 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound collection function, an image shooting function, etc.), etc. The data storage area may store data created during the use of the electronic device 200 (such as audio data, image data, etc.), etc. In addition, the internal memory 241 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 210 executes various functional applications (such as face image recognition, smart code recognition, breath awakening, etc.) and data processing of the electronic device 200 by running instructions stored in the internal memory 241 and / or instructions stored in a memory provided in the processor.

[0040] The external memory interface 242 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 200. The external memory card communicates with the processor 210 through the external memory interface 242 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0041] Motor 243 can generate vibration prompts. Motor 243 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0042] The button 244 includes a power button, a volume button, etc. The button 245 can be a mechanical button. It can also be a touch button. The electronic device 200 can receive the button input and generate a key signal input related to the user setting and function control of the electronic device 200. For example, when the user triggers the touch button such as "200 million pixel photo camera" on the screen of the electronic device 200, the corresponding function on the electronic device 200 can be displayed.

[0043] The display screen 246 is used to display images, videos, etc. For example, when the user gets the electronic device 200 for experience, it can be used to display the icon screen of each functional selling point of the electronic device 200. The display screen 246 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device 200 may include 1 or N display screens 252, where N is a positive integer greater than 1.

[0044] The camera 245 is used to capture static images or videos, such as when the user takes the electronic device 200 for experience, it can be used to capture an image containing the user's facial information. In some embodiments, the electronic device 200 may include 1 or N cameras 245, where N is a positive integer greater than 1.

[0045] The electronic device 200 implements the display function through a GPU, a display screen 246, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 246 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs, which execute program instructions to generate or change display information.

[0046] The electronic device 200 can implement audio functions such as music playback, recording, and voice input and output through the audio module 247, the speaker 247A, the receiver 247B, the microphone 247C, the headphone jack 247D, and the application processor.

[0047] The audio module 247 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 247 can also be used to encode and decode audio signals. In some embodiments, the audio module 247 can be arranged in the processor 210, or some functional modules of the audio module 247 can be arranged in the processor 210.

[0048] The speaker 247A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 200 can listen to music or listen to a hands-free call through the speaker 247A.

[0049] The receiver 247B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 200 receives a call or voice message, the voice can be received by placing the receiver 247B close to the human ear.

[0050] Microphone 247C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 247C to input the sound signal into the microphone 247C. The electronic device 200 can be provided with at least one microphone 247C. In other embodiments, the electronic device 200 can be provided with two microphones 247C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 200 can also be provided with three, four or more microphones 247C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0051] The earphone interface 247D is used to connect a wired earphone and can be a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0052] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0053] The wireless communication function of the electronic device 200 can be implemented through the antenna 1, the antenna 2, the mobile communication module 220, the wireless communication module 230, the modem processor and the baseband processor.

[0054] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0055] The mobile communication module 220 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 200. The mobile communication module 220 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 220 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 220 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 220 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 220 can be set in the same device as at least some of the modules of the processor 210.

[0056] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 247A, a receiver 247B, etc.), or displays an image or video through a display screen 246. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 220 or other functional modules.

[0057] The wireless communication module 230 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 200. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 230 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 210. The wireless communication module 230 can also receive the signal to be sent from the processor 210, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0058] In some embodiments, the antenna 1 of the electronic device 200 is coupled to the mobile communication module 220, and the antenna 2 is coupled to the wireless communication module 230, so that the electronic device 200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0059] In addition, on top of the above components, the electronic device 200 runs an operating system, such as an iOS operating system, an Android operating system, a Windows operating system, etc. Application programs can be installed and run on the operating system.

[0060] See also Figure 3 , which shows a schematic diagram of the software structure of the electronic device provided in an embodiment of the present application.

[0061] The software system of the electronic device 200 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 200.

[0062] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0063] The application layer can include a series of application packages. Figure 3 As shown, the application package may include applications such as camera, call, music, video, WLAN, Bluetooth, etc. When a user gets the electronic device for experience, the camera can capture an image containing the user's facial information, and then pass the image to the view system of the application framework layer (framework layer) through the corresponding interface for subsequent image recognition processing operations.

[0064] The application framework layer (framework layer) provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 3 As shown, the application framework layer may include a window manager, a notification manager, a view system, a phone manager, a resource manager, a function recommendation algorithm for terminal devices, and the like.

[0065] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0066] The phone manager is used to provide communication functions of the electronic device 200, such as management of call status (including connecting and disconnecting video calls, etc.).

[0067] The view system includes visual controls, such as controls for displaying text and controls for displaying pictures. The view system can be used to build applications. The display interface can be composed of one or more views. For example, the display interface of the icons of the functional selling points of the device, such as "200 million pixel photo camera", "zero risk dimming eye protection", "ultra-dynamic color display", "GPU Turbo X game engine", etc., can include views for displaying text and views for displaying pictures.

[0068] The function recommendation algorithm of the terminal device is used to process the image containing the user's facial information obtained by the camera to extract the user's implicit features (including age, gender, number, etc.); then generate a user portrait of the user based on the user's implicit features; then, according to the pre-configured correspondence between different functions and different categories of user portraits, as well as the category to which the user's user portrait belongs, match personalized functions for the user, and use these personalized functions to generate a personalized function recommendation list for the user, so as to make personalized recommendations and displays of function selling points that meet the personalized needs of different users.

[0069] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0070] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0071] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0072] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0073] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0074] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0075] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0076] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0077] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0078] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0079] A 2D graphics engine is a drawing engine for 2D drawings.

[0080] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0081] The technical solutions involved in the following embodiments can all be implemented in electronic devices having the above-mentioned hardware architecture and software architecture.

[0082] Next, the implementation process of the function recommendation method of the terminal device provided by this application will be introduced in detail:

[0083] like Figure 4 As shown, the specific implementation process of the function recommendation method of the terminal device may include the following steps S401-S406:

[0084] S401: The terminal device obtains a target image containing user facial information.

[0085] In this embodiment, if a user views terminal device products such as mobile phones in scenes such as stores and exhibition counters, when the user gets the terminal device prototype for experience, the terminal device can not only immediately start the experience application APP, but also start the camera in the background (such as the camera pre-loaded on the terminal device) to capture images containing the user's facial information around the terminal device as the target image to execute the subsequent step S402.

[0086] It should be noted that this embodiment does not limit the type of the target image. For example, the target image may be a color image composed of three primary colors: red (R), green (G), and blue (B), or a grayscale image.

[0087] S402: The terminal device performs image recognition processing on the target image to extract the user's facial image and extract image features of the user's facial image.

[0088] After the terminal device uses the camera to obtain the target image containing the user's facial information through step S401, it can further use existing or future face detection methods to perform image recognition processing on the target image to extract the user's facial image. For example, the open source face engine of OpenCV can be used to perform image recognition processing on the target image based on feature and cascade classifier face detection methods to extract the user's facial image. Among them, multiple strong classifiers are combined, and through this series of training methods, a cascade classifier can eventually be formed, and the detection accuracy can be effectively improved.

[0089] Specifically, when taking a user's face image, it is possible to determine whether there is a face image in a dynamic scene or complex background, and separate this information. For example, feature points such as eyes, ears, nose, cheeks, mouth, etc. can be detected first to detect the most prominent face contour in the target image.

[0090] It should be noted that in order to improve the detection accuracy, the target image can be preprocessed before the image features of the user's facial image are extracted. Specifically, the target image frame acquired by the camera can be preprocessed to remove irrelevant information (such as noise, etc.) in the target image, minimize the interference of the external environment or imaging system on the target image, and make the image features more obvious.

[0091] Then, the image feature information is extracted by using the existing or future image feature extraction method to extract the image features of the user's face image. The main process may include but is not limited to face light compensation, grayscale conversion, image enhancement, normalization and other processing. For example, the feature extraction method such as Convolutional Neural Networks (HOG) feature extraction and Scale-invariant feature transform (SIFT) feature extraction method can be used to extract features that can represent the image information (including the user's face information) from the user's face image. Here, the feature is defined as an image feature, which should carry all the face information of the corresponding user, and the specific form of the image feature can be a feature map (vector matrix), etc. For example, the user's face image with a size of 200×200 can be extracted by proportional compression to obtain a feature map with a size of 200×200 as the image feature of the user's face image, which is used to perform the subsequent step S403.

[0092] It should be noted that the embodiments of the present application do not limit the method for extracting the user's facial image and its image features, nor do they limit the specific extraction process. An appropriate extraction method can be selected according to actual conditions, and corresponding feature extraction operations can be performed.

[0093] S403: The terminal device extracts implicit features of the user based on the image features of the user's facial image.

[0094] After the terminal device extracts the image features of the user's facial image through step S402, it can further use existing or future image feature processing methods to process the image features of the user's facial image to extract implicit features related to the user's gender (gender), age (age), quantity (Count), etc., among which commonly used features may include but are not limited to overall features represented by brightness distribution information, and local features represented by the position and shape contour information of facial features.

[0095] S404: The terminal device generates a user portrait corresponding to the user by using the user's implicit features.

[0096] After the terminal device extracts the implicit features of the user through step S403, it can further generate a user portrait corresponding to the user based on the extracted implicit features of the user. For example, it can calculate the user portrait corresponding to the user based on the implicit features of the user's gender, age, and quantity.

[0097] Specifically, when only one facial image of a user is identified, the age and gender of the user can be used as the user portrait corresponding to the end user.

[0098] Alternatively, when there are more than two recognized user face images, that is, there are more than two users experiencing the same mobile phone or other terminal device at the same time, at this time, if there is a user whose age is in the age group of teenagers (such as 13-18 years old), the age of the teenager user can be used as the age in the user portrait corresponding to the final user (which can be defined as the comprehensive age); if there is no user whose age is in the age group of teenagers (such as 13-18 years old), the ages of all users can be processed comprehensively, and the processing result can be used as the age in the user portrait corresponding to the final user. The specific calculation formula is as follows:

[0099]

[0100] Among them, age represents the age of the end user in the user portrait (i.e., the comprehensive age); age1, age2, ..., ageM respectively represent the ages of the faces of M users who experience the same mobile phone or other terminal device at the same time.

[0101] Moreover, when the number of males among the identified users is not less than the number of females, males can be used as the gender in the user portrait corresponding to the final user. Conversely, when the number of males among the identified users is less than the number of females, females can be used as the gender in the user portrait corresponding to the final user.

[0102] In this way, the user portrait corresponding to the user calculated based on the user's gender, age, and number of implicit characteristics can be as follows: Figure 4 As shown, the user portraits included are "general", "middle-aged male", "middle-aged female", "elderly", "young female", "young male", and "juvenile". The numerical range of age segments in this application is only an example and is not limited. It can be adjusted according to actual conditions and experience.

[0103] S405: The terminal device matches personalized functions for the user according to the correspondence between the pre-configured functions and the user portrait and based on the category to which the user portrait corresponding to the user belongs.

[0104] It should be noted that in order to provide personalized recommendations for terminal device functions for different users and improve the user's purchasing experience of the terminal device, this application pre-configures different functional selling points for different user portraits, that is, pre-configures the correspondence between different functions and different categories of user portraits, and configures multiple different categories of user portraits (portrait) and corresponding recommendation weights (weight) for each functional selling point (Function) according to the degree of matching.

[0105] Among them, the various functional selling points of the terminal equipment may include but are not limited to "200 million pixel photo camera, 50 million pixel front lens, multi-focal length portrait, photo portrait engine, night scene blockbuster, dynamic photo, four-curve design, ultra-dynamic color display, retina-level resolution, zero-risk dimming eye protection, sleep-aiding display technology, natural light eye protection technology, 5000mAh high-density battery, light and thin long battery life, large memory, first-generation Snapdragon 8+ flagship chip, GPU Turbo X game engine, stereo dual speakers, light and thin design that can be held in one hand, watches, headphones, smart interconnection, one-click blockbuster 2.0, Magic text recognition, YOYO suggestions, global collection, smart code recognition, breath awakening, safety protection" and so on.

[0106] Accordingly, an example of the correspondence between different functions pre-configured in this application and different categories of user portraits is shown as follows:

[0107] [{"name":"Zero-risk dimming eye protection","functionId":"010101","conf":[{"portrait":"Wearing glasses","weigth":5},{"portrait":"Young man","weigth":2},{"portrait":"Young woman","weigth":2},{"portrait":"Old age","weigth":2},{"portrait":"General","weigth":1}]},

[0108] {"name":"GPU Turbo X Game Engine","functionId":"010102","conf":[{"portrait":"Young man","weigth":3},{"portrait":"Young woman","weigth":3},{"portrait":"General","weigth":1}]},

[0109] {"name":"Safety protection","functionId":"010102","conf":[{"portrait":"Middle-aged male","weigth":4},{"portrait":"Middle-aged female","weigth":4},{"portrait":"Old age","weigth":3},{"portrait":"General","weigth":1}]}]

[0110] It can be seen that the above example shows the names (name), identifiers (functionId) of three functional selling points (Function), "zero-risk dimming eye protection", "GPUTurbo X game engine" and "safety protection", as well as multiple categories of user portraits (portrait) and corresponding recommendation weights (weight) configured for these three functional selling points.

[0111] Among them, for the functional selling point of "zero-risk dimming eye protection", this application pre-configures 5 categories of user portraits for it, namely "wearing glasses", "young men", "young women", "elderly", and "general", and the corresponding recommendation weights are: 5, 2, 2, 2, and 1.

[0112] For the functional selling point "GPU Turbo X Game Engine", this application pre-configures three categories of user portraits for it, namely "young male", "young female", and "general", and the corresponding recommendation weights are: 3, 3, and 1 respectively.

[0113] For the functional selling point of "safety protection", this application has pre-configured 4 categories of user portraits, namely "middle-aged men", "middle-aged women", "elderly", and "general", and the corresponding recommendation weights are: 4, 4, 3, and 1.

[0114] In this way, according to the multiple categories of user portraits and corresponding recommendation weights pre-configured for each functional selling point in this application, based on the category to which the user portrait corresponding to the user generated in step S404 belongs, a functional selling point that better meets the user's personalized needs can be matched for the user to execute the subsequent step S406.

[0115] It should be noted that the multiple categories of user portraits and the corresponding recommendation weights pre-configured for each functional selling point in this application are not fixed, that is, the correspondence between the pre-configured functions and user portraits can be adjusted according to actual conditions and experience values. The correspondence between the above-mentioned functional selling points and different categories of user portraits is only an example, and this application does not limit this.

[0116] S406: The terminal device generates a personalized function recommendation list for the user according to the personalized functions matched for the user.

[0117] After the terminal device matches personalized functional selling points for the user through step S405, it may further need to integrate the functional selling points corresponding to each category in the user portrait to generate a personalized functional recommendation list for the user based on the integration result.

[0118] Specifically, the present application can first loop through each functional selling point according to the multiple categories of user portraits (portraits) and the corresponding recommendation weights (weights) configured for each functional selling point (Function) to achieve classification and collection of user portraits of different categories. For example, for the functional selling point "zero-risk dimming eye protection", assuming that the three categories of user portraits of middle-aged men, middle-aged women, and those wearing glasses are pre-configured, the functional selling point and the recommendation weight can be added to the functional selling point list corresponding to the three categories of user portraits. By analogy, a functional selling point list corresponding to each category of user portrait can be generated, that is, the functional selling points and the corresponding recommendation weights corresponding to each category of user portrait can constitute the functional selling point list corresponding to the user portrait of this category, and further, the functional selling points in the functional selling point list can be arranged in descending order according to the size of the recommendation weight.

[0119] In addition, in order to ensure the security of data, a hash table can be used to map the feature value corresponding to each category of user portrait to a position in the functional selling point strategy table (storing each category of user portrait and its corresponding functional selling point list), so that the hash value can be used to quickly query the functional selling point list corresponding to each category of user portrait. The specific acquisition method is as follows:

[0120] FunctionList=HashMap.get(portrait)

[0121] Among them, FunctionList represents the functional selling point list corresponding to the queried user portrait; HashMap represents the selling point strategy hash map corresponding to the functional selling point strategy table; portrait represents the user portrait of the category to be queried.

[0122] Based on this, the function selling point lists corresponding to the user portraits of each category of users can be determined. Furthermore, the function selling point lists corresponding to the user portraits of each category can be merged, and the recommendation weights of the same function selling point can be added together as the new recommendation weight of the function selling point to determine the overall function selling point list corresponding to the user, and the overall function selling point list can be arranged in descending order of recommendation weights as the user's personalized function recommendation list.

[0123] For example, assuming that users include three categories of user portraits: A, B, and C, and the function selling point lists corresponding to these three categories of user portraits are AList, BList, and CList respectively, then the recommendation weights of the same function selling point in AList, BList, and CList can be added together as the new recommendation weight of the function selling point. Then, the updated recommendation weights of each function selling point in these three lists can be arranged in descending order and merged to generate a personalized function recommendation list for the user, so as to recommend each function selling point to the user according to the recommendation weight from high to low.

[0124] In addition, in some embodiments, if the number of function selling points in the generated personalized function recommendation list of the user is small and lower than the preset recommendation quantity threshold, the corresponding function selling points can be selected from the function selling point list corresponding to the user portrait of the "general" category according to the recommendation weight from high to low to supplement. Among them, the specific value of the preset recommendation quantity threshold can be set according to the actual situation and experience value of the terminal device, and this application does not limit this. For example, the preset recommendation quantity threshold can be set to 10, etc.

[0125] For example, assuming that the user's user portrait is "elderly", and the number of functional selling points included in the functional selling point list corresponding to the user portrait of this category is 6, when the recommendation quantity threshold is set to 10, the number of functional selling points 6 included in the functional selling point list corresponding to the user portrait of this category is less than the recommendation quantity threshold 10. At this time, 4 functional selling points can be selected from the functional selling point list corresponding to the user portrait of the "general" category according to the recommendation weight from high to low, and these 4 functional selling points can be added to the user's personalized function recommendation list, and then the various functional selling points in the personalized function recommendation list after the function selling points are added are sorted from high to low according to the recommendation weight to generate the final personalized function recommendation list corresponding to the user (including 10 functional selling points).

[0126] In addition, in some embodiments, after the terminal device generates a personalized function recommendation list for the user, the personalized function recommendation list can be displayed through the experience application APP display page, and each recommended function in the recommendation list is arranged in different positions in accordance with the recommendation weight, that is, the function selling point with a higher recommendation weight is more eye-catching in the recommendation list for the user. The specific arrangement method and display position are not limited.

[0127] For example: assuming that the user includes two category user portraits of "wearing glasses, young men", the recommendation weights of the same functional selling point in the functional selling point lists corresponding to the two category user portraits can be added together. For example, the recommendation weights of 5 and 2 corresponding to the same functional selling point "zero-risk dimming eye protection" in the two functional selling point lists can be added together to obtain a new recommendation weight of 7 for "zero-risk dimming eye protection". And so on. After arranging the updated recommendation weights of each functional selling point in the two lists in descending order, they are merged to generate a personalized function recommendation list for the user, and each functional selling point is recommended to the user in the experience application APP display page according to the recommendation weight from high to low.

[0128] like Figure 6 As shown in the figure, suppose the function selling points in the personalized function recommendation list of the user are sorted from high to low according to the recommendation weight: "Zero Risk Dimming Eye Protection", "GPU Turbo X Game Engine", "Ultra Dynamic Color Display", "200 Million Pixel Photo Camera", etc. Then the icons corresponding to these function selling points can be displayed from top to bottom in the experience application APP display page, and the icon corresponding to "Zero Risk Dimming Eye Protection" is highlighted in a large square at the top of the eye-catching position for users to choose and understand.

[0129] Or, if Figure 7As shown, it is still assumed that the function selling points in the personalized function recommendation list of the user are sorted from high to low according to the recommendation weight: "Zero Risk Dimming Eye Protection", "GPU Turbo X Game Engine", "Ultra Dynamic Color Display", "200 Million Pixel Photo Camera", etc. Then the icons corresponding to these function selling points can be scattered from the middle to the surroundings in the experience application APP display page, and the icon corresponding to "Zero Risk Dimming Eye Protection" is highlighted in a large round frame in a conspicuous position in the middle for users to choose and understand.

[0130] In this way, if a user views terminal device products such as mobile phones in a store, exhibition counter, etc., when the user gets the terminal device prototype to experience it, in order to be able to make personalized recommendations on terminal device functions for each different user and enhance the user's purchasing experience of the terminal device, the terminal device can execute the above steps S401-S406, based on the user portrait determined using the user's facial image features, to recommend functional selling points that better meet the user's personalized needs, so as to enhance the purchasing interest of each different user in the terminal device and thereby enhance the purchasing experience.

[0131] In addition, the present application embodiment also provides an electronic device (i.e., a terminal device). For the hardware structure and software framework of the electronic device, please refer to Figure 2 and Figure 3 The electronic device includes a memory and a processor, the memory stores a computer program, and the processor is used to call and execute the computer program to implement the function recommendation method of the terminal device provided in the above description.

[0132] The present application also provides a computer-readable storage medium in an embodiment, on which a computer program is stored. When the computer program is executed by a processor of a terminal device, it is used to implement the function recommendation method of the terminal device provided in the above description.

[0133] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for recommending functions of a terminal device, characterized in that: Applied to a terminal device, the method comprises: Acquire a target image containing user facial information; and extract the user's implicit features from the target image; Based on the implicit features of the user, generate a user portrait of the user; According to the pre-configured correspondence between different functions and different categories of user portraits, based on the category to which the user portrait belongs, a personalized function is matched for the user; A personalized function recommendation list for the user is generated according to the personalized functions matched for the user.

2. The method according to claim 1, characterized in that The step of extracting the implicit features of the user from the target image includes: Extracting a user's face image from the target image, and extracting image features of the user's face image; Based on the image features of the user's facial image, the implicit features of the user are extracted.

3. The method according to claim 1, characterized in that The implicit characteristics of the user include the implicit characteristics of the gender, age and number of the user.

4. The method according to claim 3, characterized in that: The generating a user profile of the user based on the implicit features of the user includes: According to the implicit characteristics of the user's gender, age, and number, a user portrait corresponding to the user is calculated.

5. The method according to claim 4, characterized in that The step of calculating the user portrait corresponding to the user according to the implicit features of the user's gender, age, and number includes: When the number of facial images of the user is identified to be one, the age and gender of the user are used as the age and gender categories of the user portrait corresponding to the final user; Alternatively, when the number of facial images of the user identified is greater than one, the ages of all identified users are comprehensively processed, and the processing result is used as the age category in the user portrait corresponding to the final user; and the genders of no less than half of all identified users are used as the gender category in the user portrait corresponding to the final user.

6. The method according to claim 1, characterized in that The user portrait of the user includes N categories; N is a positive integer greater than 0; the matching of personalized functions for the user based on the pre-configured correspondence between different functions and user portraits of different categories and the category to which the user portrait of the user belongs includes: According to the pre-configured correspondence between different functions and different categories of user portraits, the functions and recommendation weights corresponding to each of the N categories of user portraits of the user are determined.

7. The method according to claim 6, characterized in that The step of generating a personalized function recommendation list for the user according to the personalized functions matched for the user includes: Add the recommendation weights of the same function corresponding to each of the N category user portraits of the user, and use the obtained result as the new recommendation weight corresponding to the same function; The updated recommendation weights of the various functions corresponding to the N category user portraits of the user are arranged in descending order, and then merged to generate a personalized function recommendation list for the user.

8. The method according to any one of claims 1 to 7, characterized in that: After generating the personalized function recommendation list for the user according to the personalized functions matched for the user, the method further includes: The personalized function recommendation list of the user is displayed in descending order according to the function recommendation weights through the display page of the experience application.

9. An electronic device, characterized in that: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor is used to call and execute the computer program to implement the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by an electronic device, the method according to any one of claims 1 to 8 is implemented.

Images