Service recommendation method

Perceive user actions through the ring and use interaction trajectory and interface semantic information, and combine the server's historical data and large models to generate personalized service pages, solving the problem of poor personalized effect of traditional terminal device service recommendations and achieving more efficient personalized services recommend.

CN119024964APending Publication Date: 2024-11-26TSINGHUA UNIVERSITY
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411060235.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-02
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Traditional terminal equipment has poor personalized effect in service recommendations and cannot effectively meet users' personalized needs.

Method used

Perceive user actions through the ring, activate the terminal's mask function, use user interaction trajectory and interface semantic information to generate personalized service recommendations, and combine the server's historical data and large models to generate personalized service pages.

Benefits of technology

It improves the personalized effect of service recommendations, can more accurately meet users' specific needs and improve user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119024964A_ABST
    Figure CN119024964A_ABST
Patent Text Reader

Abstract

The invention provides a service recommendation method. The method comprises the following steps: the ring makes a first interaction operation in response to a user using the ring, generates a mask display instruction, and sends the mask display instruction to a terminal; wherein the terminal is provided with a touch screen; the terminal displays a mask layer above the interface of the touch screen based on the mask layer display instruction; the terminal determines a target interface area corresponding to a track of a second interaction operation from a current interface of the touch screen in response to the second interaction operation performed in the mask layer by the user by using the ring; the terminal generates a service recommendation request based on the interface semantic information in the target interface area and the track of the second interaction operation, and sends the service recommendation request to the server; the server responds to the service recommendation request, generates a service page according to the interface semantic information and the track of the second interaction operation, and returns the service page to the terminal; and the terminal displays the service page in the mask layer. By adopting the method, the personalized service recommendation effect can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of ring technology. Specifically, the present application relates to a service recommendation method. Background Art

[0002] At present, terminal devices can provide diversified service functions such as navigation, entertainment, and life, and have become an indispensable part of our daily life.

[0003] However, traditional terminal devices usually use predefined rules to recommend services to users, and this method has poor personalized service recommendation effect. Summary of the invention

[0004] Based on this, it is necessary to provide a service recommendation method for the above technical problems.

[0005] In a first aspect, the present application provides a service recommendation method. The method comprises:

[0006] The ring generates a mask display instruction in response to the user performing a first interactive operation using the ring, and sends the mask display instruction to the terminal; wherein the terminal is provided with a touch screen;

[0007] The terminal displays a mask on the top of the interface of the touch screen based on the mask display instruction;

[0008] In response to the user performing a second interactive operation in the mask using the ring, the terminal determines, from a current interface of the touch screen, a target interface area corresponding to a track of the second interactive operation;

[0009] The terminal generates a service recommendation request based on the interface semantic information in the target interface area and the track of the second interactive operation, and sends the service recommendation request to the server;

[0010] The server generates a service page in response to the service recommendation request according to the interface semantic information and the track of the second interactive operation, and returns the service page to the terminal;

[0011] The terminal displays the service page in the mask.

[0012] In one embodiment, the method further comprises:

[0013] The terminal detects that the user makes a preset action in the mask using the finger wearing the ring, and determines that the user makes a second interactive operation;

[0014] In response to the user performing a third interactive operation in the interface using a finger not wearing the ring, the terminal switches the interface displayed on the touch screen;

[0015] or,

[0016] The terminal detects that the user makes a preset action in the mask using a finger not wearing the ring, and determines that the user makes a second interactive operation;

[0017] In response to the user performing a third interactive operation in the interface using the finger wearing the ring, the terminal switches the interface displayed on the touch screen.

[0018] In one of the embodiments, determining a target interface area corresponding to the track of the second interactive operation from the current interface of the touch screen includes:

[0019] Based on the trajectory of the second interactive operation, construct a concave hull matching the trajectory;

[0020] In the current interface of the touch screen, the area where the concave bag is located is determined as the target interface area.

[0021] In one embodiment, the method further comprises:

[0022] The terminal identifies at least one element contained in the target interface area; wherein the element at least includes a control;

[0023] The terminal calculates, for each element, the distance between the center of the element and the edge of the concave hull;

[0024] The terminal obtains information corresponding to the controls and hierarchical relationships between the controls in a pre-stored control information tree;

[0025] The terminal determines the element, the distance between the center of the element and the edge of the concave hull, the information corresponding to the controls, and the hierarchical relationship between the controls as interface semantic information within the target interface area.

[0026] In one embodiment, the server generates a service page in response to the service recommendation request according to the interface semantic information and the track of the second interactive operation, including:

[0027] The server searches, in response to the service recommendation request, a pre-stored history database for history data that matches the interface semantic information and the track of the second interactive operation;

[0028] The server inputs the interface semantic information, the trajectory of the second interactive operation and the historical data into the trained large model to obtain the service page.

[0029] In one embodiment, the processing of the large model includes:

[0030] Generate a natural language description representing page layout according to the interface semantic information, the track of the second interactive operation and the historical data;

[0031] Writing corresponding code according to the interface semantic information, the track of the second interactive operation, the historical data and the natural language description;

[0032] Evaluate whether the service page generated by the code satisfies the natural language description; if not, generate modification suggestions, and regenerate a new natural language description representing the page layout based on the interface semantic information, the trajectory of the second interactive operation, the historical data and the modification suggestions, rewrite new code and re-evaluate the new service page until the new service page satisfies the new natural language description.

[0033] In one embodiment, the method further comprises:

[0034] In response to the user performing a fourth interactive operation using the ring, the ring obtains a page modification requirement of the user, and sends the page modification requirement to the terminal;

[0035] The terminal generates a page modification request based on the page modification requirement, and sends the page modification request to the server;

[0036] The server responds to the page modification request by inputting the page modification requirement into the large model, obtaining a modified service page, and returning the modified service page to the terminal;

[0037] The terminal displays the modified service page in the mask.

[0038] In one embodiment, the method further comprises:

[0039] The ring detects that the user touches a touch element of the ring, and determines that the user performs a first interactive operation;

[0040] and / or,

[0041] The ring detects that the user inputs voice through the microphone of the ring, and determines that the user performs a first interactive operation;

[0042] and / or,

[0043] The ring detects that the user makes a preset action in the air with the finger wearing the ring, and determines that the user makes a first interactive operation;

[0044] and / or,

[0045] The ring detects that the user touches the touch screen of the terminal and determines that the user performs a first interactive operation.

[0046] In a second aspect, the present application provides a service recommendation method. The method is applied to a ring, and the method includes:

[0047] In response to the user using the ring to perform a first interactive operation, a mask display instruction is generated, and the mask display instruction is sent to the terminal to instruct the terminal to display a mask above the interface of the touch screen of the terminal based on the mask display instruction, and to display the service page in the mask when the user uses the ring to perform a second interactive operation in the mask; wherein the service page is generated by the server based on interface semantic information and a trajectory of the second interactive operation, and the interface semantic information is interface semantic information in a target interface area corresponding to the trajectory of the second interactive operation determined from the current interface of the touch screen.

[0048] In a third aspect, the present application provides a service recommendation method. The method is applied to a terminal, and the terminal is provided with a touch screen; the method comprises:

[0049] In response to the mask display instruction sent by the ring, displaying a mask above the interface of the touch screen; wherein the mask display instruction is generated by the ring in response to the user performing a first interactive operation using the ring;

[0050] In response to the user performing a second interactive operation in the mask using the ring, determining a target interface area corresponding to a track of the second interactive operation from a current interface of the touch screen;

[0051] generating a service recommendation request based on the interface semantic information in the target interface area and the track of the second interactive operation, and sending the service recommendation request to a server to instruct the server to generate a service page according to the interface semantic information and the track of the second interactive operation, and return the service page to the terminal;

[0052] The service page is displayed in the mask.

[0053] The above service recommendation method activates the mask function in the terminal after the ring senses the user's specific action. When the user uses the ring to further operate in the mask to express his intention, the terminal will request the server to generate personalized service recommendations based on the user's interaction trajectory (specific behavior) and interface semantic information (context), which is conducive to improving the personalized service recommendation effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 A flowchart of a service recommendation method in one embodiment;

[0055] Figure 2 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] In one embodiment, Figure 1 As shown, a service recommendation method is provided, which includes the following steps S102-S112:

[0058] Step S102: The ring generates a mask display instruction in response to the user performing a first interactive operation using the ring, and sends the mask display instruction to the terminal.

[0059] Specifically, the ring is worn on the user's finger, such as the index finger or the middle finger, and integrates a variety of sensors such as a touch element, a microphone, and an inertial sensor to capture the user's actions. When the user performs a specific first interactive operation through the ring, the ring generates a mask display instruction and transmits it to a terminal connected to the ring. The terminal must be configured with a touch screen. The mask display instruction is used to activate the mask function of the terminal and present it on the touch screen. The mask is a semi-transparent mask covering the interface of the touch screen.

[0060] The detection and identification of the first interactive operation may be performed in a variety of ways, as follows:

[0061] Method 1: The ring detects that the user touches the touch element of the ring, and determines that the user performs the first interactive operation.

[0062] In the first interaction mode, the touch element can be a touch button or a touch sensitive area. When users interact with a touch button, they need to press it to activate the function; while in a touch sensitive area, just a light touch can immediately trigger the corresponding response.

[0063] Method 2: The ring detects that the user inputs voice through the microphone of the ring and determines that the user makes the first interactive operation.

[0064] In the second interaction method, the user can bring the ring close to his mouth and make a command voice, and the microphone in the ring can capture these sounds and perform relevant responses.

[0065] Method three: The ring detects that the user makes a preset action in the air with the finger wearing the ring, and determines that the user makes the first interactive operation.

[0066] In the third interaction mode, the ring uses the built-in inertial sensor to capture the user's movements, and uses the neural network model to accurately classify and identify these movement signals. When a specific preset movement (such as snapping fingers) is recognized, it is considered that the user has made the first interaction operation.

[0067] Method 4: The ring detects that the user touches the touch screen of the terminal and determines that the user makes the first interactive operation.

[0068] In the fourth interaction mode, the motion data collected by the inertial sensor in the ring and the inertial sensor in the terminal are integrated, and the neural network model is used to perform motion recognition on these motion data. The recognition results may include: whether the hand is wearing a ring when touching the screen, which finger touches the screen, and which part of the finger touches the screen.

[0069] Optionally, the ring establishes a connection with the terminal via Bluetooth, Wi-Fi or other wireless communication protocols. The terminal may be, but is not limited to, a smart phone, various personal computers, laptops, tablet computers, IoT devices and portable wearable devices. The IoT devices may be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. The portable wearable devices may be smart watches, smart bracelets, head-mounted devices, etc.

[0070] Step S104: the terminal displays a mask on the top of the interface of the touch screen based on the mask display instruction.

[0071] Specifically, when the terminal receives the mask display instruction, the mask function will be activated, and the mask will be displayed above the interface of the touch screen. At this time, the user can see the mask information and the interface information under the mask at the same time on the touch screen.

[0072] Step S106: In response to the user performing a second interactive operation in the mask using the ring, the terminal determines a target interface area corresponding to the track of the second interactive operation from the current interface of the touch screen.

[0073] Specifically, after activating the mask function, the user can directly operate on the mask to express specific intentions. When the user uses the ring to perform a second interactive operation on the mask displayed by the terminal, the terminal will identify the target interface area on the touch screen that the user intends to select or operate based on the trajectory of this interactive operation. According to the trajectory of the user's second interactive operation, the type of the second interactive operation can be identified, and each type corresponds to a specific functional response. For example, if the operation trajectory is a circle, the search function will be triggered.

[0074] In addition, the user can also operate the interface under the mask. As an example, the terminal detects that the user uses the finger wearing the ring to make a preset action in the mask, and determines that the user performs the second interactive operation. In response to the user using the finger without the ring to perform the third interactive operation in the interface, the terminal switches the interface displayed on the touch screen. It can be understood that the finger wearing the ring can perform operations specifically in the mask, while the finger without the ring can perform operations in the interface.

[0075] As another example, the terminal detects that the user uses a finger without a ring to make a preset action in the mask, and determines that the user makes a second interactive operation. In response to the user using a finger with a ring to make a third interactive operation in the interface, the terminal switches the interface displayed on the touch screen. It can be understood that the finger with the ring can perform operations in the mask, and the finger without the ring can perform operations in the interface. It can be understood that the finger without the ring can perform operations exclusively in the mask, while the finger with the ring can perform operations in the interface.

[0076] In step S106, a target interface area corresponding to the track of the second interactive operation is determined from the current interface of the touch screen. The specific implementation method may be: first, based on the track of the second interactive operation, a concave hull matching the track is constructed. Then, in the current interface of the touch screen, the area where the concave hull is located is determined as the target interface area.

[0077] Step S108: The terminal generates a service recommendation request based on the interface semantic information in the target interface area and the track of the second interactive operation, and sends the service recommendation request to the server.

[0078] Specifically, before step S108, the following steps S1072-S1078 are also included:

[0079] Step S1072: the terminal identifies at least one element contained in the target interface area.

[0080] In step S1072, the terminal scans the target interface area and identifies all interface elements in the area, which may include various controls (such as buttons, text boxes, etc.), text, pictures, etc.

[0081] In step S1074, the terminal calculates the distance between the center of each element and the edge of the concave hull.

[0082] In step S1074, the terminal calculates the distance from the center point of each identified element to the nearest edge of the concave hull.

[0083] Step S1076: The terminal obtains information corresponding to the controls and the hierarchical relationship between the controls in the pre-stored control information tree.

[0084] In step S1076, the control information tree is used to describe the control information and the hierarchical structure of the control in the interface. The terminal searches the internally stored control information tree for relevant information of each control, including the type, function, and hierarchical relationship of the control with other controls.

[0085] In step S1078, the terminal determines the element, the distance between the center of the element and the edge of the concave hull, the information corresponding to the control, and the hierarchical relationship between the controls as interface semantic information within the target interface area.

[0086] In step S1078, the terminal integrates the information obtained in the above steps: interface elements, distances between elements and edges, information and hierarchical relationships of controls, and constructs interface semantic information.

[0087] In step S108, the service recommendation request carries the interface semantic information in the target interface area and the track of the second interactive operation.

[0088] Step S110 , the server generates a service page in response to the service recommendation request according to the interface semantic information and the track of the second interactive operation, and returns the service page to the terminal.

[0089] Specifically, first, in response to the service recommendation request, the server searches for historical data that matches the interface semantic information and the trajectory of the second interactive operation from the pre-stored historical database. Then, the server inputs the interface semantic information, the trajectory of the second interactive operation, and the historical data into the trained large model to obtain a service page. The service page can be a web page or a mobile application page.

[0090] Optionally, the historical data maintained in the historical database can be divided into three categories. The first category is information that the user actively requests to be recorded, such as a chat record. The second category is relevant information retrieved from online web pages based on the information recorded by the user, such as automatically searching for information about nearby cinemas based on the movie viewing plan mentioned in the user's chat record. The third category includes historical interaction records of users, such as voice, text, ring gestures, and control operations. All data will be converted into vector form through language or visual models.

[0091] Furthermore, the large model generates service pages that meet specific requirements through multiple rounds of iterative optimization. Each round of iterative process includes three steps: page description, code generation, and page evaluation. Among them, the first step of page description will automatically generate a natural language description that represents the page layout based on the interface semantic information, the second interactive operation track, historical data, and the modification opinions of the previous round (if any). The second step of code generation will automatically write the corresponding code based on the interface semantic information of the first step, the second interactive operation track, historical data, and natural language description. These codes can be web pages composed of html / css / javascript, or other framework codes for implementing the interface. The third step of page evaluation will evaluate whether the service page generated by the code meets the natural language description of the first step. If the evaluation result is that the page fails to meet the requirements, modification opinions will be generated and a new round of iteration will be started. If the evaluation passes, the generated service page is the final version.

[0092] Step S112: the terminal displays the service page in the mask.

[0093] In the above service recommendation method, after the ring senses the user's specific action, the mask function in the terminal is activated. When the user uses the ring to further operate in the mask to express his intention, the terminal will request the server to generate personalized service recommendations based on the user's interaction trajectory (specific behavior) and interface semantic information (context), which is conducive to improving the personalized service recommendation effect.

[0094] In one embodiment, the method further comprises the following steps S122-S128:

[0095] Step S122, the ring obtains the user's page modification request in response to the user performing the fourth interactive operation using the ring, and sends the page modification request to the terminal;

[0096] Step S124, the terminal generates a page modification request based on the page modification requirement, and sends the page modification request to the server;

[0097] Step S126, the server responds to the page modification request, inputs the page modification requirement into the large model, obtains a modified service page, and returns the modified service page to the terminal;

[0098] Step S128: The terminal displays the modified service page in the mask.

[0099] Based on the same inventive concept, in one embodiment, a service recommendation method is also provided, which is applied to a ring and includes the following steps S202:

[0100] Step S202, in response to the user using the ring to make a first interactive operation, a mask display instruction is generated, and the mask display instruction is sent to the terminal to instruct the terminal to display a mask above the interface of the touch screen of the terminal based on the mask display instruction, and to display a service page in the mask when the user uses the ring to make a second interactive operation in the mask.

[0101] The service page is generated by the server according to the interface semantic information and the track of the second interactive operation. The interface semantic information is the interface semantic information in the target interface area corresponding to the track of the second interactive operation determined from the current interface of the touch screen.

[0102] Based on the same inventive concept, in one embodiment, a service recommendation method is also provided, which is applied to a terminal and includes the following steps S302-S308:

[0103] Step S302, in response to the mask display instruction sent by the ring, displaying a mask above the interface of the touch screen; wherein the mask display instruction is generated by the ring in response to the user performing a first interactive operation using the ring;

[0104] Step S304, in response to the user using the ring to perform a second interactive operation in the mask, determining a target interface area corresponding to the track of the second interactive operation from the current interface of the touch screen;

[0105] Step S306, generating a service recommendation request based on the interface semantic information and the track of the second interactive operation in the target interface area, and sending the service recommendation request to the server to instruct the server to generate a service page according to the interface semantic information and the track of the second interactive operation, and return the service page to the terminal;

[0106] Step S308, displaying the service page in the mask.

[0107] The above service recommendation method activates the mask function in the terminal after the ring senses the user's specific action. When the user uses the ring to further operate in the mask to express his intention, the terminal will request the server to generate personalized service recommendations based on the user's interaction trajectory (specific behavior) and interface semantic information (context), which is conducive to improving the personalized service recommendation effect.

[0108] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0109] Based on the same inventive concept, the embodiment of the present application also provides a service recommendation device for implementing the service recommendation method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more service recommendation device embodiments provided below can refer to the limitations on the service recommendation method above, and will not be repeated here.

[0110] It should be noted that the service recommendation device provided in the above embodiment only uses the division of the above functional modules as an example to implement the corresponding functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the service recommendation device provided in the above embodiment and the service recommendation method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0111] According to one aspect of the present application, an embodiment of the present invention further provides a computer program product, the computer program product comprising a computer program, the computer program comprising a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication part. When the computer program is executed by a processor, the service recommendation method provided by the embodiment of the present application is executed.

[0112] In addition, an embodiment of the present invention also provides a computer device, which includes a processor and a memory, the memory stores a computer program, and the processor can execute the computer program stored in the memory. When the computer program is executed by the processor, the service recommendation method provided by any of the above embodiments can be implemented.

[0113] For example, Figure 2A computer device provided by an embodiment of the present invention is shown. The device includes a bus 1110 , a processor 1120 , a transceiver 1130 , a bus interface 1140 , a memory 1150 , and a user interface 1160 .

[0114] In the embodiment of the present invention, the device further includes: a computer program stored in the memory 1150 and executable on the processor 1120, and when the computer program is executed by the processor 1120, each process of the above-mentioned service recommendation method embodiment is implemented.

[0115] The transceiver 1130 is configured to receive and send data under the control of the processor 1120 .

[0116] In an embodiment of the present invention, the bus architecture (represented by bus 1110), bus 1110 may include any number of interconnected buses and bridges, and bus 1110 connects various circuits including one or more processors represented by processor 1120 and a memory represented by memory 1150.

[0117] Bus 1110 represents one or more of any of several types of bus structures, including a memory bus and memory controller, a peripheral bus, an Accelerate Graphical Port (AGP), a processor, or a local bus using any of a variety of bus architectures. By way of example and not limitation, such architectures include: Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA), Peripheral Component Interconnect (PCI) bus.

[0118] The processor 1120 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above method embodiment may be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processors include: a general processor, a central processing unit (CPU), a network processor (NP), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), a complex programmable logic device (CPLD), a programmable logic array (PLA), a microcontroller unit (MCU) or other programmable logic devices, discrete gates, transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention may be implemented or executed. For example, the processor may be a single-core processor or a multi-core processor, and the processor may be integrated into a single chip or located in multiple different chips.

[0119] Processor 1120 can be a microprocessor or any conventional processor. The method steps disclosed in conjunction with the embodiments of the present invention can be directly executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module can be located in a readable storage medium known in the art, such as a random access memory (RAM), a flash memory (FlashMemory), a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a register, etc. The readable storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware.

[0120] The bus 1110 may also connect various other circuits such as peripheral devices, voltage regulators or power management circuits, and the bus interface 1140 provides an interface between the bus 1110 and the transceiver 1130, which are well known in the art. Therefore, the embodiments of the present invention will not be further described.

[0121] The transceiver 1130 may be one element or multiple elements, such as multiple receivers and transmitters, and provides a unit for communicating with various other devices on a transmission medium. For example, the transceiver 1130 receives external data from other devices, and the transceiver 1130 is used to send data processed by the processor 1120 to other devices. Depending on the nature of the computer system, a user interface 1160 may also be provided, such as a touch screen, a physical keyboard, a display, a mouse, a speaker, a microphone, a trackball, a joystick, and a stylus.

[0122] It should be understood that in an embodiment of the present invention, the memory 1150 may further include a memory remotely arranged relative to the processor 1120, and these remotely arranged memories may be connected to the server through a network. One or more parts of the above-mentioned network may be an ad hoc network, an intranet, an extranet, a virtual private network (VPN), a local area network (LAN), a wireless local area network (WLAN), a wide area network (WAN), a wireless wide area network (WWAN), a metropolitan area network (MAN), the Internet, a public switched telephone network (PSTN), a plain old telephone service network (POTS), a cellular telephone network, a wireless network, a wireless fidelity (Wi-Fi) network, and a combination of two or more of the above-mentioned networks. For example, the cellular telephone network and the wireless network may be a Global System for Mobile Communications (GSM) system, a Code Division Multiple Access (CDMA) system, a Worldwide Interoperability for Microwave Access (WiMAX) system, a General Packet Radio Service (GPRS) system, a Wideband Code Division Multiple Access (WCDMA) system, a Long Term Evolution (LTE) system, a LTE Frequency Division Duplex (FDD) system, a LTE Time Division Duplex (TDD) system, an Advanced Long Term Evolution (LTE-A) system, a Universal Mobile Telecommunications (UMTS) system, an Enhanced Mobile Broadband (EMB) system, and a LTE-T system.

[0123] (Enhance Mobile Broadband, eMBB) system, massive Machine Type of Communication (mMTC) system, ultra-reliable low latency communications (Ultra Reliable Low Latency Communications, uRLLC) system, etc.

[0124] It should be understood that the memory 1150 in the embodiment of the present invention may be a volatile memory or a non-volatile memory, or may include both a volatile memory and a non-volatile memory. Among them, the non-volatile memory includes: a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.

[0125] Volatile memory includes: Random Access Memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as: Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Synchronous Link Dynamic Random Access Memory (SLDRAM) and Direct Rambus RAM (DRRAM). The memory 1150 described in the embodiments of the present invention includes but is not limited to the above and any other suitable types of memory.

[0126] In the embodiment of the present invention, the memory 1150 stores the following elements of the operating system 1151 and the application program 1152: executable modules, data structures, or subsets thereof, or extended sets thereof.

[0127] Specifically, the operating system 1151 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 1152 includes various applications, such as a media player (Media Player) and a browser (Browser), which are used to implement various application services. The program for implementing the method of the embodiment of the present invention may be included in the application 1152. The application 1152 includes applets, objects, components, logic, data structures, and other computer system executable instructions that perform specific tasks or implement specific abstract data types.

[0128] In addition, an embodiment of the present invention also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned service recommendation method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0129] Computer readable storage media include: permanent and non-permanent, removable and non-removable media, which are tangible devices that can retain and store instructions for use by instruction execution devices. Computer readable storage media include: electronic storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, and any suitable combination of the above. Computer readable storage media include: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassette storage, magnetic tape disk storage or other magnetic storage devices, memory sticks, mechanical encoding devices (such as punched cards or raised structures in grooves with instructions recorded thereon) or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined in the embodiments of the present invention, computer-readable storage media do not include temporary signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (such as light pulses passing through fiber optic cables), or electrical signals transmitted through wires.

[0130] In the description of the embodiments of the present invention, those skilled in the art should know that the embodiments of the present invention can be implemented as methods, devices, equipment and storage media. Therefore, the embodiments of the present invention can be specifically implemented in the following forms: complete hardware, complete software (including firmware, resident software, microcode, etc.), a combination of hardware and software. In addition, in some embodiments, the embodiments of the present invention can also be implemented in the form of a computer program product in one or more computer-readable storage media, and the computer-readable storage medium contains computer program code.

[0131] The above-mentioned computer-readable storage medium may adopt any combination of one or more computer-readable storage media. Computer-readable storage media include: electrical, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or devices, or any combination of the above. More specific examples of computer-readable storage media include: portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM), flash memories, optical fibers, compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices or any combination of the above. In an embodiment of the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device, or device.

[0132] The computer program code contained in the above-mentioned computer-readable storage medium can be transmitted using any appropriate medium, including: wireless, wire, optical cable, radio frequency (RF) or any suitable combination thereof.

[0133] The computer program code for performing the operation of the embodiments of the present invention can be written in assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, integrated circuit configuration data, or in one or more programming languages ​​or a combination thereof, wherein the programming language includes an object-oriented programming language, such as Java, Smalltalk, C++, and also includes a conventional procedural programming language, such as C language or a similar programming language. The computer program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer, partially on a remote computer, and completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer or to an external computer through any type of network, including a local area network (LAN) or a wide area network (WAN).

[0134] It should be understood that each box in the flowchart and / or block diagram and the combination of boxes in the flowchart and / or block diagram can be implemented by computer-readable program instructions. These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine, and these computer-readable program instructions are executed by a computer or other programmable data processing device to produce a device that implements the functions / operations specified by the boxes in the flowchart and / or block diagram.

[0135] These computer-readable program instructions may also be stored in a computer-readable storage medium that enables a computer or other programmable data processing device to work in a specific manner. In this way, the instructions stored in the computer-readable storage medium produce an instruction device product including functions / operations specified in the blocks in the flowchart and / or block diagram.

[0136] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device, so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby enabling the instructions executed on the computer or other programmable data processing apparatus to provide a process for implementing the functions / operations specified in the blocks in the flowchart and / or block diagram.

[0137] The above is only a specific implementation of the embodiment of the present invention, but the protection area of ​​the embodiment of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or replacements within the technical area disclosed in the embodiment of the present invention, which should be included in the protection area of ​​the embodiment of the present invention. Therefore, the protection area of ​​the embodiment of the present invention should be based on the protection area of ​​the claims.

Claims

1. A service recommendation method, characterized in that: The method comprises: The ring generates a mask display instruction in response to the user performing a first interactive operation using the ring, and sends the mask display instruction to the terminal; wherein the terminal is provided with a touch screen; The terminal displays a mask on the top of the interface of the touch screen based on the mask display instruction; In response to the user performing a second interactive operation in the mask using the ring, the terminal determines, from a current interface of the touch screen, a target interface area corresponding to a track of the second interactive operation; The terminal generates a service recommendation request based on the interface semantic information in the target interface area and the track of the second interactive operation, and sends the service recommendation request to the server; The server generates a service page in response to the service recommendation request according to the interface semantic information and the track of the second interactive operation, and returns the service page to the terminal; The terminal displays the service page in the mask.

2. The method according to claim 1, characterized in that The method further comprises: The terminal detects that the user makes a preset action in the mask using the finger wearing the ring, and determines that the user makes a second interactive operation; In response to the user performing a third interactive operation in the interface using a finger not wearing the ring, the terminal switches the interface displayed on the touch screen; or, The terminal detects that the user makes a preset action in the mask using a finger not wearing the ring, and determines that the user makes a second interactive operation; In response to the user performing a third interactive operation in the interface using the finger wearing the ring, the terminal switches the interface displayed on the touch screen.

3. The method according to claim 1, characterized in that Determining a target interface area corresponding to the track of the second interactive operation from the current interface of the touch screen includes: Based on the trajectory of the second interactive operation, construct a concave hull matching the trajectory; In the current interface of the touch screen, the area where the concave bag is located is determined as the target interface area.

4. The method according to claim 3, characterized in that The method further comprises: The terminal identifies at least one element contained in the target interface area; wherein the element at least includes a control; The terminal calculates, for each element, the distance between the center of the element and the edge of the concave hull; The terminal obtains information corresponding to the controls and hierarchical relationships between the controls in a pre-stored control information tree; The terminal determines the element, the distance between the center of the element and the edge of the concave hull, the information corresponding to the controls, and the hierarchical relationship between the controls as interface semantic information within the target interface area.

5. The method according to claim 1, characterized in that The server generates a service page in response to the service recommendation request according to the interface semantic information and the track of the second interactive operation, including: The server searches, in response to the service recommendation request, a pre-stored history database for history data that matches the interface semantic information and the track of the second interactive operation; The server inputs the interface semantic information, the trajectory of the second interactive operation and the historical data into the trained large model to obtain the service page.

6. The method according to claim 5, characterized in that The processing process of the large model includes: Generate a natural language description representing page layout according to the interface semantic information, the track of the second interactive operation and the historical data; Writing corresponding code according to the interface semantic information, the track of the second interactive operation, the historical data and the natural language description; Evaluate whether the service page generated by the code satisfies the natural language description; if not, generate modification suggestions, and regenerate a new natural language description representing the page layout based on the interface semantic information, the trajectory of the second interactive operation, the historical data and the modification suggestions, rewrite new code and re-evaluate the new service page until the new service page satisfies the new natural language description.

7. The method according to claim 6, characterized in that The method further comprises: In response to the user performing a fourth interactive operation using the ring, the ring obtains a page modification requirement of the user, and sends the page modification requirement to the terminal; The terminal generates a page modification request based on the page modification requirement, and sends the page modification request to the server; The server responds to the page modification request by inputting the page modification requirement into the large model, obtaining a modified service page, and returning the modified service page to the terminal; The terminal displays the modified service page in the mask.

8. The method according to claim 1, characterized in that The method further comprises: The ring detects that the user touches a touch element of the ring, and determines that the user performs a first interactive operation; and / or, The ring detects that the user inputs voice through the microphone of the ring, and determines that the user performs a first interactive operation; and / or, The ring detects that the user makes a preset action in the air with the finger wearing the ring, and determines that the user makes a first interactive operation; and / or, The ring detects that the user touches the touch screen of the terminal and determines that the user performs a first interactive operation.

9. A service recommendation method, characterized in that: The method is applied to a ring, and the method comprises: In response to the user using the ring to perform a first interactive operation, a mask display instruction is generated, and the mask display instruction is sent to the terminal to instruct the terminal to display a mask above the interface of the touch screen of the terminal based on the mask display instruction, and to display the service page in the mask when the user uses the ring to perform a second interactive operation in the mask; wherein the service page is generated by the server based on interface semantic information and a trajectory of the second interactive operation, and the interface semantic information is interface semantic information in a target interface area corresponding to the trajectory of the second interactive operation determined from the current interface of the touch screen.

10. A service recommendation method, characterized in that: The method is applied to a terminal, and the terminal is provided with a touch screen; the method comprises: In response to the mask display instruction sent by the ring, displaying a mask above the interface of the touch screen; wherein the mask display instruction is generated by the ring in response to the user performing a first interactive operation using the ring; In response to the user performing a second interactive operation in the mask using the ring, determining a target interface area corresponding to a track of the second interactive operation from a current interface of the touch screen; generating a service recommendation request based on the interface semantic information in the target interface area and the track of the second interactive operation, and sending the service recommendation request to a server to instruct the server to generate a service page according to the interface semantic information and the track of the second interactive operation, and return the service page to the terminal; The service page is displayed in the mask.