Information processing method and device and electronic equipment

Abstract

The invention discloses an information processing method and device and electronic equipment, and relates to the technical field of internet application, and the disclosed information processing method comprises the following steps: determining a first object; the first object is at least one display object in a target page; obtaining target input information, and determining a second object based on the target input information; the second object is at least one display object in a target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects; obtaining state information of the first object at least based on the second object; and in response to the condition that the state information represents that the first object meets a prompt condition, performing prompt output based on the first object.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and particularly relates to an information processing method and device and electronic equipment. BACKGROUND

[0002] In daily page operations such as webpage operations, a user often needs to wait for feedback of a web system or operation results of others, for example, waits for approval or processing results, so that a related prompt needs to be given to a display object of a page. A current prompt method is implemented based on pre-encoded codes, and it is difficult to meet different prompt demands of a user for a display object of a page. SUMMARY

[0003] Therefore, the present application discloses the following technical solutions.

[0004] An information processing method comprises the following steps.

[0005] A first object is determined; the first object is at least one display object in a target page;

[0006] Target input information is obtained, and a second object is determined based on the target input information; the second object is at least one display object in the target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects;

[0007] State information of the first object is obtained based on at least the second object;

[0008] In response to the state information representing that the first object meets a prompt condition, a prompt output is performed based on the first object.

[0009] Optionally, the first object is determined by at least one of the following methods.

[0010] A selection operation on a display object in the target page is detected, and at least one display object indicated by the selection operation on the target page is determined as the first object;

[0011] An interactive hot area on the target page is determined by an artificial intelligence model, and a display object corresponding to the interactive hot area is determined as a to-be-monitored object;

[0012] A time intersection between a historical access time of a display object in different areas of the target page and a display object state change time is determined by an artificial intelligence model, and a corresponding display object with the time intersection is determined as a to-be-monitored object.

[0013] Optionally, the target input information is obtained, and the second object is determined based on the target input information, comprising the following steps.

[0014] obtaining state prompt demand information of the first object input by a target input box corresponding to the first object; the target input box is displayed in response to determining the first object, or displayed in response to triggering an option for state prompt setting corresponding to the first object;

[0015] determining at least one other display object in the target page and / or at least one non-display object corresponding to the target page, based on which state prompt of the first object is needed, by analyzing the state prompt demand information by using an artificial intelligence model, to obtain the second object;

[0016] wherein the other display object is a corresponding display object on the target page other than the first object, and the target input information includes the state prompt demand information.

[0017] Optionally, determining at least one other display object in the target page and / or at least one non-display object corresponding to the target page, based on which state prompt of the first object is needed, by analyzing the state prompt demand information by using an artificial intelligence model, to obtain the second object, includes:

[0018] determining a target intent represented by the state prompt demand information by using an artificial intelligence model;

[0019] determining a state prompt rule of the first object corresponding to the target intent;

[0020] parsing a document object model of the target page to obtain a corresponding parsing result;

[0021] determining an associated task associated with a state prompt task of the first object represented by the state prompt rule based on the parsing result;

[0022] determining the associated task in at least one other display object and / or non-display object corresponding to the target page to obtain the second object.

[0023] Optionally, obtaining state information of the first object based on at least the second object includes at least one of:

[0024] monitoring corresponding visual information of the first object and the at least one other display object on the target page based on the state prompt rule, and obtaining state information of the first object based on obtained visual monitoring information;

[0025] monitoring target elements corresponding to the first object and the at least one non-display object in a document object model of the target page based on the state prompt rule, and obtaining state information of the first object based on obtained element monitoring information.

[0026] Optionally, in response to the state information representing that the first object meets the prompt condition, a prompt output is performed based on the first object, including:

[0027] In response to the state information representing that the state of the first object meets the prompt condition represented by the state prompt rule, at least one of a prompt window, a communication message, a prompt sound, and a vibration prompt for state prompting of the first object is output.

[0028] Optionally, the information processing method further includes:

[0029] In response to monitoring a triggering operation on the prompt window, the target page is switched to, and the first object is displayed in the target page with a marked marked effect.

[0030] Optionally, the information processing method further includes:

[0031] Based on a page refresh strategy, page data of the target page is refreshed.

[0032] An information processing apparatus includes:

[0033] A first determination module is configured to determine a first object; the first object is at least one display object in a target page;

[0034] A second determination module is configured to obtain target input information and determine a second object based on the target input information; the second object is at least one display object in a target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects;

[0035] An acquisition module is configured to obtain state information of the first object based on at least the second object;

[0036] A prompt output module is configured to, in response to the state information representing that the first object meets a prompt condition, perform a prompt output based on the first object.

[0037] An electronic device includes:

[0038] A memory is configured to store at least a set of computer instructions;

[0039] A processor is configured to implement the following processing by executing the set of instructions stored in the memory:

[0040] A first object is determined; the first object is at least one display object in a target page;

[0041] obtaining target input information, determining a second object based on the target input information; the second object is at least one display object in a target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects;

[0042] obtaining state information of the first object based on at least the second object;

[0043] performing prompt output based on the first object in response to the state information representing that the first object meets a prompt condition.

[0044] A storage medium carrying one or more computer instruction sets, when executed by an electronic device, can enable the electronic device to implement any one of the information processing methods provided above. BRIEF DESCRIPTION OF DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the drawings needed to be used in the embodiments or related art description will be briefly introduced. Obviously, the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative labor based on the provided drawings.

[0046] Figure 1 is a flowchart of an information processing method provided by the present application;

[0047] Figure 2 is a task list diagram on a target page provided by the present application;

[0048] Figure 3 is an example of determining a first object based on interactive hotspot analysis provided by the present application;

[0049] Figure 4 is an example of time intersection between user historical access time and display object state change time provided by the present application;

[0050] Figure 5 is an example of inputting state prompt demand information through a target input box provided by the present application;

[0051] Figure 6 is an example of other display objects associated with the first object being far away on the page provided by the present application;

[0052] Figure 7 is a flowchart of determining a second object based on state prompt demand information provided by the present application;

[0053] Figure 8This is an example of providing a status prompt for the first object based on a prompt window, as provided in this application;

[0054] Figure 9 This is an example of switching pages based on triggering a prompt window, as provided in this application;

[0055] Figure 10 This is a structural diagram of the information processing device provided in this application;

[0056] Figure 11 This is a structural diagram of the electronic device provided in this application. Detailed Implementation

[0057] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0058] This application provides an information processing method, apparatus, and electronic device to meet users' diverse prompting needs for objects displayed on web pages and other web pages.

[0059] The information processing method provided in this application can be applied to electronic devices in a variety of general or special computing device environments or configurations, such as personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor devices, etc.

[0060] See Figure 1 The flowchart shown illustrates the information processing method provided in this application embodiment, which may include the following steps 101 to 104, which are described in detail below.

[0061] Step 101: Determine the first object; the first object is at least one display object in the target page.

[0062] The target page is a page within the target application. The application page may display various display objects, including but not limited to controls (such as buttons), text, tables, progress bars, and page tasks (such as product approval tasks).

[0063] The first object is the object on the target page that requires status monitoring and prompts. The first object can be determined on the target page based on one or more user interactions such as mouse behavior, keyboard interaction, touch interaction, and voice interaction. Alternatively, the backend can automatically identify at least one display object on the target page that the user requires status prompts based on intelligent analysis, and use it as the first object.

[0064] Step 102, obtaining target input information, determining a second object based on the target input information; the second object is at least one display object in the target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects.

[0065] The target input information includes state prompt demand information input by the user for the first object, and is used to represent the state prompt demand for the first object.

[0066] The state prompt demand for the first object can include but is not limited to the reminding demand when various state changes such as text change, control state change, style change, etc. reach a certain condition (such as the approval control changes from "under review" to "pass" or "not pass", etc.), depending on the type of the first object and the actual prompt demand of the user.

[0067] The same first object can correspond to different state prompt demands based on different target input information, which is dynamically determined by the target input information input by the user.

[0068] After obtaining the target input information, the second object can be determined by analyzing the target input information.

[0069] The second object is an associated object of the first object, which can be at least one other display object on the target page and / or at least one non-display object corresponding to the target page, which is needed to realize the state prompt of the first object. That is, the state prompt of the first object needs to rely on the associated analysis of the second object, and the state prompt of the first object is realized through the state monitoring and associated analysis of the second object.

[0070] The above-mentioned other display object is a corresponding display object on the target page except the first object, and the above-mentioned at least one non-display object can include but is not limited to a corresponding background task associated with the first object.

[0071] Taking the first object as a page task (such as an approval task corresponding to a product approval process on the target page) as an example, referring to Figure 2 , a task list diagram on the target page is provided. One task can contain multiple sub-tasks. Assuming that the first object is a certain task on the page, such as task 1, task 2 or task 3, etc., the second object can be a sub-task contained in the task, such as sub-task 1-sub-task 4 contained in task 1, and / or a related background task associated with the task.

[0072] Step 103, obtaining the state information of the first object based on at least the second object.

[0073] After the second object is determined, the second object can be monitored for state monitoring, such as monitoring the state change of the second object, and based on the state monitoring information of the second object, the state of the first object is associated analyzed to determine the state information of the first object.

[0074] Step 104, in response to the state information of the first object representing that the first object meets the prompt condition, the first object is prompted based on the first object.

[0075] The prompt condition is used to represent the condition that needs to be met for the state prompt of the first object, such as requiring the color, style, and other visibility information of the first object to change in a specific manner, or the task state of the page task to change to a specific state (such as from "in review" to "pass").

[0076] The prompt condition is related to the state prompt requirement of the user for the first object, which can be determined by analyzing the target input information obtained in step 102 representing the state prompt requirement.

[0077] The target input information corresponding to the same display object is different, and the corresponding prompt condition is different, which can be dynamically determined based on user input.

[0078] After obtaining the state information of the first object, the state information of the first object can be compared with the specific state in the prompt condition for state prompt requirement to determine whether the state information of the first object represents that the first object meets the prompt condition, and in response to the state information of the first object representing that the first object meets the prompt condition, the first object is prompted based on the first object, such as when the state of the product review task in the target page changes to the specific state indicated in the prompt condition, the state of the task is prompted,

[0079] In summary, the information processing method provided in the embodiment can effectively identify the second object associated with the first object by obtaining the target input information of the first object after determining the first object to be monitored, and can obtain the state information of the first object by associated analysis of the second object, so as to perform state prompt processing on the first object on this basis. Different target input information corresponds to different second objects, and different prompts for the same first object can be realized through different target input information and different second objects corresponding thereto, so that the application can meet the personalized prompt requirement of the first object represented by the target input information, and overcome the limitations of the known technology based on pre-encoded codes for state prompt, and can effectively meet the diversified prompt requirement of the user for the display object (such as the same display object) in the page.

[0080] In an optional embodiment, step 101, i.e., determining the first object, can be implemented as at least one of the following embodiments 11) - 13):

[0081] 11) detecting a selection operation on a display object on a target page, determining at least one display object indicated by the selection operation on the target page as a first object.

[0082] The user can perform the selection operation on the display object on the target page through one or more of mouse behavior, keyboard interaction, touch interaction, voice interaction, etc.

[0083] The background detects the selection operation of the user, and can determine at least one display object indicated by the selection operation on the target page by analyzing the corresponding operation information (such as analyzing the cursor position of the mouse, the operation type, or analyzing the semantics of the user voice instruction, etc.), and determine the at least one display object as the first object to be monitored.

[0084] 12) determining an interaction hotspot area on the target page through an artificial intelligence model, and determining the display object corresponding to the interaction hotspot area as the object to be monitored.

[0085] The artificial intelligence model involved in the embodiments of the present application can be a general large model, or can be a specialized large model obtained by fine-tuning based on requirements, which is not limited. The model learns the characteristics and laws of input information by training a large amount of diversified data. It usually has hundreds of millions to tens of billions of model parameters (model parameters are variables that control the behavior of the target model), which can capture complex relationships and patterns in input information.

[0086] Optionally, the user's interaction behavior information on the target page can be detected and collected, and the interaction hotspot area of the user on the target page is determined by using the artificial intelligence model such as the large model based on the collected interaction behavior information, and the display object corresponding to the interaction hotspot area is determined as the first object to be monitored.

[0087] The interaction behavior information can include but is not limited to the user's interaction position on the target page, the operation type, the operation number / frequency, the operation time / dwelling time, etc.

[0088] In the implementation, the artificial intelligence model such as the large model can be used to assign different weights to different interaction behavior information, and the interaction scores of the user and different regions of the target page are calculated based on the interaction information collected by each region and the weights corresponding to each interaction information, so as to form a corresponding interaction hotspot map, and the interaction hotspot area is determined based on the interaction hotspot map to capture the area that the user pays attention to / interests in.

[0089] For example, the mouse / keyboard interaction mode is taken as an example. The mouse movement, hovering, clicking and scrolling behaviors can reflect the user's focus area. If the user has not moved for a long time after scrolling to a certain area, it may indicate that the user is interested in the content of this part. In addition, some keyboard interaction behaviors can also indicate the user's intention. Based on this, the user's mouse behavior, keyboard interaction and other information on the target page can be detected and collected to analyze the browsing focus and infer the content of interest to the user. By assigning appropriate weights to different interaction behavior information, the interaction score of each region on the target page is calculated, and an interaction hotspot map is generated to capture the user's truly concerned interaction area (interaction hotspot area). The corresponding display object of this area is determined as the first object.

[0090] The display object corresponding to the interaction hotspot area (i.e., the display object used to determine the first object) can be a display object within the interaction hotspot area, or it can be a display object associated with the corresponding display object within the interaction hotspot area outside the interaction hotspot area, depending on the actual application.

[0091] Referring to Figure 3 , an example of determining the first object to be monitored based on interaction hotspot analysis is shown. In this example, task 1 and each subtask contained therein are displayed on the target page, and a related information bar for task 1 is also displayed, such as operation progress reminder, task result reminder, etc. The cross mark represents the position of the user's click or other operation. According to the detection and analysis of user operation behavior, the user's interaction hotspot area is identified as the area where the operation progress reminder information bar is located. Then the display object associated with the display object in this area, such as the operation progress reminder information bar, can be determined as the first object to be monitored.

[0092] 13) Determine the time intersection between the historical access time of the display object in different regions of the target page and the display object state change time by using an artificial intelligence model, and determine the display object with time intersection as the object to be monitored.

[0093] In this embodiment, the state change time of each display object on the target page can be detected and recorded, and the access time of the user to different regions of the target page can be detected and recorded.

[0094] On this basis, the state change time of each display object on the target page and the access time of the user to different regions of the target page are compared by using a large model or other artificial intelligence model to infer the display object of interest to the user. Specifically, the time intersection between the historical access time of the display object in different regions of the target page and the display object state change time can be determined, and the display object with time intersection can be determined as the first object to be monitored.

[0095] In implementation, the time intersection between the time window corresponding to the user historical access time and the time window corresponding to the display object state change time can be determined, and the first object to be monitored can be determined based on the intersection. See Figure 4 FIG. 9 shows an example of the time intersection between the user historical access time and the display object state change time, Figure 4 In FIG. 9, the user interaction time represents the time window of the user historical access time, the webpage task state change time represents the time window of the display object state change time, and the axis with arrows represents the time axis.

[0096] The time window corresponding to the user historical access time / display object state change time can be determined by detecting the duration of the historical access behavior or the display object state change, or a certain length of time window, such as 3 minutes, 5 minutes, etc., can be preset, and the time window in which the user historical access time / display object state change time is located is taken as the user historical access time / display object state change time.

[0097] Optionally, for the user historical access time and the display object state change time with the time intersection, the accessed area of the user historical access time and the display object change area corresponding to the display object state change time can be further matched, and when there is an intersection between the two, the display object in the intersection area can be determined as the first object to be monitored.

[0098] Based on the embodiment, the user can specify the required first object to be monitored in the target page through autonomous operation, or the display object focused by the user can be automatically determined as the first object to be monitored by the background based on intelligent analysis, so that the user's demand for state monitoring and information prompting of the display object can be better met.

[0099] In an optional embodiment, step 102, i.e., obtaining the target input information, and determining the second object based on the target input information, can be further implemented as steps 21)-22) as follows:

[0100] 21) obtaining the state prompting demand information of the first object input through the target input box corresponding to the first object.

[0101] The target input information includes the state prompting demand information.

[0102] The target input box can be displayed in response to the determination of the first object, for example, after a certain control or a certain page task is selected and determined as the first object to be monitored, the corresponding input box is directly displayed for inputting the required state prompting demand information.

[0103] But not limited to this, in other embodiments, the target input box can also be displayed in response to triggering the option for state prompt setting corresponding to the first object. For example, after selecting the first object, right-click the mouse, display the operation menu of the first object by clicking the right button, and then display the target input box by triggering the option for state prompt setting in the menu.

[0104] In addition, the target control for calling out the target input box can also be displayed in a predetermined area of the target page, for example, a button for calling out the target input box is displayed at a corresponding position of the task page of the product approval task, and the user can call out the target input box by triggering the button.

[0105] After determining the first object, the user can input the state prompt requirement information of the first object into the target input box, such as "prompt when the progress of page task A > 80% and the button is visible", or "tell me the result when task A is executed", etc., see Figure 5 for examples of inputting state prompt requirement information through the target input box.

[0106] 22) By analyzing the state prompt requirement information by using an artificial intelligence model, at least one other display object in the target page and / or at least one non-display object corresponding to the target page that the state prompt of the first object needs to be based on is determined, to obtain the second object.

[0107] After obtaining the state prompt requirement information input by the user, the obtained state prompt requirement information can be analyzed by using an artificial intelligence model such as a large model, such as semantic analysis, intent recognition, and associated display object / background task analysis, to determine at least one other display object in the target page and / or at least one non-display object corresponding to the target page that the state prompt of the first object needs to be based on, and the determined at least one other display object and / or at least one non-display object is taken as the second object.

[0108] The above-mentioned other display object is a corresponding display object on the target page other than the first object and associated with the first object, which can be other display objects in the vicinity of the first object on the target page, or can be relatively far away from the first object, which is not limited, and is determined according to the actual application.

[0109] See Figure 6 for an example of the first object associated with other display objects being at a relatively far distance (relative to the position of the first object) on the page, in which example, the first object is task 1 on the page, and the first object associated with other display objects is task 2 on the page, for example, the two tasks are different tasks associated in the product approval process.

[0110] The embodiment can determine the second object by obtaining the input state prompt demand information and analyzing the state prompt demand information, can facilitate obtaining the state corresponding to the state prompt demand dimension of the first object through the correlation analysis of the second object, thereby providing a basis for the personalized state prompt of the first object, and can meet the personalized state prompt demand of the user for the first object.

[0111] In an optional embodiment, referring to Figure 7 , the process of determining the second object based on the state prompt demand information in step 22) can be further implemented as steps 701-705.

[0112] Step 701, determining a target intent represented by the state prompt demand information by using an artificial intelligence model.

[0113] Specifically, the state prompt demand information can be input into a large model or other artificial intelligence model, and the target intent represented by the state prompt demand information is identified by using the model to perform semantic analysis on the input state prompt demand information. For example, the state prompt demand information "prompt when the progress of page task A > 80% and the button is visible" represents a state prompt intent for page task A, and the state required when the state of page task A is prompted.

[0114] Step 702, determining a state prompt rule for the first object corresponding to the target intent.

[0115] Optionally, the state prompt rule can include a prompt condition required to be met for prompting the first object.

[0116] After identifying the target intent represented by the state prompt demand information, the target intent can be further converted into a corresponding prompt condition to obtain the state prompt rule for the first object.

[0117] The converted prompt condition can include one or more machine-recognizable condition expressions, such as progress > 80%, button state being a preset state representing visibility, etc.

[0118] Step 703, parsing a document object model of a target page to obtain a corresponding parsing result.

[0119] Specifically, DOM (Document Object Model) data of the target page can be obtained, and DOM elements and structure parsing can be performed to obtain each DOM element and the hierarchical relationship between each DOM element.

[0120] In implementation, the address information of the target page and the path information corresponding to the selected first object on the target page can be specifically saved, for example, the URL (Uniform Resource Locator) address of the target page and the XPath of the selected first object are saved, and based on the saved information, the part associated with the first object in the DOM is analyzed, for example, the relevant sub-tree matching the first object in the DOM tree structure is analyzed.

[0121] Step 704, based on the analysis result, determining an associated task associated with the state prompt task of the first object represented by the state prompt rule.

[0122] After analyzing the document object model of the target page, the obtained analysis result of each DOM element and the hierarchical relationship therebetween can be further used to determine the associated task associated with the state prompt task of the first object, in combination with the historical interaction information (such as a mouse click event) of the user with the target page.

[0123] The determined associated task can include but is not limited to a sub-task contained in the first object or another task on which the state change of the first object depends.

[0124] Taking the first object as task 1 described above, the associated task associated with the state prompt task of the first object (task 1) can include each sub-task contained in task 1, such as sub-task 1-sub-task 4. Taking the first object as sub-task 4 in task 1, assuming that sub-task 1-sub-task 4 are serial tasks that need to be executed in sequence and the later sub-task depends on the previous sub-task, the associated task associated with the state prompt task of the first object (sub-task 4) can include sub-task 1, sub-task 2 and sub-task 3.

[0125] In actual application, some page tasks such as product safety approval and other complex tasks are usually composed of multiple sub-tasks and there is often a dependency relationship or a containing relationship between the sub-tasks. For this case, based on the method of the embodiments of the present application, the associated task associated with the first object to be monitored (the task to be monitored) can be determined, for example, other tasks having a dependency relationship or a containing relationship with the task to be monitored are determined, to determine the second object based on the associated task, and then determine the state of the first object to be monitored based on the second object.

[0126] Step 705, determining at least one other display object and / or non-display object corresponding to the target page of the associated task to obtain the second object.

[0127] On the basis of step 704, the present step can further determine at least one other display object corresponding to the associated task on the target page, and / or determine at least one non-display object corresponding to the associated task as the second object.

[0128] The at least one non-display object can include, but is not limited to, a DOM element corresponding to the associated task on the target page and not rendered and displayed on the target page, and / or a background task such as a related background process.

[0129] The present embodiment can determine the second object based on which the state prompt of the first object is performed based on the state prompt demand information of the user input, facilitate obtaining the state of the first object corresponding to the state prompt demand dimension through the associated analysis of the second object, and thus provide a basis for the personalized state prompt of the first object, and meet the personalized state prompt demand of the user for the first object.

[0130] In an optional embodiment, step 103 in the method provided by the present application, i.e., obtaining the state information of the first object based on at least the second object, can be implemented as at least one of the following embodiments 31-32:

[0131] 31) Based on the state prompt rule, monitoring the corresponding visual information of the first object and the at least one other display object on the target page, and obtaining the state information of the first object based on the obtained visual monitoring information.

[0132] The present embodiment provides a visual monitoring mechanism for the target page to monitor the visual information of the first object and the at least one other display object associated with the first object on the target page.

[0133] In the visual monitoring mechanism, optionally, based on the state prompt rule, the visual visibility changes such as style changes (e.g., color, size), text changes, and / or progress state changes of the first object and the at least one other display object can be captured through a lightweight image difference algorithm and CSSOM (CSS Object Model, objectified representation of CSS style sheet) analysis, and the like, to obtain visual monitoring information, so as to obtain the state information of the first object based on the obtained visual monitoring information.

[0134] 32) Based on the state prompt rule, monitoring the target elements corresponding to the first object and the at least one non-display object in the document object model of the target page, and obtaining the state information of the first object based on the obtained element monitoring information.

[0135] The present embodiment provides a DOM monitoring mechanism for the target page to monitor the target elements corresponding to the first object and the at least one non-display object in the document object model of the target page.

[0136] Optionally, MutationObserver (mutation observer) can be used to monitor the attribute, child node and text change information of the target element, and support dynamically adjusting the sub-tree range monitored on the DOM tree structure to obtain the element monitoring information corresponding to the target element, and then obtain the state information of the first object based on the obtained element monitoring information.

[0137] In implementation, preferably, a hybrid monitoring engine can be implemented by combining the above two monitoring mechanisms to support multi-modal monitoring based on the hybrid monitoring engine.

[0138] Based on the present embodiment, multi-modal monitoring from the visual and DOM dimensions can be performed by using the hybrid monitoring engine to realize intelligent tracking of complex task states.

[0139] In an optional embodiment, step 104 in the method provided by the present application, i.e., responding to the state information representing that the first object meets the prompt condition, prompting output based on the first object, can be further implemented as:

[0140] In response to the state information representing that the state of the first object meets the prompt condition represented by the state prompt rule, at least one of the prompt window, the communication message, the prompt sound and the vibration prompt for state prompting of the first object is output.

[0141] After obtaining the state of the first object, the state of the first object can be compared with the state specified in the prompt condition represented by the state prompt rule to determine whether the state of the first object meets the prompt condition, and in response to meeting the prompt condition, the first object can be prompted output based on the preset prompt mode, such as Figure 8 In the above embodiment, an example of state prompting of the first object on the current page based on the prompt window is provided, and the current page can be the target page or a non-target page, which is not limited and is determined according to actual application.

[0142] The preset prompt mode can be, but is not limited to, any one or more of the window prompt, the communication message, the prompt sound and the vibration prompt. Among them, for the communication message prompt mode, the communication message for state prompting can be sent to the user through WebSocket or a third-party push service (such as Web Push, SMS, etc.).

[0143] The present embodiment can facilitate the user to timely know the state of the first object by outputting the prompt window, the communication message, the prompt sound and the vibration prompt for state prompting of the first object.

[0144] In an optional embodiment, the information processing method provided by the present application can further include the following processing:

[0145] In response to monitoring the triggering operation on the prompt window, switching to the target page and displaying the first object in the target page with the marked effect after the marking.

[0146] In the embodiment, the prompt window for state prompting of the first object supports the triggering operation of the user, and the user can trigger the window, such as clicking the prompt text in the window or clicking the "back" button, or clicking any position of the window, to make the electronic device switch to the target page.

[0147] The electronic device monitors the triggering operation on the prompt window, and in response to monitoring the triggering operation, switches from the current page to the target page and displays the first object in the target page as the marked effect after the marking.

[0148] The marking processing can be, but is not limited to, one or more marking methods such as color, highlighting, grayscale, protrusion, dynamic display (such as jitter), and the like, see Figure 9 , which shows an example of switching to the target page based on the triggering operation of the user on the prompt window, in which the first object is displayed in the target page with a grayscale effect.

[0149] In the state prompting of the first object, the embodiment supports the user to quickly and conveniently switch from the current page to the target page by triggering the prompt window, improves the convenience and efficiency of the user operation, and at the same time, displays the first object in the target page switched to with the marked effect, facilitates the user to quickly locate the first object to view the state information, and further improves the user experience.

[0150] The information processing method provided in the application can further include the following processing:

[0151] Based on the page refresh strategy, refreshing the page data of the target page.

[0152] The page refresh strategy can be, but is not limited to, a periodic refresh strategy based on a set time interval or refresh frequency.

[0153] The background can obtain the latest page data at the corresponding time through the set time interval or refresh frequency to refresh the page data.

[0154] In the implementation, a reasonable time interval or refresh frequency can be set through experiments or experience to ensure state monitoring while avoiding excessive server pressure and bandwidth consumption.

[0155] The embodiment can compare the new and old states (the current state and the historical state before the current state) of the page data based on the page refreshing strategy and refreshing the page data of the target page in time, so as to realize the state monitoring of the corresponding to-be-monitored object, and further provide a basis for the state prompting processing based on the state monitoring.

[0156] Corresponding to the information processing method, the embodiment of the application further provides an information processing device, the component structure of which is as shown in Figure 10 The information processing device comprises:

[0157] A first determination module 1001 is configured to determine a first object; the first object is at least one display object in a target page;

[0158] A second determination module 1002 is configured to obtain target input information and determine a second object based on the target input information; the second object is at least one display object in a target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects;

[0159] An acquisition module 1003 is configured to obtain state information of the first object based on at least the second object;

[0160] A prompt output module 1004 is configured to perform prompt output based on the first object in response to the state information representing that the first object meets a prompt condition.

[0161] In an optional embodiment, the first determination module 1101 is specifically configured to perform at least one of the following:

[0162] Detecting a selection operation on a display object on the target page, and determining at least one display object indicated by the selection operation on the target page as the first object;

[0163] Determining an interactive hot area on the target page through an artificial intelligence model, and determining a display object corresponding to the interactive hot area as a to-be-monitored object;

[0164] Determining a time intersection between a historical access time and a display object state change time of a display object in different regions of the target page through an artificial intelligence model, and determining a corresponding display object with the time intersection as a to-be-monitored object.

[0165] In an optional embodiment, the second determination module 1002 is specifically configured to:

[0166] obtaining state prompt demand information of the first object input by a target input box corresponding to the first object; the target input box is displayed in response to determining the first object, or displayed in response to triggering an option for state prompt setting corresponding to the first object;

[0167] determining at least one other display object in the target page and / or at least one non-display object corresponding to the target page, based on which state prompt of the first object is needed, by analyzing the state prompt demand information by using an artificial intelligence model, to obtain the second object;

[0168] The other display object is a corresponding display object on the target page other than the first object, and the target input information includes the state prompt demand information.

[0169] In an optional implementation, the second determination module 1002, when determining at least one other display object in the target page and / or at least one non-display object corresponding to the target page, based on which state prompt of the first object is needed, by analyzing the state prompt demand information by using an artificial intelligence model, to obtain the second object, is specifically used for:

[0170] determining a target intent represented by the state prompt demand information by using an artificial intelligence model;

[0171] determining a state prompt rule of the first object corresponding to the target intent;

[0172] parsing a document object model of the target page to obtain a corresponding parsing result;

[0173] determining an associated task associated with a state prompt task of the first object represented by the state prompt rule based on the parsing result;

[0174] determining the associated task in at least one other display object and / or non-display object corresponding to the target page to obtain the second object.

[0175] In an optional implementation, the obtaining module 1003 is specifically used for performing at least one of the following:

[0176] monitoring corresponding visual information of the first object and the at least one other display object on the target page based on the state prompt rule, and obtaining state information of the first object based on obtained visual monitoring information;

[0177] Based on the state prompt rule, a target element corresponding to the first object and the at least one non-display object in a document object model of the target page is monitored, and state information of the first object is obtained based on obtained element monitoring information.

[0178] In an optional implementation, the prompt output module 1004 is specifically configured to:

[0179] In response to the state information representing that the state of the first object satisfies the prompt condition represented by the state prompt rule, at least one of a prompt window, a communication message, a prompt sound, and a vibration prompt for state prompting of the first object is output.

[0180] In an optional implementation, the apparatus further includes a switching control module configured to:

[0181] In response to monitoring a triggering operation on the prompt window, switching to the target page and displaying the first object in the target page with a marked processed mark effect.

[0182] In an optional implementation, the apparatus further includes a page refreshing module configured to:

[0183] Based on a page refreshing strategy, refreshing page data of the target page.

[0184] Embodiments of the present application also disclose an electronic device, and a component structure of the electronic device, as shown in Figure 11 at least includes:

[0185] The memory 10 is configured to store a computer instruction set.

[0186] The computer instruction set can be implemented in the form of a computer program.

[0187] The processor 20 is configured to implement the information processing method provided in any of the above method embodiments by executing the computer instruction set in the memory.

[0188] The processor 20 can be a central processing unit (CPU), a graphics processor, an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a neural network processor (NPU), a deep learning processor (DPU), or other programmable logic devices.

[0189] Optionally, the electronic device further includes storage resources such as memory, cache, etc.

[0190] Optionally, the electronic device further comprises a camera assembly, and / or is connected with an external camera assembly.

[0191] In addition, the electronic device can further include a communication interface, a communication bus and the like components. The memory, the processor and the communication interface complete the communication between each other through the communication bus.

[0192] The communication interface is used for the communication between the electronic device and other devices. The communication bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus and the like.

[0193] The embodiment of the application further discloses a storage medium, the storage medium carries one or more computer instruction sets, when the one or more computer instruction sets are executed by the electronic device, the electronic device can realize the information processing method provided by any method embodiment.

[0194] It should be noted that each embodiment in the specification adopts a progressive manner for description, and each embodiment focuses on the difference from other embodiments. The same and similar parts of each embodiment can be referred to each other.

[0195] For the convenience of description, the above system or device is described as various modules or units respectively described in the function. Of course, in the implementation of the application, the functions of each unit can be realized in the same or multiple software and / or hardware.

[0196] From the above description of the embodiments, those skilled in the art can clearly understand that the application can be realized by means of software and the necessary universal hardware platform. Based on such understanding, the technical solutions of the application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in various embodiments or some parts of the embodiments.

[0197] Finally, it needs to be pointed out that, in this document, relational terms such as first, second and third and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0198] The above description is merely preferred embodiments of the present application, and it is to be pointed out that, for those skilled in the art, some improvements and refinements can be made without departing from the principles of the present application, and these improvements and refinements shall also be considered as falling within the protection scope of the present application.

Claims

1. An information processing method comprising: determining a first object; the first object being at least one display object in a target page; obtaining target input information, determining a second object based on the target input information; the second object being at least one display object in the target page and / or at least one non-display object corresponding to the target page; different target input information corresponds to different second objects; obtaining state information of the first object based on at least the second object; in response to the state information representing that the first object meets a prompt condition, performing prompt output based on the first object.

2. The information processing method of claim 1, wherein determining a first object comprises at least one of the following: detecting a selection operation on a display object on the target page, and determining at least one display object indicated by the selection operation on the target page as the first object; determining an interactive hot area on the target page by an artificial intelligence model, and determining a display object corresponding to the interactive hot area as a to-be-monitored object; determining a time intersection between a historical access time of a display object in different regions of the target page and a display object state change time by an artificial intelligence model, and determining a corresponding display object with a time intersection as a to-be-monitored object.

3. The information processing method of claim 1, wherein obtaining target input information and determining a second object based on the target input information comprises: obtaining state prompt demand information of the first object input through a target input box corresponding to the first object; the target input box is displayed in response to determining the first object, or in response to triggering an option for state prompt setting corresponding to the first object; determining at least one other display object in the target page and / or at least one non-display object corresponding to the target page based on which state prompt of the first object is needed by analyzing the state prompt demand information by using an artificial intelligence model, to obtain the second object; wherein the other display object is a corresponding display object on the target page other than the first object, and the target input information includes the state prompt demand information.

4. The information processing method of claim 3, wherein determining at least one other display object in the target page and / or at least one non-display object corresponding to the target page based on which state prompt of the first object is needed by analyzing the state prompt demand information by using an artificial intelligence model, to obtain the second object, comprises: determining a target intent represented by the state prompt demand information by using an artificial intelligence model; determining a state prompt rule of the first object corresponding to the target intent; parsing a document object model of the target page to obtain a corresponding parsing result; based on the parsing result, determining an associated task associated with a state prompt task of the first object represented by the state prompt rule; determining the associated task in at least one other display object and / or non-display object corresponding to the target page to obtain the second object.

5. The information processing method of claim 4, wherein the state information of the first object is obtained based on at least the second object, and the obtaining comprises at least one of: monitoring respective visual information of the first object and the at least one other display object on the target page based on the state prompt rule, and obtaining the state information of the first object based on the obtained visual monitoring information; and monitoring target elements corresponding to the first object and the at least one non-display object in a document object model of the target page based on the state prompt rule, and obtaining the state information of the first object based on the obtained element monitoring information.

6. The information processing method of claim 4, wherein the prompt output based on the first object is performed in response to the state information representing that the first object satisfies a prompt condition, and the performing comprises: outputting at least one of a prompt window, a communication message, a prompt sound, and a vibration prompt for state prompting of the first object in response to the state information representing that the state of the first object satisfies the prompt condition represented by the state prompt rule.

7. The information processing method of claim 6, further comprising: switching to the target page and displaying the first object with a marked effect of a mark processing in the target page in response to monitoring a triggering operation on the prompt window.

8. The information processing method of any one of claims 1-7, further comprising: refreshing page data of the target page based on a page refreshing strategy.

9. An information processing apparatus, comprising: a first determining module configured to determine a first object; the first object being at least one display object in a target page; a second determining module configured to obtain target input information and determine a second object based on the target input information; the second object being at least one display object in the target page and / or at least one non-display object corresponding to the target page; different target input information corresponding to different second objects; an obtaining module configured to obtain state information of the first object based on at least the second object; and a prompt output module configured to perform prompt output based on the first object in response to the state information representing that the first object satisfies a prompt condition.

10. An electronic device, comprising: a memory configured to store at least a set of computer instructions; and a processor configured to implement the following processing by executing the set of instructions stored in the memory: determining a first object; the first object being at least one display object in a target page; obtaining target input information and determining a second object based on the target input information; the second object being at least one display object in the target page and / or at least one non-display object corresponding to the target page; different target input information corresponding to different second objects; obtaining state information of the first object based on at least the second object; and performing prompt output based on the first object in response to the state information representing that the first object satisfies a prompt condition. ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​

Images