212 results about "Target–action" patented technology

The invention relates to the technical field of artificial intelligence, can be applied to business scenes such as personal intelligence, financial science and technology and medical health, and discloses a mechanical arm task planning and control method, device, equipment and medium. Encoding visual information and task description language information to obtain visual features and language features, generating a target action sequence by using a language model, generating a basic path through dynamic planning under an environment model, adjusting the basic path according to environment change in combination with reinforcement learning, generating a final path, and decoding the target action sequence into a joint control instruction. And generating a motion control signal based on the final path, and optimizing a joint control instruction in combination with environment feedback. According to the method, through multi-modal information fusion and mixed path planning, the control instruction is dynamically optimized in combination with environment feedback, and the operation efficiency and task generalization ability of the mechanical arm in a complex environment are improved.

The invention provides a training method and device for a robot control model, a control method and device and electronic equipment, and relates to the technical field of equipment control, and the method comprises the steps: obtaining a preset motion data set, and employing a preset large language model in the robot control model to obtain a preset motion data set; generating an action sequence text and a prediction target direction corresponding to the sample natural language command based on the sample natural language command; and encoding the action sequence text by adopting an initial text encoder in the robot control model, determining a target action code corresponding to the action code from a preset action codebook, and performing action planning according to the target action code and a predicted target direction by adopting an initial action planning model in the robot control model. Generating action strategy information corresponding to the sample natural language command; and parameter adjustment training is carried out on the initial motion planning model in the robot control model. The generalization ability of the robot control model is improved, and control over the robot is more accurate.

The embodiment of the invention provides an action sequence execution method, electronic equipment, a storage medium and a program product. The method comprises the steps that a global action sequence is generated based on semantic features representing user instructions, and the global action sequence comprises a plurality of node actions with an execution sequence; after executing each node action, performing anomaly identification on each node action to obtain an identification result corresponding to each node action; generating a target action sequence taking the target node action as a starting point under the condition that the identification result indicates that the target node action is abnormal; the target action sequence is used for updating the global action sequence; according to the updated global action sequence, interface elements in the operation interface are processed until the execution target of the user instruction is completed. According to the technical scheme of the embodiment of the invention, the technical problem that the success rate of the automatic execution process is not ideal in the prior art is solved.

The invention provides a model training method, a silicon wafer processing method, a silicon wafer processing device, a storage medium and equipment. The model training method comprises the following steps: acquiring initial state information and target state information of a silicon wafer to be processed; through an action decision model, according to the initial state information and the target state information, machining action information for the machining machine table is generated; determining an award parameter corresponding to the processing action information, wherein the award parameter represents the processing quality and efficiency when the processing machine processes the to-be-processed silicon wafer based on the processing action information; if the reward parameter is not more than the preset condition, updating the initial action decision model according to the reward parameter to obtain an updated action decision model; and based on the updated action decision model, returning to execute the step of generating the processing action information through the action decision model according to the initial state information and the target state information until the reward parameter is greater than the preset condition, and obtaining a target action decision model. According to the invention, the processing machine table can be accurately adjusted.

The invention provides a robot control method, a robot and electronic equipment, and the method comprises the steps: planning an initial action sequence of the robot according to the environment information of the robot, correcting a part of action sequences in the initial action sequence according to a target action state of the robot at a current moment, and obtaining a target action sequence; and finally, the robot is controlled according to the target action sequence, the collection moment of the environment information is before the current moment, the initial action sequence comprises initial action states of the robot at multiple moments after the collection moment, and the partial action sequence is the action sequence located after the current moment in the initial action sequence. According to the method, the two steps of planning the action sequence and executing the action sequence can be executed at the same time, and the control efficiency is ensured.

The invention relates to the technical field of intelligent control, and discloses a dexterous hand motion planning and control method based on a visual language motion model, and the method comprises the steps: S1, collecting data, and carrying out the time sequence synchronization and consistency verification of multi-source data; s2, performing dynamic adaptive exponential moving average filtering and calculation processing on the joint sequence, and reconstructing a processing result into adaptive structured features; s3, fusing joint states, inputting the fused joint states into an action head network, splicing online and offline samples into a training batch according to a preset proportion, and determining results to jointly optimize model parameters; s4, performing model reasoning to obtain target action information, performing processing in sequence to generate a smooth low-jitter control sequence, and sending the smooth low-jitter control sequence to the dexterous hand for execution; and S5, the deployment thread issues a control instruction by aligning the annular buffer and the timestamp, triggers a rollback track and allows manual intervention when the control instruction exceeds a threshold value, and writes manual intervention data into an offline buffer. According to the method, efficient, stable and smooth motion control of the dexterous hand can be realized under the condition of extremely few teaching data sets.

The invention provides a task processing method, device and equipment based on a virtual auxiliary screen, and the method comprises the steps: displaying a user interaction interface through a main screen, and collecting multimode data from the user interaction interface; determining a user intention based on the multimode data, and generating a task execution sequence based on the user intention; generating a target action sequence based on the task execution sequence; obtaining a target virtual secondary screen corresponding to the target action sequence, sending the target action sequence to the target virtual secondary screen, and performing task processing based on the target action sequence through the target virtual secondary screen; and obtaining a target execution result of the target virtual auxiliary screen for the target action sequence, and displaying the target execution result on a user interaction interface of the main screen. Through the technical scheme of the invention, rapid AI response can be realized, and smooth conversation between the user and the AI agent can be ensured even under the condition that the network is unstable.

The embodiment of the invention discloses an action processing method, device, system and equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring point cloud data corresponding to each target object in a target space; recognizing the action of the target object based on the point cloud data to obtain the action corresponding to the target object; if the action is the target action, indicating the movable equipment to move to an area corresponding to the target object, and obtaining feedback information obtained by interaction between the movable equipment and the target object; and processing an event corresponding to the target action based on the target action and the feedback information. According to the method, action recognition is carried out by acquiring the point cloud data of the target object, a user does not need to wear any equipment, user privacy leakage is avoided while the action recognition accuracy is improved, meanwhile, the mobile equipment is linked to interact with the user, the event is processed according to the feedback information obtained through interaction, and the user experience is improved. And the action processing efficiency and the event processing capability are improved.

The application discloses a blockchain task allocation method and device based on DQN, equipment and medium, relates to the field of task allocation, comprising: determining the state vector of the DQN model, selecting the target action according to the state vector, and determining the predicted execution time and the actual execution time of the target action; the predicted execution time and the actual execution time are used as the input of the preset time length reward formula to obtain the time length reward; a plurality of experiences are randomly extracted, the target Q value of the DQN model is determined based on the plurality of experiences, and the DQN model is updated through the observation Q value and the target Q value of the DQN model; multiple rounds of updating are performed until the DQN model meets the preset requirements to obtain the target DQN model; the target blockchain task allocation model is constructed through the target DQN model, and after receiving the blockchain task allocation request, the target blockchain task allocation model is used for intelligent task allocation. Therefore, the task allocation efficiency can be improved, the dynamic environment change can be responded to, and the manual intervention can be reduced.

The invention provides an interaction method, an intelligent agent training method and device and electronic equipment, and the method comprises the steps: receiving a user instruction; generating a first target action associated with the first user interface according to the first page description information of the first user interface and the user instruction; and executing the first target action on the first user interface to realize the interactive response to the user instruction, thereby realizing the intellectualization and automation of user interface interaction, remarkably improving the speed and accuracy of the response to the user instruction, and improving the user experience. Meanwhile, user interfaces (including complex multi-element interfaces or simple single-function interfaces) with different structures and designs can be flexibly coped with, the consistency and satisfaction degree of user experience are enhanced, and operation under various application scenes is smoother and more natural.

The invention discloses a multi-step task reasoning and planning method and electronic equipment, and belongs to the technical field of robot control. The method comprises the steps of obtaining target task input, and determining a first action plan based on the target task input; candidate actions are obtained, a composite scoring function is generated, the candidate actions are associated with the first action plan, and the composite scoring function is used for scoring the candidate actions; decomposing the first action plan into multi-level tasks by using a multi-level planning algorithm, calculating the total cost, and selecting an execution path with the minimum total cost as a target action plan; and calculating a state difference value, and determining whether to trigger re-planning or not based on the state difference value. According to the invention, the robot control efficiency and accuracy are improved, and the robustness is enhanced.

The invention discloses an available time pushing method and device and a storage medium, and the method comprises the steps: firstly receiving request information used for requesting to push target available total time, and then obtaining the predicted available time of a target object for carrying out a target action at each candidate place in each unit time period according to the request information, obtaining reachable information between every two candidate places; according to all the predicted available time and all the reachable information, the total available time of the target is obtained through calculation, dynamic time planning is carried out by comprehensively considering the space-time relation between time and places, and the sum of the available time of the target object for carrying out target actions in multiple unit time periods can be calculated more accurately and comprehensively. According to the method, the processing efficiency of time planning and the reasonability of time planning are effectively improved, so that a more accurate time planning scheme with a better optimization effect can be pushed to the target object, and the satisfaction degree of the target object for time planning is improved.

The application provides a virtual object control method, a virtual object control device, a computer readable storage medium and an electronic device, and relates to the technical field of virtual interaction. In the method, a user can trigger a sliding operation from a first control to a second control to control a virtual object to perform a target action related to the first control and the second control. Compared with the related art, the user does not need to press the first control and the second control respectively to trigger the target action. The user only needs to slide from the first control to the second control to achieve "one-key" triggering of the target action (such as a continuous attack action). This can improve the casting efficiency of the target action and reduce the cost of the user learning to cast the target action.

The embodiment of the invention discloses a task execution method and device, electronic equipment, a computer storage readable medium and a program product. The method comprises the following steps: acquiring a plurality of to-be-executed actions in a current interaction state; executing multiple rounds of action screening operation; wherein each action screening operation is used for screening candidate actions meeting the cost requirement in the current round from the action list determined in the last round, and determining the action list of the current round based on the candidate actions meeting the cost requirement in the current round; in the first round, candidate actions meeting the cost requirement in the round are obtained from a plurality of actions to be executed; taking a father node action corresponding to the candidate action screened out by the last round of action screening operation in the plurality of actions to be executed as a target action to be executed in the current interaction state; and in the current interaction state, executing the target task in response to the target action.

The invention relates to a task processing method and system for a body-equipped robot based on context self-adaption. The method comprises the following steps: receiving user instructions, and classifying the user instructions to obtain instruction types; under the condition that the instruction type is the fuzzy instruction type, outputting an intention guiding suggestion for the user instruction; the intention guidance suggestion is generated based on instruction context information corresponding to the user instruction, and the intention guidance suggestion is used for guiding the user to define a task intention; based on the intention guiding suggestion, reconstructing the instruction context information to obtain reconstructed context information; receiving a feedback instruction of the user for the intention guidance suggestion, and performing semantic analysis on the feedback instruction based on the reconstructed context information to obtain a feedback task intention; and under the condition that the feedback task intention indicates execution of the target task, a target action sequence is generated based on the target task, and the robot with the body is controlled to execute the target action sequence. By adopting the method, the task processing efficiency can be improved.

The invention discloses a generation method, model and device and electronic equipment. The method comprises the steps that action description information input by a user is obtained; determining text features based on the action description information; processing the text features, and gradually obtaining an action feature set with multiple time sequence lengths according to a pre-trained codebook; the action feature set of the time sequence length comprises a plurality of action features with different time sequences; the codebook is used for storing a mapping relation between a plurality of discrete code values and a plurality of action characteristics; and processing the action feature set with the multiple time sequence lengths to obtain a target action sequence.

The invention provides an integration test method and device, equipment, a medium and a product, and relates to the technical field of automatic testing, and the specific technical scheme is as follows: obtaining an action library corresponding to a test object of an integration test service, and screening a target action from test actions in the interface test dimension, the file test dimension, the database test dimension and the script test dimension of the action library, and generating a test case based on the target action. And performing collection processing according to the test case and a preset case to obtain a test task, and running the integrated test task based on the execution dependency relationship to obtain an integrated test result of the test object. According to the method, on one hand, the action library comprises the test actions under multiple test dimensions, and the test applicability is wider; and on the other hand, based on the execution dependency relationship, the integration test task is automatically operated, the integration test result of the test object is obtained, manual intervention on triggering and sequence control between cases is not needed, automatic test is achieved, and the test efficiency is improved.

The embodiments of the present disclosure disclose a method and apparatus for training a model. A specific implementation of the method includes: obtaining a sample state transition trajectory data set; performing the following training steps: selecting a target state value from the sample state transition trajectory data, and using the target state value, performing the following processing steps: inputting the target state value into the initial action selection model to obtain a target action value; inputting the target state value and the target action value into the environment model to obtain a simulation subsequent state value and a simulation reward value; using the simulation subsequent state value as the target state value, repeatedly performing the processing steps until the preset processing conditions are met, and obtaining simulation state transition trajectory data; forming a training sample set from the sample single-step state transition data and the simulation single-step state transition data; and using the training sample set to train the initial action selection model to obtain a trained action selection model. This implementation can train an action selection model with stronger generalization capabilities.

This disclosure provides a method and an apparatus for programming. The method includes: identifying a first target profile from a set of profiles according to information related to a target user. The set of profiles is obtained according to information related to users, and each profile in the set of profiles corresponds to a category of the information related to the users. The method further includes determining one or more candidate models from a model database according to the first target profile. The models in the model database are trained models obtained through subsets of a training dataset. The models are used for programming tasks. The subsets are obtained by dividing the training dataset based on the set of profiles. The method further includes obtaining a target action from one or more candidate actions generated by applying the one or more candidate models to context.

The disclosure provides a large model-based data generation method and device, equipment and a storage medium, relating to the technical field of computers, especially the technical fields of large models, data processing, artificial intelligence and the like. The specific implementation scheme is: inputting target prompt information to a generation large model, so that the generation large model generates first question information based on expert knowledge and a target action sequence in the target prompt information; the target action sequence is used to constrain the execution path of the generation large model; the first question information includes text data, and the text data is a clue required to answer the first question information; the first question information is verified based on an evaluation large model to obtain a difficulty level; the difficulty level is used to represent the difficulty of the target large model in answering the first question information; and in the case that the difficulty level is a target level, a training sample of the target large model is constructed based on the first question information.

This invention discloses a security verification method, apparatus, and electronic device. The method includes: responding to a user-initiated verification request by randomly generating an action sequence containing multiple action descriptions; extracting target action samples that match the action descriptions from a pre-built action sample library, and constructing an action sample set based on the extracted target action samples; displaying the target action samples from the action sample set to the user, and obtaining the action trajectory generated by the user performing the verification action under the guidance of the target action samples; detecting the action trajectory based on the action sequence, and confirming that the user has passed the security verification when the action trajectory matches the action descriptions in the action sequence. In this way, by guiding the user to perform the verification action through action samples, there is no need to touch the screen, which avoids verification failure due to accidental touches and improves the accuracy and convenience of verification.

The invention provides a game interaction control method and device and electronic equipment. The method comprises the following steps: determining a body part corresponding to a to-be-executed action of a virtual character; displaying a key identifier corresponding to the current to-be-executed action at a target position corresponding to a target body part of the virtual character; and in response to the fact that the key identifier corresponding to at least one action in the action sequence is triggered within the correct triggering time, controlling the virtual character to execute the target action. According to the mode, when the virtual character executes part of actions in the action sequence, the key identifiers are provided for the player at the associated positions of the body parts corresponding to the actions, so that the player has pleasant sensation of participating in action control, and only when the key identifier corresponding to at least one action in the action sequence is correctly triggered, the action sequence can be accurately triggered. Therefore, the role can be controlled to execute the target action without influencing normal execution of other actions in the action sequence, the game difficulty is reduced, the overall refreshing feeling of the game is not influenced, and the game experience of players is improved.

According to embodiments of the present disclosure, methods, apparatuses, devices and storage media for interacting in a virtual environment are provided. The method comprises: receiving a request for performing a target action in a target interface, the target action being related to obtaining a virtual element in the virtual environment, the virtual element comprising a virtual prop and / or a virtual character; presenting an execution value corresponding to the execution of the target action by utilizing a dynamic change of a probability interaction element; and determining an attribute of a target virtual element obtained based on the target action based on a comparison of the execution value and at least one target value presented in the target interface. In this way, the interactive experience in the virtual scene can be enhanced.

The invention provides a task processing method and electronic equipment, and is applied to the technical field of artificial intelligence. The task processing method comprises the steps that a target task is decomposed into a plurality of sub-tasks, and the sub-tasks are different execution nodes of the target task; determining a sub-action sequence corresponding to the sub-task, wherein the sub-action sequence has at least one type of current semantic information, current logic structure information and current context information; according to at least one type of information of the sub-action sequences, at least one candidate action sequence corresponding to the target task is determined from a knowledge base, and the knowledge base comprises a plurality of historical tasks and historical action sequences corresponding to the historical tasks; processing the target task based on the large model, and generating a target action sequence corresponding to the target task by taking the at least one candidate action sequence as prompt information; the target action sequence is used for executing the target task.

The embodiment of the invention provides a method and device for programming. The method comprises the steps that according to information related to a target user, a first target configuration file in a configuration file set is identified, the configuration file set is obtained according to the information related to the user, and each configuration file in the configuration file set corresponds to the category of the information related to the user; according to the first target configuration file, one or more candidate models are determined from a model database, the models in the model database are trained models obtained through a subset of a training data set, and the models are used for programming tasks; the subsets are obtained by dividing the training data set according to the configuration file set; a target action is obtained from one or more candidate actions, the one or more candidate actions being generated by applying the one or more candidate models to the environment. According to the technical scheme, personalized support can be provided for the user.

The embodiment of the invention discloses an information interaction method and device, electronic equipment and a readable storage medium. According to the embodiment of the invention, the game picture data of the user is obtained in the game process of the user, and the key information in the game picture data is determined, so that the strategy distribution and the reward function of the object controlled by the user in the current state and the state value function of the object controlled by the user in the next state are determined according to the key information in the game picture data; and determining a target action of the object controlled by the user in the current state according to the strategy distribution of the object controlled by the user, the state value function and the reward function, thereby interacting with the user according to the target action. In the embodiment of the invention, the game state of the user can be recognized in real time according to the game picture data of the user, and then the action of the operation object is accurately predicted and interacts with the user, so that the timeliness and accuracy of game assistance can be improved, and the use experience of the user is improved.

The application discloses a device linkage control energy consumption statistical optimization method and device, a terminal and a medium. The method comprises the following steps: obtaining a target rule, performing multi-device linkage control based on the target rule; when target environment information meets a trigger condition of the target rule, instructing a target device to perform a target action; when the target device performs the target action, recording target event information of the target device to a target record table, the target event information comprising a target event timestamp, an event duration and an energy consumption result; and optimizing multiple devices based on the target record table. The application can solve the problem that the prior art lacks overall consideration of the overall energy consumption under device linkage control, and can make more reasonable device operation strategies, so that linkage control between devices can further optimize energy consumption, prolong the service life of the devices, and improve user experience and management efficiency.

The application relates to a method and device for playing a game based on a virtual-real combined object, which comprises the following steps: acquiring action execution information for controlling a first virtual object to execute a specific action, wherein the first virtual object is a virtual object controlled by a target player; calling a preset game intelligent agent, analyzing the action execution information and context information of the specific action, and determining target action information required by a virtual-real combined object; and controlling the virtual-real combined object to execute a corresponding action according to the target action information, wherein the virtual-real combined object is composed of a target entity object arranged near a display screen and a second virtual object displayed on the display screen. Since the virtual-real combined object is integrated with the entity object, when a player interacts with the virtual-real combined object, the player seems to be in a real combat scene, the sense of immersion is greatly enhanced, and the game experience is significantly improved.

Embodiments of the present application provide a kind of action sequence execution method, electronic equipment, storage medium and program product.It relates to human-computer interaction field, the method includes: based on the semantic feature of representing user instruction, generate global action sequence, global action sequence includes multiple node actions with execution order in it;After executing each node action, each node action is identified, and the identification result corresponding to each node action is obtained;In the case where the identification result indicates that the target node action exists exception, generate the target action sequence with the target node action as starting point;Target action sequence is used to update global action sequence;According to the updated global action sequence, the interface element in operation interface is executed to process until the execution target of user instruction is completed.In the technical scheme of the present application, the technical problem that the success rate of automation execution process is not ideal in the related art is solved.