4 results about "Curiosity" patented technology

The invention discloses an AUV trajectory tracking deep reinforcement learning method based on an improved curiosity mechanism. On the basis of an internal curiosity mechanism, a self-adaptive internal reward coefficient mechanism is provided, and an improved internal curiosity module IICM is constructed, so that the AUV can dynamically adjust the exploration capability of the AUV according to the actual tracking effect. Meanwhile, the IICM is combined on the SAC algorithm framework, an SAC + IICM algorithm is provided, the exploration behavior of the AUV is stimulated through a self-adaptive internal reward mechanism, and the understanding depth of the AUV on the environment is improved. Besides, in order to improve the tracking effect and the training efficiency, a composite reward function fusing factors such as path errors, speed changes and yaw angle errors is designed, and a state and action space highly matched with a tracking task is constructed. The method has the advantages of being high in autonomy, good in adaptability, high in convergence speed, high in control precision, high in robustness and the like, and is suitable for an AUV autonomous operation scene in a complex marine environment.

A curiosity-driven Android app automatic testing method includes the following steps:1) a left part represents a pre-processing assembly which achieves abstraction of an Android app state based on an Android interface structure; 2) a right part is curiosity-driven reinforcement learning module which maintains a historical access state set and optimizes an exploration policy constantly to guide a test to find more new states under the guidance of a reward function based on a curiosity thought; and 3) a middle part represents an advanced guidance module of a deterministic finite automaton (DFA), where the DFA is constructed during operation to record all access states and frequencies thereof; and if the new states are not explored within a given time budget, an AndroidExplore selects the most curious state as a starting point of a next exploration according to global information of the DFA.

The system according to this embodiment aims to leverage children's natural curiosity and promote their active participation. [Solution] The system according to the embodiment comprises an analysis unit, a prompt creation unit, and a motivation unit. The analysis unit analyzes the child's browsing history and interests. The prompt creation unit creates personalized prompts based on the analysis results obtained by the analysis unit. The motivation unit encourages the child's behavior based on the prompts created by the prompt creation unit.

An object of the present application is to provide a composition for inhibiting a decrease in curiosity or improving curiosity. The present application relates to a composition for inhibiting a decrease in curiosity or improving curiosity, characterized by containing L-ergothioneine or a salt thereof.