497 results about "Return function" patented technology

The present invention comprises an intelligent gaming system that includes a game engine, simulation engine, and, in certain embodiments, a static evaluator. Embodiments of the invention include an intelligent, poker playing slot machine that allows a user to play poker for money against one or more intelligent, simulated opponents. In one embodiment, the invention generates card playing strategies by analyzing the expected return to players of a game. In one embodiment, a multi-dimensional model is used to represent possible strategies that may be used by each player participating in a card game. Each axis (dimension) of the model represents a distribution of a player's possible hands. Points along a player's distribution axis divide each axis into a number of segments. Each segment has associated with it an action sequence to be undertaken by the player with hands that fall within the segment. The dividing points delineate dividing points between different action sequences. The model is divided into separate portions each corresponding to an outcome determined by the action sequences and hand strengths for each player applicable to the portion. An expected return expression is generated by multiplying the outcome for each portion by the size of the portion, and adding together the resulting products. The location of the dividing points that result in the maximum expected return is determined by taking partial derivatives of the expected return function with respect to each variable, and setting them equal to zero. The result is a set of simultaneous equations that are solved to obtain values for each dividing point. The values for the optimized dividing points define optimized card playing strategies.

The invention discloses an automatic book management system based on closed stacks, which combines the original library management systems, realizes automatic borrowing and returning functions of books, lowers the labor intensity of the workers in the library and effectively improves the quality of the library in serving readers. The automatic library system adopts RFID technology, mechanical automation, network and computer technologies. The book management system of the invention comprises shelves, a library integrated management system, books with RFID chips, a self-service borrowing and returning terminal, a management system of closed stacks, a self-service borrowing system, a self-service returning system and an automatic transfer system which realizes that books automatically go in and out of the closed stacks; wherein, the management system of closed stacks operates the information of the database of the closed shelf system to realize information interaction between the library integrated management system and the automatic transfer system, thus finally realizing the automatic management functions of books.

The invention relates to the technical field of traffic control and artificial intelligence and provides a traffic signal self-adaptive control method based on deep reinforcement learning. The method includes the following steps that 1, a traffic signal control agent, a state space S, a motion space A and a return function r are defined; 2, a deep neutral network is pre-trained; 3, the neutral network is trained through a deep reinforcement learning method; 4, traffic signal control is carried out according to the trained deep neutral network. By preprocessing traffic data acquired by magnetic induction, video, an RFID, vehicle internet and the like, low-layer expression of the traffic state containing vehicle position information is obtained; then the traffic state is perceived through a multilayer perceptron of deep learning, and high-layer abstract features of the current traffic state are obtained; on the basis, a proper timing plan is selected according to the high-layer abstract features of the current traffic state through the decision making capacity of reinforcement learning, self-adaptive control of traffic signals is achieved, the vehicle travel time is shortened accordingly, and safe, smooth, orderly and efficient operation of traffic is guaranteed.

The invention is applicable to the field of computer technology and provides a generation method and device for a decision network model of vehicle automatic driving. The method comprises the steps that a sample triad corresponding to each test moment is generated according to vehicle state information collected at each test moment, a preset vehicle movement set and a preset return function, all the sample triads are stored as sample data in a pre-established experience database, and all the sample data is subjected to clustering analysis; training samples are uniformly collected from each cluster obtained after clustering analysis of the experience database according to a preset sampling scale value, and a return accumulated value of each training sample is calculated; and according to all the training samples, the return accumulated value of each training sample and a preset deep learning algorithm, training is performed to obtain the decision network model of vehicle automatic driving. Therefore, the training efficiency of the decision network model and the generalization ability of the decision network model are effectively improved.

The present invention relates to a hinge apparatus for a door, and more particularly, to a separated type hinge apparatus with an automatic return function, in which a restoring device and a damping device are installed separately so that the overall length of the hinge apparatus is reduced, and thus the hinge apparatus may be buried less deeply. A separated type hinge apparatus comprises: an elastic casing; a first elastic member that provides a restoring force; a clutch device which is combined with one end of the first elastic member and controls the elastic force of the first elastic member to remain constant; a shaft penetratively combined through the clutch device in order to transmit a rotational force; and a spring fixing member which is coupled to the other end end of the first elastic member and has a gear groove to control a spring elastic force.

An intelligent control method for vertical recovery of carrier rockets based on deep reinforcement learning is disclosed. A method of autonomous intelligent control for carrier rockets is studied. Theinvention mainly studies how to realize attitude control and path planning for vertical recovery of carrier rockets by using intelligent control. For the aerospace industry, the autonomous intellectualization of spacecrafts is undoubtedly of great significance whether in the saving of labor cost or in the reduction of human errors. A carrier rocket vertical recovery simulation model is established, and a corresponding Markov decision-making process, including a state space, an action space, a state transition equation and a return function, is established. The mapping relationship between environment and agent behavior is fitted by using a neural network, and the neural network is trained so that a carrier rocket can be recovered autonomously and controllably by using the trained neural network. The project not only can provide technical support for the spacecraft orbit intelligent planning technology, but also can provide a simulation and verification platform for attack-defense confrontation between spacecrafts based on deep reinforcement learning.

This invention constitutes a method for taking a set of input parameters specifying a person or family's assets, liabilities, income and expenses and computing the optimal amount of cash to withdrawal from each credit source or asset (including liquidation of physical assets, credit card balance transfers, and use of loan sources) and the allocation of expenses and cash flow across assets and liabilities so as to maximize net worth by a particular date. The method consists of computing marginal and average expense and return functions for each asset and liability to do a no-withdrawal monthly optimization from the start month to the target month on which to maximize net worth, then recursively computing optimal withdrawal amounts for each source of capital on specific months, ultimately finding the optimal withdrawal amount for each source on each of these months and returning the optimal allocation of expenses and the resulting income and cash-flow across assets and liabilities. This invention is being applied to an online environment, where the user inputs the necessary details and optimization takes place on the server.

The present invention is an automatic CD management system based on a closed-shelf jukebox. It realizes the centralized storage, standardized management and reader-specific automatic access of CD, extends the functions of libraries, enables libraries to not only perform automatic storage, borrowing and returning of CD but also realize the groundbreaking self-service borrowing and returning functions of CD and effectively improves library's reader service function. The automatic CD management system adopts RFID technique, mechanical automation, network and computer techniques and includes an integrated library management system, consisting of: a jukebox mechanical structure, a closed-shelf jukebox management system, a self-service CD borrowing system, a self-service CD return system and an automation system. It adopts an automatic CD management system based on a closed-shelf jukebox, completely sets free the work of CD administrator, raises work efficiency and extends the functions of automatic libraries.

The invention discloses a method and device for implementing return to an original interface after interface switching. The method comprises the following steps: when a switching command of entering a preset interface of an application to be switched is received, saving the current interface information of a current foreground application in a history interface information list; switching from a current interface into the preset interface; and returning to a history interface according to a return command received by the preset interface. According to the scheme disclosed by the invention, the history interface information before entrance of the application via a system notification bar is saved, one or more return function items are set on the preset interface, and a user can return to anyone history interface after clicking of one return function item, so that the user can return to the original interface rapidly and conveniently, and the user experience is improved greatly.

The embodiment of the invention provides a device, a system and a method for repairing an underground pipeline of a trenchless pneumatic cracking pipe. The system comprises an existing well and a working pit, wherein the existing well is provided with a pulley group and a winch; the winch is connected with a cracking pipe head through a traction device; the traction device is provided with front and back steering connectors, a pin, an adjusting device and a bolt; and the working pit is externally provided with an air compressor to drive a pipe tampering machine. The cracking pipe head is provided with a tapered head and a tail part for connecting with a replacing pipe, and is provided with a through hole; the middle line of the through hole is overlapped with the middle line of the tapered head; a front columnar through hole is used for mounting the front steering connector; a tail tapered through hole is used for connecting the pipe tampering machine; the cracking pipe head is provided with the tapered head and an expansion cutter is arranged on the outer surface; and the outer diameter of the cracking pipe head formed by the expansion cutter is greater than the inner pipe of a waste pipe to propel the expanded and cracked waste pipe. The whole process ingeniously utilizes the returning function of the pipe tampering machine under the condition that one pit corresponds to one well, and a receiving pit is replaced by the existing well. Therefore, the digging amount can be reduced so that the working efficiency is improved and the cost is saved.

The invention discloses an adaptation method for an android terminal device system setting interface. The adaptation method includes the steps: firstly, binding a Service through a Bind Service by a client, acquiring a device system setting interface instance object and transmitting request data to the Service through a Proxy service; secondly, acquiring Proxy request data through an on Transact of a Binder by the Service; thirdly, calling corresponding function interfaces of the Service through a Stud internal abstract class according to the request data package results; fourthly, returning function interface calling results by the Service, judging whether information meets requirements or not, finishing flow if meeting the requirements, and executing corresponding strategies according to preset strategies if partially meeting the requirements; fifthly, returning request information processing results of the client by the Service, responding to information by the client, and finishing the processing flow. Streaming device upper layer control modules in existing android system settings are unified, and the performance and the expandability of IPTV+OTT (internet protocol television over-the-top) business settings are enhanced.

A compact and lightweight round reclining apparatus having a neutral position return function of automatically returning and securing the backrest to the preset neutral position when the backrest that has been reclined forward is raised is provided. A memory plate in approximately disc form having a center shaft at its center and a spring member for pressing the memory plate so that the memory plate always rotates in one direction intervene between a base plate and a gear plate. A guide portion, which is a long hole in approximately arc form, for restricting the movement of the lock gear outward in the direction of the radius through contact with the protrusion of the above described lock gear is provided inside the disc of the memory plate, and at least one notch is provided in the outer periphery of the memory plate so that an engaging portion provided on the above described gear plate enters into the notch and the memory plate is rotatable relative to the gear plate within the range of the notch.

The invention discloses a gas-liquid separator with a heat-returning function and an application method thereof to an air conditioning unit. The gas-liquid separator with the heat-returning function comprises a superheating passageway and a supercooling passageway, and the superheating passageway is provided with an air inlet pipe used for bringing refrigerant vapour in the gas-liquid separator and an air outlet pipe used for exhausting the refrigerant vapour out of the gas-liquid separator; and the supercooling passageway is provided with one or more than one supercooling pipe arranged in the gas-liquid separator, refrigerant liquid flows through the supercooling pipe(s) so as to carry out heat exchange with the refrigerant vapour which is brought in the gas-liquid separator, thus realizing the superheating of the refrigerant vapour and supercooling of the refrigerant liquid. The gas-liquid separator and the application method provided by the invention can effectively promote the performance and efficiency of refrigerating/heating circulation and can be widely applied to the air conditioning unit.

The invention relates to a method for cognitive radio anti-interference intelligent decision based on reinforcement learning. The method includes the following steps: under the multichannel cognitivescene, a cognitive user takes perceived channel information and transmission power and channel selection information of an interference unit as state information S and actively selects transmission power and channel selection information to be action information a; the ratio of the signal to interference plus noise ratio SINR to the energy consumption E of the cognitive user is defined as an utility function R which serves as a measuring standard of the action selection performance of the cognitive user; in the cognitive decision model, the state information serves as a known condition, the action selection is decided by the cognition user as a body, the utility function serves as an instant return function in the reinforcement learning, a Q-learning reinforcement learning model is established, and the action decision optimized by the cognitive user is obtained.

A nursing bottle having an air returning function comprises a bottle body, a fixing cover, a nipple, a ventilation component, an air conduit, an elastic one-way valve set at a second opening of the air conduit and is located at the interior of the air conduit, a mounting pan located on the second opening of the air conduit to secure the elastic one-way valve. The ventilation component, the air conduit, the elastic one-way valve and the mounting part forms a gas returning device and are located on the interior of the bottle. The present invention reduces the contacting area between the air and the milk, lowering the amount of loss of vitamin. The phenomenon of vomiting milk, choking and flatulence will be omitted since no air bubble is generated.

The invention provides a mobile terminal and a key control method of the mobile terminal. The mobile terminal comprises an improved home key, a fingerprint identification unit and a controller. The fingerprint identification unit is arranged above the improved home key. The improved home key is used for executing a homepage returning function and a power switch function. The fingerprint identification unit is used for determining whether the function of the mobile terminal is unlocked or not according to acquired fingerprint information. The controller is used for determining achievement of the function of the fingerprint identification unit and the function of the improved home key according to the state of the mobile terminal and/or the mode of operating the fingerprint identification unit and the improved home key. By the adoption of the scheme, the terminal device space occupied by the key is decreased, and a user conveniently operates a terminal device.