Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

Assessment of the Antimetastatic Activity of Extracts of Filipedula ulmaria Depending on Extractant

Pharmaceutical Chemistry Journal - Three extracts were produced from the above-ground part of the meadowsweet Filipendula ulmaria (L.) Maxim. using water, 40% ethanol, and 70% ethanol. Comparative...     

eTEP inferior access with tailored retromuscular dissection for small to mid-sized umbilical hernia repair with or without inguinal hernia: early experience

Hernia - The minimally invasive surgical repair of combined inguinal and ventral hernias often requires shifting from one approach or plane to another. The traditional enhanced-view totally...     

Hypocholesterolaemic mechanism of bitter melon aqueous extracts via inhibition of pancreatic cholesterol esterase and reduction of cholesterol micellar solubility

This study investigated the hypocholesterolaemic effects of bitter melon aqueous extracts (BMAE) in vitro, the inhibitory effects of BMAE on pancreatic cholesterol esterase (CEase) and incorporation of cholesterol into micelles were investigated. BMAE decreased the in vitro micellar solubility of cholesterol in a dose-dependent manner. The conformation of CEase was investigated by means of circular dichroism (CD) and fluorescence. The result revealed the decrease of α-helix contents, increase of β-sheet and exposure of aromatic amino acid residuals. The incorporation of cholesterol into micelles was inhibited by BMAE. A complex was observed by transmission electron microscopy (TEM), which indicated interaction between cholesterol and BMAE. The result revealed that BMAE can play a role in decreased intestinal cholesterol absorption via inhibition of CEase, and of micelle formation.