Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

凉血通瘀方干预高血压大鼠急性脑出血模型对脑组织中差异miRNA表达的影响＊

目的 研究凉血通瘀方对高血压大鼠急性脑出血模型脑组织miRNA表达的影响，对差异表达的miRNA靶基因进行分析，探索凉血通瘀方可能的药效机制。方法 将自发性高血压大鼠随机分成对照组（B）和实验组（C）。适应性饲养一周后，C组灌胃凉血通瘀方，B组灌胃等体积生理盐水，连续5天，每天1次。构建脑出血模型后收集脑组织，借助全转录组测序技术获得miRNA表达量，与miRBase数据库比对获取已知miRNA，使用miRDeep2预测新miRNA。差异分析软件为DESeq2，筛选阈值为|log₂FC| ≥1 并且P <0.05。对显著差异表达的miRNA进行靶基因预测，对靶基因进行GO功能、KEGG通路富集和PPI网络分析。结果 实验组和对照组对比，共发现21个显著差异表达的miRNA，上调有9个，下调有12个，共预测得到1243个有统计学意义的靶基因。GO富集分析发现，生物过程中突触囊泡分泌的调节、神经递质分泌的调节和神经递质运输的调节占前三位，神经元投射终点、全膜、质膜区域和细胞投射则是主要的细胞成分。分子功能分别为小GTPase绑定、底物特异性跨膜转运蛋白活性和离子跨膜转运体活性。通路分析结果显示，靶基因在癌证通路、pI3K-Akt信号通路、人类乳头瘤病毒感染、神经活性配体-受体相互作用和MAPK通路等分布广泛。采用STRING网站和Cytoscape软件，根据MCC算法筛选出ADRA2C、CASR、CCL28、CCR1、DRD2、GNAT3、GRM2、DYNC1LI1、GABBR1、GNAI1等核心靶基因。结论 凉血通瘀方对脑出血急性期鼠脑组织内miRNA的表达有重要影响；显著差异表达miRNAs可能通过靶向核心基因调控凉血通瘀方干预急性脑出血的病理过程及预后。     

Pinealectomy interferes with the circadian clock genes expression in white adipose tissue

Melatonin, the main hormone produced by the pineal gland, is secreted in a circadian manner (24‐hr period), and its oscillation influences several circadian biological rhythms, such as the regulation of clock genes expression (chronobiotic effect) and the modulation of several endocrine functions in peripheral tissues. Assuming that the circadian synchronization of clock genes can play a role in the regulation of energy metabolism and it is influenced by melatonin, our study was designed to assess possible alterations as a consequence of melatonin absence on the circadian expression of clock genes in the epididymal adipose tissue of male Wistar rats and the possible metabolic repercussions to this tissue. Our data show that pinealectomy indeed has impacts on molecular events: it abolishes the daily pattern of the expression of Clock, Per2, and Cry1 clock genes and Pparγ expression, significantly increases the amplitude of daily expression of Rev‐erbα, and affects the pattern of and impairs adipokine production, leading to a decrease in leptin levels. However, regarding some metabolic aspects of adipocyte functions, such as its ability to synthesize triacylglycerols from glucose along 24 hr, was not compromised by pinealectomy, although the daily profile of the lipogenic enzymes expression (ATP‐citrate lyase, malic enzyme, fatty acid synthase, and glucose‐6‐phosphate dehydrogenase) was abolished in pinealectomized animals.