Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

中日友好医院分型股骨头坏死腓骨植入治疗的三维有限元分析

文题释义：股骨头坏死中日友好医院分型的有限元分析：根据李子荣等提出的中日友好医院分型，建立股骨头坏死三维模型，分为 M型(内侧型)、C型(中央型)和 L型(外侧型)，其中 L型包括L1型(次外侧型)、L2型(极外侧型)和 L3型(全头型)。通过对建立的模型进行有限元分析，为该分型的保髋治疗提供了一定力学依据，显示外侧柱的存留是精准预防塌陷的重要因素，为进一步实现个体化治疗提供力学基础。 腓骨支撑坏死股骨头保髋手术：是对于早中期股骨头坏死需要保留股骨头患者进行的一种手术方式。首先需对股骨头进行髓芯减压，清除一定坏死骨，空腔填塞松质骨(髂骨为主)，打压结实后植入腓骨(异体或自体)支撑，给坏死区的提供力学支撑及生物学修复，预防股骨头进一步坏死及塌陷。 背景：研究报道股骨头坏死的保髋疗效与外侧柱存留密切相关，中日友好医院分型是根据三柱结构确立的，对股骨头塌陷的预测准确性高。 目的：建立股骨头坏死中日友好医院分型各分型仿真的三维有限元模型，通过有限元分析各分型腓骨植入的力学变化，探讨外侧柱存留对保髋疗效的意义，为该分型的塌陷精准预测提供基础。 方法：建立正常股骨头、中日友好医院分型(M型、C型、L1型、L2型、L3型)股骨头坏死及其腓骨植入3组11种三维有限元模型，运用ANSYS软件进行有限元分析计算，观察各组模型的最大应力值、最大位移值及股骨头内部载荷传递模式。 结果与结论：①坏死组位移最大，应变最大，且因坏死分型不同而位移不同，位移变化如下：M型相似文献   

Lysophosphatidylcholine‐induced cytotoxicity and protection by heparin in mouse brain bEND.3 endothelial cells

A pathological feature in atherosclerosis is the dysfunction and death of vascular endothelial cells (EC). Oxidized low‐density lipoprotein (LDL), known to accumulate in the atherosclerotic arterial walls, impairs endothelium‐dependent relaxation and causes EC apoptosis. A major bioactive ingredient of the oxidized LDL is lysophosphatidylcholine (LPC), which at higher concentrations causes apoptosis and necrosis in various EC. There is hitherto no report on LPC‐induced cytotoxicity in brain EC. In this work, we found that LPC caused cytosolic Ca²⁺ overload, mitochondrial membrane potential decrease, p38 activation, caspase 3 activation and eventually apoptotic death in mouse cerebral bEND.3 EC. In contrast to reported reactive oxygen species (ROS) generation by LPC in other EC, LPC did not trigger ROS formation in bEND.3 cells. Pharmacological inhibition of p38 alleviated LPC‐inflicted cell death. We examined whether heparin could be cytoprotective: although it could not suppress LPC‐triggered Ca²⁺ signal, p38 activation and mitochondrial membrane potential drop, it did suppress LPC‐induced caspase 3 activation and alleviate LPC‐inflicted cytotoxicity. Our data suggest LPC apoptotic death mechanisms in bEND.3 might involve mitochondrial membrane potential decrease and p38 activation. Heparin is protective against LPC cytotoxicity and might intervene steps between mitochondrial membrane potential drop/p38 activation and caspase 3 activation.