Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

Uncertainty evaluation at three spatial scales for the NDVI-based VWC estimation method used in the SMAP algorithm

Vegetation water content (VWC) is the key input parameter for a soil moisture retrieval algorithm based on microwave remote sensing, and VWC uncertainty can limit the estimated accuracy of soil moisture. There has been little research on VWC algorithm development and validation in China, and the uncertainty of the VWC estimation method has not been well evaluated. Therefore, the aim of this study is to evaluate the uncertainty of the VWC estimation method used in the SMAP (Soil Moisture Active Passive) algorithm on three spatial scales (the point-scale, 30 m scale, and 1 km scale) for maize in northeast China. Results from three ground experimental datasets showed that the SMAP VWC estimation method was strongly biased with an average overestimation of 1.16 kg m^?2,1.04 kg m^?2, and 1.13 kg m^?2 for the point-scale, 30 m scale, and 1 km scale respectively, and maximum bias occurred in the mid-stage of maize. Also, a new power relationship between NDVI (Normalized Difference Vegetation Index) and VWC was proposed for the 30 m scale based on Sentinel 2 NDVI and field VWC values from 2017 experiment, with respective R² (coefficient of determination) and Root Mean Squared Error (RMSE) values of 0.80 and 0.67 kg m^?2. The results confirmed that this power relationship was still suitable for VWC estimation at the 1 km scale, and it has smaller bias than the original SMAP VWC method. Future work will be carried out to evaluate the applicability of this VWC estimation method over a lager region. It is expected that it can improve the accuracy of soil moisture by providing high precision VWC input parameters.     

Association Study of Matrix Metalloproteinases Gene Polymorphisms with Susceptibility to Rheumatoid Arthritis: A Meta-Analysis

Objective: Association of matrix metalloproteinases (MMPs) gene polymorphisms with rheumatoid arthritis is controversial. We conduct a meta-analysis to clarify this dispute.

Methods: We systematically searched the electronic PUBMED, EMBASE and CNKI databases for research articles about MMPs (MMP-1, MMP-2, MMP-3, MMP-9) gene polymorphisms and rheumatoid arthritis (RA) up to January 2015. According to the heterogeneity, fixed-effects or random-effects models were used to calculate crude odds ratios (ORs) and 95% confidence intervals (95% CIs).

Results: A total of 11 articles involving 2143 cases and 2049 controls were included in this meta-analysis. Overall, no significant associations were observed between MMP-1-1607 1G/2G polymorphism and RA. Stratification by ethnicity, no significant associations were observed in Caucasian populations. Similarly, no significant associations were observed between MMP-3-1171 5A/6A, MMP-9-1562 C/T polymorphisms and RA in overall and Caucasian populations, respectively. However, a weak association was found between MMP-2-1306 C/T polymorphism and RA (C vs. T, OR?=?0.813, 95%CI?=?0.694–0.953, p?=?0.010) in overall populations.

Conclusions: The present meta-analysis suggests that MMP-1-1607 1G/2G, MMP-3-1171 5A/6A, MMP-9-1562 C/T polymorphisms are not associated with the susceptibility of RA, but MMP-2 -1306 C/T is weakly associated with susceptibility to RA. Further studies with more sample size are needed for definitive conclusions.     

血清胱抑素C和尿微量白蛋白联合检测在人类免疫缺陷病毒感染者肾功能损伤检测中的应用价值

目的评估血肌酐和尿常规的常规检测基础上联合血清胱抑素C和尿微量白蛋白检测在人类免疫缺陷病毒（HIV）感染者肾功能损伤检测中的应用价值。 方法以2019年2～5月于首都医科大学附属北京地坛医院感染一科住院的169例HIV感染者为研究对象，完善其尿常规、尿微量白蛋白、血肌酐、血清胱抑素C检测；分析尿蛋白及尿微量白蛋白的阳性检出率及其差异，血肌酐升高及血清胱抑素C升高的比例及其差异。计算应用替诺福韦酯（TDF）及合并丙型肝炎、高血压、糖尿病、肿瘤的肾功能损伤的相对危险度。 结果169例HIV感染者中尿常规示尿蛋白阳性者5例（3.0%），尿微量白蛋白升高者17例（10.1%），两者阳性检出率差异具有统计学意义（χ² = 5.9、P = 0.007）。血肌酐升高者10例（5.9%），血清胱抑素C升高者20例（11.8%），两者阳性检出率差异具有统计学意义（χ² = 3.0、P = 0.042）。在尿常规和血肌酐检测的基础上联合检测尿微量白蛋白和血清胱抑素C的总体阳性检出率为49例（30.0%）。CD4⁺ T淋巴细胞计数< 200个/μl与≥ 200个/μl组患者血清胱抑素C水平分别为0.94（0.83，1.05）mg/L、0.85（0.77，0.95）mg/L，差异具有统计学意义（Z =-3.02、P = 0.003）。应用TDF及合并丙型肝炎、高血压、糖尿病、肿瘤的肾功能损伤的相对危险度分别为1.1、1.5、1.9、2.2和1.4。 结论HIV感染者中，单纯以尿常规为依据评估有无蛋白尿，以血肌酐水平为依据评估肾小球滤过功能会低估肾功能损伤的患病率。在常规检测血肌酐和尿常规的基础上联合检测血清胱抑素C和尿微量白蛋白在提高HIV感染者肾功能损伤检出率方面具有重要的应用价值。低CD4⁺ T淋巴细胞计数、应用TDF及合并丙型肝炎、高血压、糖尿病、肿瘤均为肾功能损伤的危险因素。     

中日友好医院分型股骨头坏死腓骨植入治疗的三维有限元分析

文题释义：股骨头坏死中日友好医院分型的有限元分析：根据李子荣等提出的中日友好医院分型，建立股骨头坏死三维模型，分为 M型(内侧型)、C型(中央型)和 L型(外侧型)，其中 L型包括L1型(次外侧型)、L2型(极外侧型)和 L3型(全头型)。通过对建立的模型进行有限元分析，为该分型的保髋治疗提供了一定力学依据，显示外侧柱的存留是精准预防塌陷的重要因素，为进一步实现个体化治疗提供力学基础。 腓骨支撑坏死股骨头保髋手术：是对于早中期股骨头坏死需要保留股骨头患者进行的一种手术方式。首先需对股骨头进行髓芯减压，清除一定坏死骨，空腔填塞松质骨(髂骨为主)，打压结实后植入腓骨(异体或自体)支撑，给坏死区的提供力学支撑及生物学修复，预防股骨头进一步坏死及塌陷。 背景：研究报道股骨头坏死的保髋疗效与外侧柱存留密切相关，中日友好医院分型是根据三柱结构确立的，对股骨头塌陷的预测准确性高。 目的：建立股骨头坏死中日友好医院分型各分型仿真的三维有限元模型，通过有限元分析各分型腓骨植入的力学变化，探讨外侧柱存留对保髋疗效的意义，为该分型的塌陷精准预测提供基础。 方法：建立正常股骨头、中日友好医院分型(M型、C型、L1型、L2型、L3型)股骨头坏死及其腓骨植入3组11种三维有限元模型，运用ANSYS软件进行有限元分析计算，观察各组模型的最大应力值、最大位移值及股骨头内部载荷传递模式。 结果与结论：①坏死组位移最大，应变最大，且因坏死分型不同而位移不同，位移变化如下：M型相似文献   

顶天立地服务需求 注重内涵创建一流——首都医科大学建校60周年教育教学与人才培养成果回顾

首都医科大学通过60年辛勤耕耘、精益求精，秉承“顶天立地”的人才培养理念，为社会培养了大批高水平的学术型与应用型医药卫生人才。回顾学校60年来本专科教育、全科医学教育、国际教育、研究生教育的人才培养成果，以总结经验并鼓舞全体首医人进一步求真务实、凝心聚力、积极进取、追求卓越，努力将学校建设成为国际一流的研究型医科大学。     

试论异常毒性作为药品质量控制指标的合理性

异常毒性最初是一种确保复杂成分制剂生产工艺一致性及安全性的辅助检测手段，后来成为针对外源性毒性污染物的通用安全性检测项，曾在世界范围内被各国药典收载。由于该检测与药品质量、安全性之间的关联性受到质疑，各国药典逐渐在各论及通则中删除该检测项，目前仅《中国药典》保留异常毒性。由于该检测存在设定限值难以统一、给药体积及给药剂量不合理、结果易受干扰且缺乏明确的判定标准等试验原理及设计上的缺陷，导致其试验结果没有实际参考意义。基于对历史数据的回顾分析，国际监管机构及卫生组织对异常毒性有了更为科学的认知，并已逐渐形成统一的监管共识：严格的生产控制措施和有效的质量检测手段，比异常毒性检测更为重要；异常毒性检测结果或与产品质量及污染不具相关性；在异常毒性检查中使用大量动物不符合动物福利和“3R”原则。本文从科学角度试论异常毒性作为药品质量控制指标的合理性，并总结异常毒性修订的科学原则，希望能为我国监管机构、制药行业修订异常毒性相关内容提供思考角度。