Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

Uncertainty evaluation at three spatial scales for the NDVI-based VWC estimation method used in the SMAP algorithm

Vegetation water content (VWC) is the key input parameter for a soil moisture retrieval algorithm based on microwave remote sensing, and VWC uncertainty can limit the estimated accuracy of soil moisture. There has been little research on VWC algorithm development and validation in China, and the uncertainty of the VWC estimation method has not been well evaluated. Therefore, the aim of this study is to evaluate the uncertainty of the VWC estimation method used in the SMAP (Soil Moisture Active Passive) algorithm on three spatial scales (the point-scale, 30 m scale, and 1 km scale) for maize in northeast China. Results from three ground experimental datasets showed that the SMAP VWC estimation method was strongly biased with an average overestimation of 1.16 kg m^?2,1.04 kg m^?2, and 1.13 kg m^?2 for the point-scale, 30 m scale, and 1 km scale respectively, and maximum bias occurred in the mid-stage of maize. Also, a new power relationship between NDVI (Normalized Difference Vegetation Index) and VWC was proposed for the 30 m scale based on Sentinel 2 NDVI and field VWC values from 2017 experiment, with respective R² (coefficient of determination) and Root Mean Squared Error (RMSE) values of 0.80 and 0.67 kg m^?2. The results confirmed that this power relationship was still suitable for VWC estimation at the 1 km scale, and it has smaller bias than the original SMAP VWC method. Future work will be carried out to evaluate the applicability of this VWC estimation method over a lager region. It is expected that it can improve the accuracy of soil moisture by providing high precision VWC input parameters.     

健脾消积颗粒对脾胃湿热型功能性消化不良患儿的临床疗效及对脑肠肽水平的影响＊

目的 探讨健脾消积颗粒治疗脾胃湿热型功能性消化不良的临床疗效及其对脑肠肽的影响。方法 按照随机数字表法将2018年2月-2019年2月我院收治的80例功能性消化不良患儿均分为对照组和观察组，对照组给予多潘立酮片治疗，观察组在对照组基础上加用健脾消积颗粒治疗，比较2组治疗效果。结果 治疗后2组主要临床症状积分均显著下降，观察组下降更为明显。观察组总有效率为95%，显著高于对照组的79.5%。观察组治疗后胃电节律异常例数明显低于对照组，治疗后2组胃动素(MTL)显著上升，神经肽Y（NPY）、神经降压素（NT）显著下降，且观察组和对照组相比，差异有统计学意义。2组治疗期间均未发生不良反应及肝肾功能异常。结论 健脾消积颗粒能够明显改善脾胃湿热型功能性消化不良患儿临床症状，改善胃动力水平，调节脑肠肽分泌水平。     

Exosomes from miRNA‐126‐modified endothelial progenitor cells alleviate brain injury and promote functional recovery after stroke

AimsWe previously showed that the protective effects of endothelial progenitor cells (EPCs)‐released exosomes (EPC‐EXs) on endothelium in diabetes. However, whether EPC‐EXs are protective in diabetic ischemic stroke is unknown. Here, we investigated the effects of EPC‐EXs on diabetic stroke mice and tested whether miR‐126 enriched EPC‐EXs (EPC‐EXs^miR126) have enhanced efficacy.MethodsThe db/db mice subjected to ischemic stroke were intravenously administrated with EPC‐EXs 2 hours after ischemic stroke. The infarct volume, cerebral microvascular density (MVD), cerebral blood flow (CBF), neurological function, angiogenesis and neurogenesis, and levels of cleaved caspase‐3, miR‐126, and VEGFR2 were measured on day 2 and 14.ResultsWe found that (a) injected EPC‐EXs merged with brain endothelial cells, neurons, astrocytes, and microglia in the peri‐infarct area; (b) EPC‐EXs^miR126 were more effective than EPC‐EXs in decreasing infarct size and increasing CBF and MVD, and in promoting angiogenesis and neurogenesis as well as neurological functional recovery; (c) These effects were accompanied with downregulated cleaved caspase‐3 on day 2 and vascular endothelial growth factor receptor 2 (VEGFR2) upregulation till day 14.ConclusionOur results indicate that enrichment of miR126 enhanced the therapeutic efficacy of EPC‐EXs on diabetic ischemic stroke by attenuating acute injury and promoting neurological function recovery.