Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

Clinical Diagnostic Implications of Body Fluid MiRNA in Oral Squamous Cell Carcinoma: A Meta-Analysis

Oral cancer, predominantly oral squamous cell carcinoma (OSCC), is one of the most leading causes of cancers worldwide. Due to a low 5-year survival rate, highly effective methods for the early detection of OSCC are totally needed. MicroRNAs (miRNAs), as promising biomarkers, can bring insights into tumorigenesis of oral cancers. However, studies on the accuracy of miRNAs detection in OSCC have inconsistent conclusions, leading us to conduct this meta-analysis. The aim of this study was to systematically review the articles investigating the diagnostic value of miRNAs in OSCC.The PubMed, Embase, Chinese National Knowledge Infrastructure (CNKI), Web of Science were searched (updated to June 11th, 2015) to identify all articles evaluating the diagnostic yield of miRNAs for OSCC. The pooled sensitivity, specificity, and other diagnostic parameters were used to assess the performance of miRNAs assays on OSCC detection. Statistical analysis was conducted by employing the R software.The present meta-analysis comprised 23 studies from 10 articles, including 598 OSCC patients and 320 healthy individuals, available for analysis. The summary receiver operator characteristic (SROC) curve was plotted. Meanwhile, the pooled diagnostic parameters and the area under curve (AUC) were calculated based on all included studies. The pooled diagnostic parameters calculated from all 23 studies were as follows: pooled sensitivity of 0.759 (95% CI: 0.701–0.809), pooled specificity of 0.773 (95% CI: 0.713–0.823) and AUC of 0.832, which indicates a relatively high diagnostic accuracy of miRNAs in differentiating OSCC patients from healthy controls. Meanwhile, In addition, subgroup analyses were conducted to access the heterogeneity between studies, which is based on specimen (serum/plasma/blood/saliva/ tissue) and ethnicity (Asian/Caucasian).In summary, our meta-analysis suggests that miRNAs might be used in noninvasive screening tests for OSCC, which needs further large-scale studies to be validated.     

Comparison between a new platelet count drop method PL-11, light transmission aggregometry,VerifyNow aspirin system and thromboelastography for monitoring short-term aspirin effects in healthy individuals

Platelet function has been described by many laboratory assays, and PL-11 is a new point-of-care platelet function analyzer based on platelet count drop method, which counts platelet before and after the addition of agonists in the citrated whole blood samples. The present study sought to compare PL-11 with other three major more established assays, light transmission aggregometry (LTA), VerifyNow? aspirin system and thromboelastography (TEG), for monitoring the short-term aspirin responses in healthy individuals. Ten healthy young men took 100?mg/d aspirin for 3-day treatment. Platelet function was measured via PL-11, LTA, VerifyNow and TEG, respectively. The blood samples were collected at baseline, 2 hour, 1 day during the aspirin treatment and 1 day, 5?±?1 days, 8?±?1 days after the aspirin withdrawal. Moreover, 90 additional healthy subjects were recruited to establish a reference range for PL-11. Platelet function of healthy subjects decreased significantly 2 hours after 100?mg/d aspirin intake and began to recover during 4–6 days after the aspirin withdrawal. Correlations between methods were PL-11 vs. LTA (r?=?0.614, p?<?0.01); PL-11 vs. VerifyNow (r?=?0.829, p?<?0.01); PL-11 vs. TEG (r?=?0.697, p?<?0.001). There was no significant bias between PL-11 and LTA at baseline (bias?=?1.94%, p?=?0.804) using Bland-Altman analysis, while the data of PL-11 were significantly higher than LTA (bias?=?24.02%, p?<?0.001) during the aspirin therapy. The reference range for PL-11 in healthy young individuals was from 66.8 to 90.5% (95%CI). When aspirin low-responsiveness was defined as LTA?>?20%, the cut-off values for each method were, respectively: PL-11?>?50%, VerifyNow?>?533 ARU, TEG?>?60.2%. The results of different platelet function assays were uninterchangeable for monitoring aspirin response and correlations among them were also varied. Correlations among PL-11 and other three major assays suggested the ability of PL-11 to assess the treatment effects of aspirin. But a large cohort study is needed to confirm the cut-off value of aspirin response detected by PL-11.     

Amyloid PET imaging in cardiac amyloidosis: a pilot study using 18F-flutemetamol positron emission tomography

Annals of Nuclear Medicine - Cardiac amyloidosis is a rare disease characterized by amyloid heart deposits and is usually a part of systemic amyloidosis, in relation to systemic light chain (AL)...     

Mimengosides J and K: two new neuroprotective triterpenoids from the fruits of Buddleja lindleyana

Two new 11-methoxyl substituted triterpenoids, named as mimengosides J (1) and K (2), along with seven known compounds, were isolated from the fruits of Buddleja lindleyana. Their structures were elucidated on the basis of spectroscopic analysis. In addition, the new ones were evaluated for protective effects against damage of SH-SY5Y cells induced by 1-methyl-4-phenylpyridinium ion (MPP⁺) and the results indicated that those may be one of the candidate compositions of Buddleja lindleyana for the treatment of neurodegenerative disease.

     

Outcomes of Early Decompressive Craniectomy Versus Conventional Medical Management After Severe Traumatic Brain Injury: A Systematic Review and Meta-Analysis

This meta-analysis examined whether early decompressive craniectomy (DC) can improve control of intracranial pressure (ICP) and mortality in patients with traumatic brain injury (TBI).Medline, Cochrane, EMBASE, and Google Scholar databases were searched until May 14, 2015, using the following terms: traumatic brain injury, refractory intracranial hypertension, high intracranial pressure, craniectomy, standard care, and medical management. Randomized controlled trials in which patients with TBI received DC and non-DC medical treatments were included.Of the 84 articles identified, 8 studies were selected for review, with 3 randomized controlled trials s having a total of 256 patients (123 DCs, 133 non-DCs) included in the meta-analysis. Patients receiving DC had a significantly greater reduction of ICP and shorter hospital stay. They also seemed to have lower odds of death than patients receiving only medical management, but the P value did not reach significance (pooled odds ratio 0.531, 95% confidence interval 0.209–1.350, Z = 1.95, P = 0.183) with respect to the effect on overall mortality; a separate analysis of 3 retrospective studies yielded a similar result.Whereas DC might effectively reduce ICP and shorten hospital stay in patients with TBI, its effect in decreasing mortality has not reached statistical significance.     

Implant wear induces inflammation, but not osteoclastic bone resorption, in RANK(-/-) mice.

Signaling of RANK (receptor activator of nuclear factor kappa B) through its ligand RANKL appears critical in osteolysis associated with aseptic loosening (AL). The purpose of this study was to investigate the role of RANK in a murine osteolysis model developed in RANK knockout (RANK(-/-)) mice. Ultra high molecular weight polyethylene (UHMWPE) debris was introduced into established air pouches on RANK(-/-) mice, followed by implantation of calvaria bone from syngeneic littermates. Wild type C57BL/6 (RANK(+/+)) mice injected with either UHMWPE or saline alone were included in this study. Pouch tissues were collected 14 days after UHMWPE inoculation for molecular and histology analysis. Results showed that UHMWPE stimulation induced strong pouch tissue inflammation in RANK(-/-) mice, as manifested by inflammatory cellular infiltration, pouch tissue proliferation, and increased gene expression of IL-1beta, TNFalpha, and RANKL. However, the UHMWPE-induced inflammation in RANK(-/-) mice was not associated with the osteoclastic bone resorption observed in RANK(+/+) mice. In RANK(+/+) mice subjected to UHMWPE stimulation, a large number of TRAP(+) cells were found on the implanted bone surface, where active osteoclastic bone resorption was observed. No TRAP(+) cells were found in UHMWPE-containing pouch tissues of RANK(-/-) mice. Consistent with the lack of osteoclastic activity shown by TRAP staining, no significant UHMWPE particle-induced bone resorption was found in RANK(-/-) mice. A well preserved bone collagen content (Van Gieson staining) and normal plateau surface contour [microcomputed tomography (microCT)] of implanted bone was observed in RANK(-/-) mice subjected to UHMWPE stimulation. In conclusion, this study provides the evidence that UHMWPE particles induce strong inflammatory responses, but not associated with osteoclastic bone resorption in RANK(-/-) mice. This indicates that RANK signaling is essential for UHMWPE particle-induced osteoclastic bone resorption, but does not participate in UHMWPE particle-induced inflammatory response.