Organization of the state space of a simple recurrent network before and after training on recursive linguistic structures.

Recurrent neural networks are often employed in the cognitive science community to process symbol sequences that represent various natural language structures. The aim is to study possible neural mechanisms of language processing and aid in development of artificial language processing systems. We used data sets containing recursive linguistic structures and trained the Elman simple recurrent network (SRN) for the next-symbol prediction task. Concentrating on neuron activation clusters in the recurrent layer of SRN we investigate the network state space organization before and after training. Given a SRN and a training stream, we construct predictive models, called neural prediction machines, that directly employ the state space dynamics of the network. We demonstrate two important properties of representations of recursive symbol series in the SRN. First, the clusters of recurrent activations emerging before training are meaningful and correspond to Markov prediction contexts. We show that prediction states that naturally arise in the SRN initialized with small random weights approximately correspond to states of Variable Memory Length Markov Models (VLMM) based on individual symbols (i.e. words). Second, we demonstrate that during training, the SRN reorganizes its state space according to word categories and their grammatical subcategories, and the next-symbol prediction is again based on the VLMM strategy. However, after training, the prediction is based on word categories and their grammatical subcategories rather than individual words. Our conclusion holds for small depths of recursions that are comparable to human performances. The methods of SRN training and analysis of its state space introduced in this paper are of a general nature and can be used for investigation of processing of any other symbol time series by means of SRN.     

Risk of basal cell carcinoma in relation to alcohol intake and smoking.

We prospectively investigated whether alcohol intake and smoking affect the risk of basal cell carcinoma (BCC) in subjects from the United States Radiological Technologists (USRT) cohort study. We evaluated 68,371 radiological technologists certified during 1926-1982 who were free of cancer at the time they answered a first questionnaire (1983-1989) and who completed a second questionnaire (1994-1998). The first questionnaire provided baseline information on numerous risk factors, including smoking and alcohol intake, and the second provided self-reported cancer diagnoses. During 698,190 person-years of follow-up, we identified 1,360 cases of BCC: 1,036 in women and 324 in men. Cox proportional hazards regression indicated that the trend in BCC was significantly associated with increased alcohol intake (P for trend = 0.001). Compared with those who reported no alcohol consumption, those who drank <1-2, 3-6, 7-14, and >14 drinks/week had multivariate risks of 1.1 [95% confidence interval (CI), 0.9-1.3], 1.3 (95% CI, 1.1-1.5), 1.4 (95% CI, 1.2-1.7), and 1.0 (95% CI, 0.7-1.6), respectively. We found no clear association between smoking and BCC. This is the second large prospective study to report a significant but nonmonotonic trend in increased risk associated with alcohol consumption.     

The effect of baseline complex ovarian cysts on in vitro fertilization outcome.

STUDY OBJECTIVE: To determine the effect of baseline complex ovarian cysts on controlled ovarian hyperstimulation and in vitro fertilization (IVF) outcome. DESIGN: Retrospective analysis with stratification by stimulation regimen and the presence or absence of surgically documented endometriosis. PATIENTS: Two hundred sixty-one women undergoing IVF from May 1, 1989 to December 31, 1990. MAIN OUTCOME MEASURES: The outcome measures assessed were the maximum estradiol (E2) concentration on day of human chorionic gonadotropin (hCG) administration, number of follicles with maximum diameter greater than or equal to 15 mm, number of follicles with maximum diameter greater than or equal to 12 mm, number of days to hCG administration, number of ampules of human menopausal gonadotropin (hMG) used, number of oocytes retrieved and fertilized, number of embryos transferred, and pregnancy and cycle cancellation rates. RESULTS: There were no statistical differences between cyst and noncyst groups in any of the above parameters of IVF performance. In a single subgroup, patients with endometriosis stimulated with hMG and patients with cysts had significantly lower E2 concentrations than patients without cysts. CONCLUSION: The presence of a complex cyst on a baseline ultrasound does not appear to adversely affect IVF cycle outcomes.     

Serial in vivo MR tracking of magnetically labeled neural spheres transplanted in chronic EAE mice.

Neural stem cell (NSC) transplantation has been shown to attenuate the severity of experimental autoimmune encephalomyelitis (EAE), an animal model of multiple sclerosis (MS). Central to the future success of NSC transplantation in MS is the ability of transplanted cells to migrate from the site of transplantation to relevant foci of disease. Using magnetically labeled mouse neurospheres and human embryonic stem cell (hESC)-derived neurospheres, we applied serial magnetic resonance imaging (MRI) to assess the biodynamics of transplanted cell migration in a chronic mouse EAE model. Magnetic labeling did not affect the in vitro and in vivo characteristics of cells as multipotential precursors. Cell migration occurred along white matter (WM) tracts (especially the corpus callosum (CC), fimbria, and internal capsule), predominantly early in the acute phase of disease, and in an asymmetric manner. The distance of cell migration correlated well with clinical severity of disease and the number of microglia in the WM tracts, supporting the notion that inflammatory signals promote transplanted cell migration. This study shows for the first time that hESC-derived neural precursors also respond to tissue signals in an MS model, similarly to rodent cells. The results are directly relevant for designing and optimizing cell therapies for MS, and achieving a better understanding of in vivo cell dynamics and cell-tissue interactions.     

High-Performance Liquid Chromatographic (HPLC) Assay Using Fluorescence Detection for the Simultaneous Determination of Gallopamil and Norgallopamil in Human Plasma

Gallopamil is a calcium-channel antagonist with reported activity in experimental animals three to five times higher than that of verapamil. An automated high-performance liquid chromatographic (HPLC) method with fluorescence detection is described for the simultaneous determination of gallopamil and its metabolite norgallopamil in plasma. Gallopamil was well resolved from norgallopamil and other metabolites, allowing simultaneous quantitation of both drugs. The detection limit for both gallopamil and norgallopamil was 0.9 ng/ml. This method has been successfully used for the determination of gallopamil and norgallopamil following the administration of 25-, 37.5-, and 50-mg oral doses of drug.     

Female sexual receptivity is defective in juvenile hormone-deficient mutants of theapterous gene ofDrosophila melanogaster

During reproductive maturation of female insects, the acquisition of sexual receptivity is coordinated with ovarian development. Juvenile homone regulates vitellogenesis in the ovaries, but the action of this hormone in the development of sexual behavior is less well-understood. A strain ofDrosophila melanogaster carrying a mutation in theapterous gene(ap ⁴) was known to exhibit arrested vitellogenesis (rescuable by applying exogenous juvenile hormone), sterility of both sexes, and a deficiency of juvenile hormone. In this study, we examined the effects of mutations ofap on female receptivity and its relationship to juvenile hormone. We observed abnormally low female receptivity in homozygousap strains, and heteroallelic combinations ofap mutations exhibited low receptivity. For female receptivity,ap showed no dominance (i.e.,ap/ap ⁺ was intermediate betweenap/ap andap ⁺/ap ⁺). Low receptivity mapped genetically to theap locus. The reduction in female receptivity in these mutants is positively correlated with levels of juvenile hormone synthesized by their corpora allata.This work was supported in part by The Scheinfeld Center for Humans Genetics in the Social Sciences (J.R.), The National Science Foundation (BNS-882 1339 to J.R.), BARD (No. IS-1664-89R to D.S.), The Israel Cancer Research Fund (grant to D.S.), The Rekanati Foundation of Tel Aviv University (grant to D.S.), and The Israeli Fruit Council (award to M.A.)