Optimal tracking control for non-zero-sum games of linear discrete-time systems via off-policy reinforcement learning

In this article, a model-free off-policy reinforcement learning algorithm is applied to address the optimal tracking problem based on multiplayer non-zero-sum games for discrete-time linear systems. In contrast to the traditional method and the policy iteration method for solving the optimal tracking problems, the proposed algorithm operates with the system data rather than the knowledge of the system dynamics. For performing the proposed algorithm, an auxiliary augmented system is constructed via assembling the original system and the reference trajectory while a discount factor is introduced into the performance indexes. It is analyzed that the solutions of the proposed algorithm converge to the Nash equilibrium and the result is not influenced by the probing noise. Two simulations are presented to verify the feasibility and effectiveness of the proposed algorithm.     

Optimal control of a revenue management system with dynamic pricing facing linear demand

This paper considers a dynamic pricing problem over a finite horizon where demand for a product is a time‐varying linear function of price. It is assumed that at the start of the horizon there is a fixed amount of the product available. The decision problem is to determine the optimal price at each time period in order to maximize the total revenue generated from the sale of the product. In order to obtain structural results we formulate the decision problem as an optimal control problem and solve it using Pontryagin's principle. For those problems which are not easily solvable when formulated as an optimal control problem, we present a simple convergent algorithm based on Pontryagin's principle that involves solving a sequence of very small quadratic programming (QP) problems. We also consider the case where the initial inventory of the product is a decision variable. We then analyse the two‐product version of the problem where the linear demand functions are defined in the sense of Bertrand and we again solve the problem using Pontryagin's principle. A special case of the optimal control problem is solved by transforming it into a linear complementarity problem. For the two‐product problem we again present a simple algorithm that involves solving a sequence of small QP problems and also consider the case where the initial inventory levels are decision variables. Copyright © 2006 John Wiley & Sons, Ltd.     

Atrial Flutter with 1:1 Atrioventricular Conduction Caused by Propafenone

We describe a case of 1:1 atrial flutter in a patient with coronary disease taking propafenone. In atrial flutter, the atrial rate is usually about 300 beciis/min with 2:1 AV conduction and a ventricular rate of 150 beats/min. Class IA antiarrhythmic drugs, especially quinidine and disopyramide, may cause 1:1 AV response because they reduce atrial rate and are vagolytic. However, propafenone is a Class IC agent and has no anticholinergic properties, and the occurrence of 1:1 AV conduction at a rate of about 250 beats/min is an important side, effect that, although uncommon, should be recognized.     

纸本与数字的交互：手机阅读的最佳效果

随着全球3G商用的推进和拥有大容量存储能力的智能终端的日益普及,手机正逐步演变成为一个新型的数字阅读终端。利用手机进行电子阅读的全新模式,正以前所未有的普及速度冲击着人们的阅读习惯。而这趋势也逐渐为"阅读"进行重新的定义。对于每一个读者而言,在这样一个信息化的时代里,手机阅读和纸本阅读的交互使用、取长补短,才是获得最佳阅读效果的最有效方式。     

Second‐degree atrioventricular block (Mobitz Type I) in an adolescent with anorexia nervosa: Intrinsic or acquired conduction abnormality

Anorexia nervosa (AN) can cause both functional and structural cardiac complications, including a variety of different conduction abnormalities. This is the first case report of symptomatic diurnal second‐degree atrioventricular (AV) block (Mobitz Type I) in an adolescent with AN. We present a 12‐year‐old girl with AN, restrictor sub‐type who reported cardiac symptoms during weight gain, at the time of the initial diagnosis of AV block. Second‐degree AV block (Mobitz Type I) is discussed as a possible complication of the AN, as well as being an intrinsic conduction system disease. © 2009 by Wiley Periodicals, Inc. Int J Eat Disord 2009     

ITERATIVE DYNAMIC PROGRAMMING FOR MINIMUM ENERGY CONTROL PROBLEMS WITH TIME DELAY

This paper presents the use of iterative dynamic programming employing exact penalty functions for minimum energy control problems. We show that exact continuously non-differentiable penalty functions are superior to continuously differentiable penalty functions in terms of satisfying final state constraints. We also demonstrate that the choice of an appropriate penalty function factor depends on the relative size of the time delay with respect to the final time and on the expected value of the energy consumption. A quadratic approximation (QA) of the delayed variables is much better than a linear approximation (LA) of the same for relatively large time delays. The QA improves the rate of convergence and avoids the formation of ‘kinks‘. A more general way of selecting appropriate penalty function factors is given and the results obtained using four illustrative examples of varying complexity corroborate the efficacy of the method.     

Pleiotropy in Coffin-Lowry syndrome: Sensorineural hearing deficit and premature tooth loss as early manifestations

We report on 7 patients (6 M, 1 F) with Coffin-Lowry syndrome who have a sensorineural hearing deficit in addition to developmental delay and characteristic facial changes. One of the patients also had a history of premature exfoliation of primary teeth. These are previously unappreciated clinical signs that may aid in the early diagnosis of Coffin-Lowry syndrome. Early diagnosis and recognition of a hearing deficit in the patient can lead to the use of hearing aids to help the patient achieve his or her full potential. These “;new”; clinical manifestations expand the phenotype of Coffin-Lowry syndrome and constitute an additional indication of pleiotropy. © 1993 Wiley-Liss, Inc.     

房室结逆向传导电生理特点的观察

目的研究房室结逆向传导的电生理特点。方法分析在我院行电生理检查和／或射频消融的成年患者中电生理资料比较完整的300例患者的房室结逆传电生理特点。结果射频消融术后有161例（54％）有房室结逆传。有逆传患者的前传功能要好于无逆传的患者，对于术后存在室房逆传的患者，逆传功能均明显差于前传功能。射频消融术后有28例（17％）经房室结逆传最早激动冠状静脉窦口，其逆传功能较最早激动希氏束电图的病例相比要差，而两者的前传功能差异无统计学意义。结论射频消融术后54％的患者存在房室结逆传，可能是正常人群中室房逆传的真实反映。有室房逆传患者的房室结前传功能优于无室房逆传者，也优于其本身的逆传功能。房室结逆传冲动进入心房可能存在两条不同的通路。