The Role of Major Donors in Health Aid to the Democratic People's Republic of Korea

We investigated the major trends in health aid financing in the Democratic People''s Republic of Korea (DPRK) by identifying the primary donor organizations and examining several data sources to track overall health aid trends. We collected gross disbursements from bilateral donor countries and international organizations toward the DPRK according to specific health sectors by using the Organization for Economic Cooperation and Development creditor reporting system database and the United Nations Office for the Coordination of Humanitarian Affairs financial tracking service database. We analyzed sources of health aid to the DPRK from the Republic of Korea (ROK) using the official records from the ROK''s Ministry of Unification. We identified the ROK, United Nations Children''s Fund (UNICEF), World Health Organization (WHO), United Nations Population Fund (UNFPA), and The Global Fund to Fight AIDS, Tuberculosis and Malaria (GFATM) as the major donor entities not only according to their level of health aid expenditures but also their growing roles within the health sector of the DPRK. We found that health aid from the ROK is comprised of funding from the Inter-Korean Cooperation Fund, private organizations, local governments, and South Korean branches of international organizations such as WHO and UNICEF. We also distinguished medical equipment aid from developmental aid to show that the majority of health aid from the ROK was developmental aid. This study highlights the valuable role of the ROK in the flow of health aid to the DPRK, especially in light of the DPRK''s precarious international status. Although global health aid from many international organizations has decreased, organizations such as GFATM and UNFPA continue to maintain their focus on reproductive health and infectious diseases.     

Triangulating health expenditure estimates from different data sources in developing countries

This article deals with the accuracy of statistical records used for political decision making and international comparative analysis. In developing countries, even major macroeconomic indicators can include data inadequacies and methodological differences in data generation between statistical agencies. Existing data show that total health expenditure as a percentage of GDP is about 50% lower in Pakistan than in other low-income countries (LIC). To determine whether these results reflect the actual situation in Pakistan or whether they are due to statistical error, Pakistan produced National Health Accounts (NHA) for the first time in 2009 to assess health spending in 2005-6. Improved NHA estimates are also being made for 2007-8, which will be based on the following: public expenditure data published with time lags; survey results for 2007-8; and multivariate analyses of data from 2010 and 2011 surveys on health-specific out-of-pocket (OOP) expenditure, healthcare providers, non-profit institutions and census data on autonomous bodies and large hospitals. Since these data are not yet available, a best estimate of health expenditure has to be made to support policy decision making and to provide a point of comparison for future NHA results. Health expenditure data are available from different data sources and estimates have been made by applying different methods, leading to a range of health spending estimates. As a result of this diversity of estimates and data, each with its own inaccuracies or gaps, there was a clear need to triangulate the available information and to identify a best possible estimate. This article compares estimates of household health expenditure from different sources, such as the Household Integrated Economic Survey, the Family Budget Survey and National Accounts (NA). The analysis shows that health expenditure figures for Pakistan have been underestimated by both WHO and the NHA. An adjusted estimate shows OOP spending to be twice as high as previously thought. Previous per capita total health expenditure estimates ranged from $US16 to $US19. The revised estimate showed per capita total health expenditure to be $US33, based on NA data. This puts Pakistan in a different position in international comparisons, with health expenditure exceeding the level of India ($US32.5) and the average of all LIC ($US24.5). Methodological differences in estimating expenditure and the multiple and conflicting estimates might cause stakeholders to make potentially adverse or even erroneous policy decisions on the allocation of resources. Because policy makers make decisions based on the estimates provided, the provision of a best estimate, made following a review of the advantages and limitations of existing sources and methods, is key.     

Financing health services in Poland: new evidence on private expenditures

This paper estimates total expenditure on health care in Poland in 1994 and provides new evidence on high levels of private spending on health care. The analysis shows that health care expenditures in Poland are higher than has usually been maintained, and are comparable with the prevailing levels in many other European countries. Private expenditure on health is a significant proportion of total expenditure on health, and in particular on financing outpatient care. Available evidence indicates that informal payments made by patients to physicians contribute as much as double of the physician's salary, and thus form an important source of earnings for physicians. This situation of high private expenditures on health care and informal payments to physicians is likely to be true of other transitional economies of Central and Eastern Europe as well. One policy implication that emerges is these transitional economies face a big challenge in managing existing resources, as opposed to finding new resources, in the health sector more effectively to meet the health care needs of their population. The paper highlights the need for better understanding of the current availability and distribution of resources in the health sector and their directions of flow, in both public and private sectors, and suggests using tools such as National Health Accounts to track and monitor changes in the financing of the health care system. © 1998 John Wiley & Sons, Ltd.     

Future directions for the national health accounts

Over the past 15 years, the Health Care Financing Administration (HCFA) has engaged in ongoing efforts to improve the methodology and data collection processes used to develop the national health accounts (NHA) estimates of national health expenditures (NHE). In March 1998, HCFA initiated a third conference to explore possible improvements or useful extensions to the current NHA projects. This article summarizes the issues discussed at the conference, provides an overview of three commissioned papers on future directions for the NHA that were presented, and summarizes suggestions made by participants regarding future directions for the accounts.     

Developing countries' health expenditure information: what exists and what is needed?

In the past decade, the scarcity of financial resources for the health sector has increasingly led countries to take stock of national health resources used, review allocation patterns, assess the efficiency of existing resource use, and study health financing options. The primary difficulties in undertaking these analyses have been 1) the lack of information on health expenditures and 2) not using existing information to improve the planning and management of health sector resources. The principle sources of available health expenditure information are reported by organizations such as the World Bank, WHO, UNICEF and OECD. Special studies and non-routine information are a second major source of information. This existing data has a number of difficulties, including being sporadic, inconsistency, inclusion of only national level public expenditure, high opportunity and maintenance costs, quantitative and qualitative differences across countries, and validity and interpretability problems. Reliable health expenditure data would be useful not only for in-country, national purposes, but also for cross-national comparisons and for development agencies. Country uses of health expenditure data include policy formulation and planning and management, while international uses would facilitate examination of cross-national comparisons, reviews of existing programmes and identification of funding priorities. Collaborative efforts between countries and international development agencies, as well as between agencies, are needed to establish guidelines for health expenditure data sets. This development must ensure that the resulting information is of direct benefit to countries, as well as to agencies. Results of such collaborative efforts may include a set of standardized methodologies and tools; standardized national health accounts for developing countries; and training to enhance national capabilities to actively use the information. The opportunities for such collaboration are unique with the issuance of the World Development Report 1993, to build on this work in clearly identifying what is needed and proposing a standardized data set and the tools necessary to regularly and economically gather such data.     

中越卫生合作需求与策略

目的:通过分析越南的卫生合作需求,提出中越卫生合作的策略建议。方法:通过二手资料收集和定性访谈,收集健康相关可持续发展目标(SDG)数据、越南卫生发展规划、国际组织对越援助以及中越卫生合作现况。结果:越南以SDG为基础,规划优先发展领域。国际组织对越南卫生发展起到重要作用,但随着越南的经济发展,部分组织开始撤资。中越目前主要在多边合作框架下开展卫生合作,合作内容涉及卫生安全、卫生发展和医学创新。结论:中越卫生合作应根据两国卫生发展水平、卫生合作基础及国家发展规划决定合作的领域和方式。两国的卫生合作应随双方的发展进程和需求变化而动态调整。除了中越两国的资源,其他国际资源的有效利用也有助于卫生合作的推进。     

The influence of health sector reform and external assistance in Burkina Faso

Despite health reform and increasing public investment in the health sector, utilization of curative health services, immunization coverage and patient satisfaction with the public health care system are steadily decreasing in Burkina Faso. It seems that the health care system itself is "ill". This paper examines the major symptoms associated with this illness. The central thesis suggests that any further improvement of health care performance in Burkina Faso will be subject to profound central reform in the area of human resources and financial management of the sector. Such a broad reform package cannot be achieved through the current project approach, but a sector-wide approach (SWAp) does not seem to be realistic at the present time. Policy discussions at a level higher than the Ministry of Health could be beneficial for achieving better donor coordination and increasing the commitment of the Ministry of Health to a sector-wide approach. Health sector reform issues and priorities and the role of international cooperation are reviewed and discussed.     

National Health Accounts development: lessons from Thailand

National Health Accounts (NHA) are an important tool to demonstrate how a country's health resources are spent, on what services, and who pays for them. NHA are used by policy-makers for monitoring health expenditure patterns; policy instruments to re-orientate the pattern can then be further introduced. The National Economic and Social Development Board (NESDB) of Thailand produces aggregate health expenditure data but its estimation methods have several limitations. This has led to the research and development of an NHA prototype in 1994, through an agreed definition of health expenditure and methodology, in consultation with peer and other stakeholders. This is an initiative by local researchers without external support, with an emphasis on putting the system into place. It involves two steps: firstly, the flow of funds from ultimate sources of finance to financing agencies; and secondly, the use of funds by financing agencies. Five ultimate sources and 12 financing agencies (seven public and five private) were identified. Use of consumption expenditures was listed under four main categories and 32 sub-categories. Using 1994 figures, we estimated a total health expenditure of 128,305.11 million Baht; 84.07% consumption and 15.93% capital formation. Of total consumption expenditure, 36.14% was spent on purchasing care from public providers, with 32.35% on private providers, 5.93% on administration and 9.65% on all other public health programmes. Public sources of finance were responsible for 48.79% and private 51.21% of the total 1994 health expenditure. Total health expenditure accounted for 3.56% of GDP (consumption expenditure at 3.00% of GDP and capital formation at 0.57% of GDP). The NESDB consumption expenditure estimate in 1994 was 180,516 million Baht or 5.01% of GDP, of which private sources were dominant (82.17%) and public sources played a minor role (17.83%). The discrepancy of consumption expenditure between the two estimates is 2.01% of GDP. There is also a large difference in the public and private proportion of consumption expenses, at 46:54 in NHA and 18:82 in NESDB. Future NHA sustainable development is proposed. Firstly, we need more accurate aggregate and disaggregated data, especially from households, who take the lion's share of total expenditure, based on amended questionnaires in the National Statistical Office Household Socio-Economic Survey. Secondly, partnership building with NESDB and other financing agencies is needed in the further development of the financial information system to suit the biennial NHA report. Thirdly, expenditures need breaking down into ambulatory and inpatient care for monitoring and the proper introduction of policy instruments. We also suggest that in a pluralistic health care system, the breakdown of spending on public and private providers is important. Finally, a sustainable NHA development and utilization of NHA for planning and policy development is the prime objective. International comparisons through collaborative efforts in standardizing definition and methodology will be a useful by-product when developing countries are able to sustain their NHA reports.     

Flows of financial resources for health research and development in Brazil, 2000-2002

OBJECTIVE: To map and measure the flows of financial resources for health research and development in Brazil for the years 2000-2002. METHODS: After adapting the methodology developed for the Center for Economic Policy Research, data were collected on the sources and uses of resources for health research and development. RESULTS: The annual average value of resources apportioned to health research and development was approximately 573 million US dollars. The public sector as a whole invested 417.3 million US dollars and the health department 51.1 million US dollars. Expressed in percentages, the public sector invested 4.15% of the health department's budget although the Ministry of Health assigned only 0.3% of its budget to health research in the country. The universities and the research institutes are the main users of the resources allocated to health research and development, receiving 91.6% of the total public spending, while the private sector receives a small share of around 0.69% of the total. The private sector invested 135.6 million US dollars per year, and the international organizations 20.1 million US dollars per year. CONCLUSION: Besides measuring the financial resources made available for health research and development, the results allowed the filling of gaps in national information; the identification of the flows of applied financial resources; and the testing and adaptation of the proposed methodology, generating information suitable for international comparisons.     

基于柯布-道格拉斯生产函数的我国卫生资源实证分析

卫生资源配置是形成卫生生产能力的基石，它包括增量的有效配置和存量的合理调整。作者基于柯布一道格拉斯生产函数的计算方法和分析原理，结合我国卫生领域的历史数据，采用最小二乘法和方差分析等方法拟合出卫生资源与产出能力相关的多元线性回归模型，实证分析我国卫生资源配置现状。结果表明，我国卫生人力资源投入不足，其对产出的贡献率偏低，而且卫生资源配置总体上规模效益递减。     

Player or referee? Aid effectiveness and the governance of health policy development: Lessons from Viet Nam

Viet Nam is one of the brightest stars in the constellation of developing countries. Its remarkable achievements in reducing poverty and improving health and education outcomes are well known, and as a result it has enjoyed generous aid programmes. Viet Nam also has a reputation for taking a strong lead in disciplining its donors and pushing for more efficient and effective forms of aid delivery, both at home and internationally.

This article discusses how efforts to improve the effectiveness of aid intersect with policy-making processes in the health sector. It presents a quantitative review of health aid flows in Viet Nam and a qualitative analysis of the aid environment using event analysis, participant observation and key informant interviews.

The analysis reveals a complex and dynamic web of incentives influencing the implementation of the aid effectiveness agenda in the health sector. There are contradictory forces within the Ministry of Health, within government as a whole, within the donor community and between donors and government. Analytical frameworks drawn from the study of policy networks and governance can help explain these tensions. They suggest that governance of health aid in Viet Nam is characterised by multiple, overlapping ‘policy networks’ which cut across the traditional donor–government divide. The principles of aid effectiveness make sense for some of these communities, but for others they are irrational and may lead to a loss of influence and resources. However, sustained engagement combined with the building of strategic coalitions can overcome individual and institutional incentives.

This article suggests that aid reform efforts should be understood not as a technocratic agenda but as a political process with all the associated tensions, perverse incentives and challenges. Partners thus need to recognise – and find new ways of making sense of – the complexity of forces affecting aid delivery.     

Improved estimates of Belgian private health expenditure can give important lessons to other OECD countries

OECD Health Data are a well-known source for detailed information about health expenditure. These data enable us to analyze health policy issues over time and in comparison with other countries. However, current official Belgian estimates of private expenditure (as published in the OECD Health Data) have proven not to be reliable. We distinguish four potential major sources of problems with estimating private health spending: interpretation of definitions, formulation of assumptions, missing or incomplete data and incorrect data. Using alternative sources of billing information, we have reached more accurate estimates of private and out-of-pocket expenditure. For Belgium we found differences of more than 100% between our estimates and the official Belgian estimates of private health expenditure (as published in the OECD Health Data). For instance, according to OECD Health Data private expenditure on hospitals in Belgium amounts to €3.1 billion, while according to our alternative calculations these expenses represent only €1.1 billion. Total private expenditure differs only 1%, but this is a mere coincidence. This exercise may be of interest to other OECD countries looking to improve their estimates of private expenditure on health.     

Health workforce monitoring in Portugal: Does it support strategic planning and policy-making?

The quality of the available information on Human Resources for Health (HRH) is critical to planning strategically the future workforce needs. This article aims to assess HRH monitoring in Portugal: the data availability, comparability and quality.A scoping review of academic literature was conducted, which included 76 empirical studies. The content analysis was guided by the World Health Organization ‘AAAQ framework’ that covers availability, accessibility, acceptability and quality of the health workforce.The analysis identified three types of problems affecting HRH monitoring in Portugal: insufficient data, the non-use of available data, and the general lack of analysis of the HRH situation. As a consequence, the data availability, comparability and quality is poor, and therefore HRH monitoring in Portugal makes strategic planning of the future health workforce difficult.Recommendations to improve HRH monitoring include: 1) make data collection aligned with the standardized indicators and guidelines by the Joint Eurostat-OECD-World Health Organization questionnaire on Non-Monetary Health Care Statistics; 2) cover the whole workforce, which includes professions, sectors and services; 3) create a mechanism of permanent monitoring and analysis of HRH at the country level.     

Inter-state disparities in health care and financial burden on the poor in India

Over five decades of independence, India has made rapid strides in various sectors. However, its performance in social sectors and particularly the healthcare sector has not been too rosy. Being the State's responsibility the healthcare has traditionally been influenced by individual State's budgetary allocation. Consequently inter-state disparity in availability and utilization of health services and health manpower are distinctly marked. This has implications for achievement of Health for All for the nation as a whole. Keeping in view the significance of studying inter-state variations in healthcare, this study focuses on the performance of healthcare sector in 15 major States in India. This is attempted through a comparative analysis of various parameters depicting availability of health services, their utilization and health outcomes. Our analysis depicts the prevalence of considerable inequity favoring high income group of States. In terms of healthcare resources, for instance, it indicates that the high income States hold a superior position in terms of: per capita government expenditure on medical and public health, total number of hospitals and dispensaries, per capita availability of beds in hospitals and dispensaries and health manpower in rural and urban areas. These parameters of availability have an impact on utilization levels and health outcomes in these States. A comparative profile of high and low income States as well as middle and low income States, both in rural and urban areas, reaffirms a greater financial burden in availing treatment at OPD and inpatient in low income States. In line with the higher financial burden and low per capita health expenditure, the health outcome indicators also depict a disconcerting situation in regard to low income States. These States are marked by lower life expectancy and higher incidence of diseases as well as high mortality rates. In this regard, demand as well as supply side constraints are observed which restrain the optimum utilization of existing health services. Among the low income States the main constraints on the demand side include illiteracy, malnutrition, and lack of infrastructure in accessing the facilities. Certain state specific supply side factors add significantly to under-utilization in low income States. In some of the States, however, corrective actions have been initiated to overcome the problem of the quality and low utilization of health facilities. In due course of time, it is likely that proper implementation of these measures may result in improved utilization level of existing health services, which may be useful to improve health status indicators. Nonetheless, overcoming the current levels of regional disparities in healthcare across three income groups of States may also require additional resources. The latter could be mobilized through assistance of donor agencies and appropriate mix of social and private insurance. Ultimately mitigating the problem of regional disparities in healthcare and protecting the poor and vulnerable from financial burden may require establishing and maintaining proper linkages between socio-economic development and healthcare planning.     

Perspectives from the global poliomyelitis eradication initiative

Ten years after the year 2000 target was set by the World Health Assembly, the global poliomyelitis eradication effort has made significant progress towards that goal. The success of the initiative is built on political commitment within the endemic countries. A partnership of international organizations and donor countries works to support the work of the countries. Interagency coordinating committees are used to ensure that all country needs are met and to avoid duplication of donor effort. Private sector support has greatly expanded the resources available at both the national and international level. At the programmatic level, rapid implementation of surveillance is the key to success, but the difficulty of building effective surveillance programmes is often underestimated. Mass immunization campaigns must be carefully planned with resources mobilized well in advance. Programme strategies should be simple, clear and concise. While improvements in strategy and technology should be continuously sought, changes should be introduced only after careful consideration. Careful consideration should be given in the planning phases of a disease control initiative on how the initiative can be used to support other health initiatives.     

The international community and the reconstruction of health care in South Eastern Europe

Today, with the aid of the international community [European Union (EU), World Bank (WB), World Health Organisation (WHO), United Nations Children's Fund (UNICEF), nongovernmental organisations (NGOs), Global Fund (GF), Stability Pact, etc.] the ministries of health in transitional countries in the South Eastern Europe (SEE) region are in the process of expanding the capacities and skills of the health workforce in order to achieve successful health care reform and accomplish necessary steps for EU integration. The aim of this paper is to review international community support to reconstruction of the health care in SEE countries, with main focus on the EU and WB donors and projects. Review was done on the basis of existing donor reports, Internet search (search of official Web sites and electronic databases, check of references from selected documents, and use of a generic Internet search engine) and authors’ experience from different health projects. The governments of SEE countries, in order to create an effective and efficient health system, overcame a period of transition and soon or later became ready for the process of EU integration, and began working on the following issues: rehabilitation, reconstruction and equipping of health facilities; developing a health strategy and policy documents; legislation and financing framework; building institutional, human resource and management capacity; health care sector reform; support to public health development and restructuring of the pharmaceutical sector. In many SEE countries, the capacity of the Ministry of Health and Health Insurance Fund was strengthened, and policy and strategy documents were drafted to guide reorganisation and reorientation of health care services. The public health system was strengthened. A family medicine model was introduced and developed in most countries. Development of enabling legislation mostly followed proposed changes in the health system. Although progress on several important fronts in achieving transition and progress in the rehabilitation health sector in SEE countries is significant, a lot remains to be done. Experience in some countries can be used to stimulate, motivate and encourage professionals throughout the civil service to grasp with both hands the opportunities for positive change.     

卫生研发活动经费流向调查指标与监测体系

在提高卫生研发活动资源配置效率日益成为全球卫生科技发展热点的情况下,掌握研发活动经费流向情况是改善资源配置效率的重要前提。以往关于卫生研发经费流向情况的信息十分缺乏,系统地追踪全球卫生研发经费流向情况是一个长期的目标。本就卫生研发活动经费调查在世界范围内所进行的情况,以及实施调查涉及的概念、分类指标进行概述。同时,就我国卫生研发经费调查的现状进行分析,并对建立我国卫生研发活动监测体系给予政策建议。     

Stakeholder perceptions of aid coordination implementation in the Zambian health sector

In this study, we analysed stakeholder perceptions of the process of implementing the coordination of health-sector aid in Zambia, Africa. The aim of coordination of health aid is to increase the effectiveness of health systems and to ensure that donors comply with national priorities. With increases in the number of donors involved and resources available for health aid globally, the attention devoted to coordination worldwide has risen. While the theoretical basis of coordination has been relatively well-explored, less research has been carried out on the practicalities of how such coordination is to be implemented. In our study, we focused on potential differences between the views of the stakeholders, both government and donors, on the systems by which health aid is coordinated.A qualitative case study was conducted comprising interviews with government and donor stakeholders in the health sector, as well as document review and observations of meetings. Results suggested that stakeholders are generally satisfied with the implementation of health-sector aid coordination in Zambia. However, there were differences in perceptions of the level of coordination of plans and agreements, which can be attributed to difficulties in harmonizing and aligning organizational requirements with the Zambian health-sector plans. In order to achieve the aims of the Paris Declaration; to increase harmonization, alignment and ownership – resources from donors must be better coordinated in the health sector planning process. This requires careful consideration of contextual constraints surrounding each donor.     

Good governance and sustainability: a case study from Pakistan

OBJECTIVE: On the basis of a case study in Pakistan, the paper argues that good governance, characterized by transparency, accountability and meaningful community participation, plays a critical role in the sustainability of donor-funded health systems projects in the public health sector. METHODS: The Family Health Project (FHP) (1992-1999), funded by the World Bank, has been used as a case study. Critical analysis of secondary data mainly obtained from the Department of Health (DoH) in the province of Sindh in Pakistan is the major tool used for the study. Data from other sources including the World Bank have also been used. RESULTS: The analysis reveals that the existing health care system could not fully absorb and sustain major "sociopolitical" thrusts of the project, meaningful community participation and "democratic" decision-making processes being the most important ones. The hierarchical structure and management process made it difficult to produce a sense of ownership of the project among all managers and the rank and file staff. The Provincial Health Development Center (PHDC) and District Health Development Centers (DHDCs) established by the FHP did not receive adequate financial and political support from DoH and the Ministry of Health to have much control of the project at the local level. Consequently, these Centers largely failed to institutionalize a continuing training program for district level health officials/professionals. Due to lack of political support, the District Health Management Teams (DHMTs) could not be institutionalized. Community participation in the DHMTs was symbolic rather than forceful. Improved coordination among all stakeholders, more stable and competent leadership, more meaningful community participation, greater devolution of project management to the district level, and better management of resources would have resulted in more effective and efficient implementation of the project. Based on these findings, the paper introduces a Sustainable Management Approach (SMA) as a tool that can be used to ensure the sustainability of health systems projects, particularly those funded by international organizations in developing countries. CONCLUSIONS: Good governance and a conducive organizational culture are important prerequisites for incorporating any new project within an existing system. This includes prior consensus building among all stakeholders, a meaningful and inclusive participatory planning, implementation and evaluation process involving communities, political commitment, and the identification and use of appropriate leadership for project management.     

Analysing the hindrance to the use of information and technology for improving efficiency of health care delivery system in Tanzania

Information Technologies (IT) have been described as offering tremendous opportunity to improve health services as well as in meeting broader developmental goals which have an impact on health. Through the use of IT, healthcare sectors can potentially plan, monitor and evaluate health services as well as communicate more effectively within and across organizational hierarchies. However, a number of studies suggest several hindrances where the use of IT to bring critical change in the health sector of Tanzania has been problematic. Despite the lack of appropriate use of the existing IT resources in the health sector, donors and government have continued helping the health sector to acquire up-to-date IT resources while however placing little emphasis on long term IT training, data management and effective utilization of information resulting into wasted of such resources hence little improvement in health services delivery. This study is based on the Health Information System Programme (HISP), an action research project aimed at improving health information system in developing countries with the use of IT and information for local action. Under the project, the district health information software which is customizable, open source and freely distributed has been implemented in five pilot districts in Tanzania. The lessons learned from HISP project and other levels of the health sector in general indicate the lack of skills for data interpretation and utilisation, policy guidelines on information and human capacity building as well as a lack of flexible system.