Conference OrganizersSynergosPBSP

GP&FB Home > Knowledge Base > 2002 Regional Conference on CSROs > CSRO Accountability

2002 Southeast Asia Regional Conference on CSROs
Critical Lessons on CSRO Accountability

Introduction
Dr. Juree Vichit-Vadakan
Chair, Center for Philanthropy and Civil Society, National Institute for Development Administration (CPCS-NIDA)
Vice-President, Thai Fund Foundation

Good morning!

We are here because we are like-minded people. We always want to see society having more justice, peace and equal opportunity for the less well off in the society. We try so many methods toward achieving this. CSRO is one form by which we can try to bring about sustainability and assistance to those who can help themselves. The issue of sustainability and accountability became very important because we are working with multi-partners, with different capacities in helping out societies. The professionalization of the sector becomes an issue that is talked about in the conferences, as well as the governance of non-profit sector, a replica of the western models of governance. Should board be important? What about the indigenous model of accountability? the indigenous pattern of accountability? We accepted there are several patterns of accountability. An example is the savings group in Southern part of Thailand, using the micro-finance system within the community. The basic principle is having internal social sanction.

In the other level of accountability, there are always reasons behind and in that the legitimacy of civil society is important because of issue of public trust. Great importance is put on maintaining it. It may have consequences if it is violated. Our presenters for this session will show how public trust is maintained.

Top

Accountability as a Sector: The PCNC Experience
Ms. Felicidad Soledad
Executive Director
Philippine Council for NGO Certification

Thank you to the organizers. I am happy to be following to Mr. Paiboon Wattanasiritham, as he laid down the principles and context by which I would like to proceed.

In the Philippines, the roles of NGOs were emphasized during the Marcos era. NGOs became useful in the delivery of basic social services. Then came the People Power I & II, all the more the number grew. Government recognition of the sector is enshrined in the 1987 Philippines Constitution, which provided that mechanisms be put up so NGOs and POs be involved in consultation with government especially in delivery of social services and decision making. The Local Government Code of 1991 also mandated Local Government Unit (LGU) to put up mechanisms so local special bodies are included in the pursuit of local autonomy.

With the democratic space and inflow of donor fund particularly during the Pres. Corazon Aquino's term, there arouse alarm among NGOs because of the sudden proliferation of fly-by-night NGOs. Their credibility and legitimacy cannot be accounted for. The CODE-NGO, the largest network of NGOs in the Philippines, came out with a covenant or code of ethics, but this didn't work out because of absence of mandate from the Philippine government.

In 1995, the Comprehensive Tax Reform Program came out, which wanted to take away deductibility of local donations to NGOs. This paved the way for lobbying. The government heeded. The Department of Finance agreed to retain the tax incentives provided that the sector could help in determining legitimacy of NGOs, which deserve the tax incentives. So in response to the emergency situation, six (6) networks took up the challenge. They are the Association of Foundations, the League of Corporate Foundations, PBSP, NCS, Bishop-Businessmen's Conference of the Philippines and CODE-NGO.

The Department of Finance authorized PCNC to certify NGOs to be given tax incentives or be given donee status. With the authorization, the Philippine Bureau of Internal Revenue followed and drafted the implementing rules and regulations (BIR #13-98).

Later, the PCNC Board decided to come up with its vision-mission and objectives. Its vision is: a self-regulating NGO, which is committed to the pursuit of development goals and respected by the government, donors, and international institutions. The PCNC mission reads: to be recognized as pre-eminent institution accrediting entity of Philippine NGO aspiring for a donee institution status and as such to continuously create an environment where NGOs enjoy credibility and confidence of its various stakeholders.

PCNC objectives include:

  • provide mechanism for certification of NGOs that meet minimum established criteria for greater transparency and accountability;
  • encourage private sector participation through the availment of incentives under the comprehensive tax reform program;
  • stimulate and integrate the efforts of non profit sector to level standards of its service delivery; and
  • provide model for greater government-NGO collaboration and complementation.

Programs:

  • NGO certification and training of evaluators
  • Public awareness campaign
  • Research and documentation project
  • Organizational development mechanisms -- certified NGO become members and participate in the governance of the council.
  • Training of evaluators. PCNC trained 960 evaluators across the country; conducted 60 fora; reached 5,1000 individuals/organizations; and evaluated 208 NGOs.

Criteria use for certification:

  • Vision-mission-goals which set the direction of the organization
  • Governance. PCNC sees the Board as important in an organization for setting the directions and types of services to be delivered.
  • Administration -- Staff and the management of staff
  • Program Operation -- to include planning, implementation, monitoring and evaluation system.
  • Financial management. PCNC gives most weight to measure of accountability, transparency and sustainability.
  • Networking

Issues:

  • ensure consistency of compliance with existing policy
  • formulate minimum standards
  • ensure that small NGOs are assisted in meeting the certification requirement. Help desk are put up to ensure this.
  • initiate multi-sectoral dialogue toward defining public good.
  • advocate for policy changes because of government moves e.g. gross income taxation; allowance to all corporations deleting the provisions on donations, which is now in Congress.

Other concerns:

  • other additional services e.g. advocacy work for further tax exemption especially for business.
  • remove perceived bias against small NGOs/POs
  • issue of social relevance as criteria for certification
  • raising public awareness about PCNC
  • improving evaluation process
  • removing barriers to help small NGOs even if they don't want to be certified.
  • improving relation with BIR
  • ensuring stability in volatile political climate
  • keeping true to PCNC mandate. To do the work well before attempting to grow big.

Some insights:

  • PCNC has to balance demand of stakeholders. Demands are different by sector. For example the donor community wants to know if NGOs have certain standards. PCNC on one hand has to live within the mandate given by government and ensure that NGO beneficiaries maintain quality of services. The general public seeks out the values of credibility, transparency through integrity.
  • PCNC is a work in progress. It continues to process and learn. The evaluation has become interesting with some sector like the Philippine Institute of Certified Public Accountants (PICPA) getting interested. So PCNC moves on with renewed hope for better governance, for better Philippines despite the challenges.

Top

The YAPPIKA Experience
Abdi Suryaningati
Executive Director
YAPPIKA, Indonesian Foundation to Strengthen
People's Participation, Partnership and Initiative

YAPPIKA is a civil society alliance for democracy meant to give rise to vision of democratic civil society Indonesia that respect pluralism and development of strong NGOs at local level. It is not merely giving grants but is conducting advocacy, public awareness campaign and creating support systems such as research clearing house, training to support partners to become more accountable professionals, enable them to be independent. Its activities include:

  • grant making
  • advocacy at national level
  • coordinate many coalitions working on different issues that are issues of YAPPIKA. It acts as coordinator of coalition of NGO advocates against laws of foundations in Indonesia. It advocates for another law on procedures to create a bill that assure citizen's participation in every policy formation.

Accountability is the measure of our success toward development results that YAPPIKA is able to deliver. This could be done by:

  • CSO should be able to transfer its V-M-G into concrete results. The Indonesia challenge is: how to measure the achievement of our Vision-Mission.
  • cost effectiveness of results. Have we achieved results at reasonable cost?
  • relevance of results or do the results make sense in terms of conditions and problems they are intended to respond to.
  • sustainability of results. Have the results continues after the termination of support? Is there local ownership of results?

To whom and how are we accountable?

  • To the constituents -- the Indonesian publics. YAPPIKA provides periodic reporting to public and accepts students in its program.
  • To partner NGOs and communities. YAPPIKA involves them in planning programs, annual reflections. YAPPIKA employs the following strategy:
    • Uses monitoring as a 2-way learning system
    • Avoids judgmental reactions to problems. YAPPIKA establishes participatory dispute mechanism to deal with problems.
    • Improves support mechanism within the network and expands the network
    • Quick responses to partners' need and community target
    • Ability to channel the policy advocacy from local to national level
  • To donors -- periodic reporting is done.

Sustainability of what? It is sustainability of impact and maintaining the organization. YAPPIKA can change position and role for as long as the plans are achieved.

Lessons learned:

  • Organizational/management level
    • Satisfaction of services rendered is main indicator of success. If partners are satisfied, resources are not a problem.
    • Ability to adopt to changing situations. Resources and seed capital are needed to continue to define organization roles.
    • Building skills to communicate with the public at large is key to generate resources from other sectors. YAPPIKA embarked on book publishing and events coordination to raise funds. As far as its human resources, YAPPIKA practices rotation of staff, so as not to lose resourceful persons.
    • Need to educate donors and partners as far as capability building, sustainability and accountability in Indonesia are concerned. There is not enough seed capital to move on after the project because donor gives only to implement plans. It is important to have seed capital to move on, and for staff to be able to raise funds within the project period. YAPPIKA lobbied to give time to generate own income.
  • Programmatic
    • Monitoring and evaluation -- YAPPIKA has a large capacity for learning using the 2-way system. This is why YAPPIKA discusses with its partners outcomes and improvements for local development.
    • Need for creative ways to support capacity building for partners
    • Linking successive alternative program at grassroots with advocacy. This is important for Indonesia as most of the problems are on structural level.
    • Well-planned support system. YAPPIKA serves well its partners so it could sell its services more. It offers to broader network facilitation skills and consultancy.

Top

Measuring Results and Impact
Eugenio M. Caccam, Jr.
Associate Director
Philippine Business for Social Progress

The Philippines Business for Social Progress (PBSP) has an established research and evaluation unit. It has established mechanism, which could be viewed as touchstone of PBSP. This is also proof of how important measurement is to the organization, and research has been the lead unit in this. Research though has a very colorful history in PBSP. At one point it was an independent unit. It was lodged at the Operations Unit, thereafter at the Training Unit. This showed how the priorities of information needed were brought to the units needing them most. When there was a need to measure effectiveness of enterprise development or community organization the research and evaluation was lodged at the Operations Unit. When developing curriculum for social development workers' or training institutions, it became part of the Training Unit.

Now as PBSP tried to develop, refine its direction within the 5-years, it tried to develop a corporate planning unit, with strong research and measurement support.

The Purposes of Measurement:

  • To assess the effectiveness as an organization -- is PBSP achieving its objectives?
  • To measure efficiency -- is PBSP doing it at a least possible cost? Are the staff complement effectively used? Is it using financial resources efficiently?
  • To demonstrate the organization's capability to deliver. The research and evaluation will show whether PBSP achieved what it intended to and therefore enhance its ability to deliver.
  • To use the data to learn and build theories. Data tells the accomplishments, improvements that need to be done, pitfalls and problems and thereon PBSP learns from the experience. As an organization that is trail blazing in so many fields, measurements help PBSP to build theories or generalize specific experience to come up with universal ideas, which could be shared with certainty with colleagues in the NGO community.

The Framework:

The PBSP's framework is fairly simple which was developed and adopted from community organizing experiences. It measures inputs and outputs, the effects of efforts against outputs; and the over-all impact of work done versus effects. There have been problems in measuring impact. Attempts to measure net results of impact, and present them to colleagues and acadame bring PBSP humbling experience. When results are presented to PBSP Research Advisory group, they would say it is difficult to say that poverty in the community can be attributed to the PBSP's area development program because who knows the increase in family level of income in communities served is due to member of family working abroad. As much as this could be argued further, the problem of attribution is there.

The problem of attribution is -- how much certainty do one have that benefits claimed are the effects of one's efforts. This is true not only to PBSP but to other organizations as well. It is important to bring this out, because now as a collegial body, CSRO here present could find ways to address this.

In the Philippines, PBSP has been talking with academicians and other sector on this. Actually, social scientists of the University of the Philippines are starting to develop tools to isolate specific outputs of specific inputs to overcome the problem of attribution. While for now, PBSP can't attribute entirely the impact of its work to its efforts, there are initiatives being done to finding ways to isolate variables which could directly be attributed to PBSP's efforts.

Levels of Measurements

Program is a body of knowledge that serves as framework for various activities in various localities, which are called projects. So in measurement, we differentiate these two as distinct levels.

  • Project evaluation level -- questions may include: how may farmers are involved in income generating project? How many trainings conducted? How many participants benefited from the training? How many women are involved? And host of variables.
  • measure of effectiveness and efficiency of program such as the ComRel, ARM, small enterprise or CSR program
  • measure of effectiveness of PBSP -- this could be in the form of program audit, financial audit, or the measure of amount of administrative support given to projects or ratio of staff to projects.

Methods of Measurement

  • Internal
    • review of records using the units' targets. PBSP units set their own indicators or targets each year, and they go back to records mid-way of project or fiscal year to compare accomplishments with targets. Annual accomplishments and the 5-year Plan are also compared.
    • Monitoring of projects by team or external evaluators to look at how projects are progressing, and reports are validated by actual experiences.
    • Regular program audit. An internal unit looks at the performance of units. Financial and processes are examined. At the Board level, the program audit committee, which meets regularly looks at the organization's performance versus its objectives. Added to this is the conduct of annual program reviews, to ensure that targets are realistic enough to be met.
  • External
    • independent evaluators are contracted to do mid-term or end of 5-year reviews. Indicators and milestones are furnished the external evaluators.
    • conduct of "peer reviews," where colleagues from NGO community are invited to assess PBSP projects such as the Area Resource Management (ARM), to determine if services delivered are what are needed, or could strategies still be improved.

Problems:

  • Qualitative results and quantitative measures. Evaluators often are looking for concrete data, which are mostly quantitative, but how should one measure quality of life, improvement in living standards, or improvement in quality of participation. This is something PBSP has to work on.
  • Problem of attribution
  • Static tools that measure continuously changing situations. We utilize Static Newtonian tools that operate in the field of energy which effect is similar to quantitative tools measuring qualitative changes. In the same manner, we have tools for short-term targets, when what needs to be assessed is the long-term impact. Practitioners and people in the academe could study and further refine the tools.
  • Who assesses impact? When do we measure impact? Often the budget for measuring impact comes too close to project termination. Obviously, impact is not the same as simple effects. Impact could be probably felt 15 or 20 years after the project ended. Who will evaluate these impacts then? The organizations or original implementers who understand the project vision and context may not be there anymore to explain what the project is all about. Still the better way is to leave the evaluation to other groups.

Lessons Learned:

  • Need for baseline data. Often at the onset of evaluation, we are confronted with reality that there is nothing to compare results with because of absence of baseline information. To do honest to goodness assessment, baseline data in the strictest term (no manipulation done to support conclusion) must be available.
  • Need for rigor in setting indicators and milestones. Many times, arbitrariness comes into play when setting indicators in the absence of model or rigor in development. Setting indicators depend on how conscientious, intelligent or creative the worker.
  • Clarity and specificity of objectives. Rational means of measuring objectives could be made when everybody understands the objectives.
  • Value of evaluation and its synergistic relation with planning, organizational effectiveness and credibility. This brings the need to develop tools that could overcome problems of attribution, which is the agenda of research in the organization.

Top

Plenary Discussion

Q.: Do you have any idea of alternatives to Newtonian tools?

R. E. Caccam: That is what we are trying to find out. PBSP system of measurement, according to the Research and Advisory Group is subjective and unreliable. The tools developed could not stand the rigors of examination and proof. This is the reason, PBSP is working with the Institute of Strategic Studies to develop the appropriate tools.

Q. With regards to small NGOs that don't get certified or aren't quite ready to even ask for certification, what emphasis does PCNC put on capability building? Also you mentioned about help desk, what exactly does that means?

R. F. Soledad: The help desk is assigned to the network. They vary from one network to another, on how active they have been in promoting certification in the region. At the Associate of Foundation for example, a survey was conducted to determine needs of partners who need to be certified. After running the survey and the need was established, capability-building activities were conducted to help partners that are weak.

Among small NGOs, PCNC have quite larger number. They get certified easier than big ones. If an organization is good in financial management almost immediately they will pass. The rest of the evaluation areas balanced off somehow. Those that lack the criteria are deferred and given 6 months to comply with the requirement.

Q. Who gives accreditation to PCNC?

R. F. Soledad: In the Philippines, when we say accreditation, it really means accreditation of program, while PCNC certifies institutions as donee institution. In similar manner, PCNC underwent a process where the Department of Finance investigated the organization's systems and procedures, and see if they are above and over the mandate or authority given us through the Memorandum of Agreement and the Revenue regulations.

Return to Proceedings of the 2002 Regional Conference on CSROs

Synergos LogoKnowledge Resources