5. Tracking Performance
Performance versus Plan
Addressing Government Priorities
Corporate Performance Indicators – Performance against Five Year Plan
Performance Target Performance in 1998/99 Involvement of end users in all aspects of R&D investment program Our end users are rural industries. During 1998/99 we put maximum focus on our communication efforts and making our operations/output more transparent and consumer friendly. Corporation communications expenditure in 1998/99 was $766,975, up from $658,144 in 1997/98. We issued 15 short reports and nearly all our final reports are accessible on our Website. Most of our programs now have newsletters issued to key stakeholders. A RIRDC Communications Plan was developed and issued in May 1999. Translation of research outputs into industry benefits. Our strong policy on accessibility to research outputs means that industry has the opportunity of building new technologies into future investments. An example of a product designed to integrate/facilitate is the publication The New Rural Industries – Financial Indicators which builds on our earlier work The New Rural Industries – A Handbook for Farmers and Investors. Review of programs on a four-year rolling evaluation basis Projects in Program 3 were reviewed in 1998/99. All but two of the reviewed projects were found to have provided a rate of return in excess of the strategic plan performance target of 25 per cent. The equivalent range for the benefit–cost ratios was 0.8 to 120 (discount rate of 5 per cent) and again all but two were greater than the performance target of 10. The information on projects with rates of return lower than the target rates is being used by the sub-programs to support future funding decision considerations. Expansion of the gross value of production of new and emerging industries supported by RIRDC programs Most of our new industries exporting to Asia were adversely affected by developments in that region in 1998/99 . Most of these markets are now recovering. The market for 'organics' is expected to grow strongly with the debate over GM foods. Tea tree oil prices are expected remain under pressure because of the sharp expansion in output. Our latest farm-gate GVP estimates for RIRDC related industries in Programs 1 and 2 (1997/98) are as follows:
Sub-program Area Farm-gate 1997/1998
GVP ($ million)Anticipated short-term
GVP trendAsian Foods 89.0 increase Cashews 0.17 increase slowly Deer 5.4 Stable Essential Oils & Plant Extracts 36.5 Increase Organic Produce 122.5 Increase Rare Natural (Animal) Fibres 2.3 stable/increase Tea Tree Oil 16.2 stable/increase Wildflowers & Native Plants 46.0 Increase
Performance Target Performance in 1998/99 Strong partnerships with stakeholders in new, emerging and established industry programs Our relationships in industry specific programs continue to be underpinned by our industry advisory committees, active information distribution mechanisms and by a close relationship between representative industry bodies and the Corporation. Strong partnership with stakeholders in Future Farming Systems program This is a difficult area for the Corporation. Program 4 is cross sectoral in nature and it is difficult for the Corporation to identify key stakeholders. Our primary relationship continues to be with the National Farmers' Federation, on behalf of all sector interests. Progressive reduction of corporate and administrative costs to keep these below 6 per cent of total budget expenditure Our 1998/99 Budget was premised on a 'corporate' and 'administration' vote of 5.9 per cent of anticipated expenditure. Actual expenditure on these two items in 1998/99 was 7 per cent of total expenditure. This increase was due to an underspend in Sub-programs 2.2, 3.1 and 3.2. RIRDC’s 1999/2000 Annual Operational Plan has been structured for 'corporate' and 'administration' expenditure to be 5.8 per cent of outlays.
Addressing Government Priorities
Stakeholders in any investment activity are interested to know what the rates of return are to this investment. In recognition of this, RIRDC identified in its Corporate Strategic Plan quantitative rate-of-return targets as one of its performance indicators.
Rolling Four Year Evaluation
Public good R&D, the focus of RIRDC’s programs, is one of the more complex types of investment and therefore it is difficult to quantify rates of return. Despite this RIRDC has developed a systematic program for regular quantification of the returns to the funds it invests on behalf of the Government and industries. The program involves evaluating a sample of completed projects in one of the four major R&D programs each year.This four year cycle commenced in 1997/98 with the ‘Emerging Industries’ program, continued in 1998/99 with the ‘Established Industries program and in subsequent years will cover ‘New Industries’ and ‘Future Agricultural Systems’. In addition to this well-defined program, evaluations will often be undertaken as part of the decision-support requirements specific to sub-programs.
The Emerging Industries evaluation in 1997/98 and the Established Industries one in 1998/99 adopted the approach outlined in the Guidelines for Economic Evaluation of R&D developed for RIRDC and GRDC. This approach includes two stages: first, development of a qualitative overview of all completed projects and, second, undertaking a detailed evaluation of a sample of these projects.
First stage – qualitative overview
Up to 1998/99, 431 projects had been completed in the Established Industries program. The first stage of the evaluation developed a systematic overview of all projects and preliminary assessment of their impact. This overview has proven very useful in looking at the focus and direction of each of the sub-programs.Second stage – detailed evaluation
In the second stage, 14 of the 431 projects were chosen for detailed evaluation. These 14 projects were selected to ensure at least one from each sub-program was evaluated. In addition, they were selected with the evaluation cost in mind given the relatively limited budget. The sample cannot therefore be considered random.The results indicate internal rates of return to the investment ranging from:
Rates versus performance targets
- 1 percent for a project testing the effectiveness of progestagens in maintaining pregnancy in mares:
- 18 percent for the development of techniques for the prevention and contr9l of American foulbrood in bees:
- 26 percent for the development of new temperate pasture seeds varieties;
- 93 percent for an assessment of the digestible amino acid content of feed for poultry;
- 117 percent for lucerne hay management technology extension;
- 189 per cent for rice harvester efficiency research; and
- over 200 per cent for research on diets for moulted laying hens.
All but two projects were found to have provided a rate of return in excess of the strategic plan performance target of 25 per cent. The equivalent range for the benefit–cost ratios was 0.8 to 120 (discount rate of 5 per cent) and again all but two were greater than the performance target of 10.
The results of the analyses have been published in two detailed reports, one covering each stage of the evaluation process:
- Impact Evaluation of RIRDC's Established Industries Program: An Overview of all Projects (Stage 1) Pub no. 99/90
Phone 02 6272 4819 for a copy.
- Impact Evaluation of RIRDC's Established Industries Program: Specific Project Evaluations (Stage 2). Pub no. 99/91
By comparison, most projects in the Emerging Industries evaluation in 1997/98 were found to have provided a rate of return in excess of the 20 per cent target. The equivalent range for the benefit–cost ratios was 0 to 11.8 (discount rate of 8 per cent) and the majority were greater than the performance target of 5. (Results are detailed in our report Benefit-Cost Analysis of RIRDC’s Emerging Industries Program, Pub no. 98/104, $10. Phone 02 6272 4819 for a copy).
Assisting future funding decisions
The information on projects with rates of return lower than the target rates is being used by the sub- programs to support future funding decision considerations. In addition during the year further detailed evaluations of projects in the Asian Foods sub-program were commenced. These will be used, in early 1999/2000, as an input to the development of a five year plan for this program.