Evaluation of Risbang Strengthening Program 2015-2019 for Development of Renstra Strengthening Structure 2020-2024

In accordance with the mandate of the Presidential Regulation of the Republic of Indonesia Number 13 the Year 2015, the Ministry of Research, Technology, and Higher Education has the task of holding government affairs in the fields of research, technology, and higher education to assist the President in organizing state government. To be able to carry out its duties and functions, the Ministry of Research, Technology and Higher Education establishes the organization’s vision, mission, goals and strategic objectives. In order to carry out the assigned tasks and functions, the Directorate General of Research and Development Strengthening has established a vision, mission and strategic plan. In the 2015-2019 period, the Directorate General of Research and Development Strengthening was established as a Research and Development Strengthening program. To measure the performance achievements in the scope of the Directorate General of Research and Development Strengthening, several strategic objectives have been set out that describe the conditions that must be achieved in 2019 which is one year left. In preparing the new strategic plan, it is necessary first to evaluate the previous program. The result Analysis based on the performance of Universities obtained a sequence of focus areas with high indexed publications are Social Humanities, Cultural Arts & Education; followed by ICT; Health and Medicine Technology. While the least is Defense and Security. Thus, if the focus area will be prioritized, then all grant schemes under the Ministry of Research, Technology and Higher Education can be directed to the focus areas whose publications are indexed on many Scopus. In general, respondents who were very satisfied/satisfied with the performance of the Directorate General of Research and Development Strengthening were Regional R&D, KL R&D, and LPNK while the respondents who are less/dissatisfied are the public and foreign researchers.


Background
In accordance with the mandate of the Presidential Regulation of the Republic of Indonesia Number 13 the Year 2015, the Ministry of Research, Technology, and Higher Education has the task of holding government affairs in the fields of research, technology, and higher education to assist the President in organizing state government.
In In order to achieve the vision and mission, the vision and mission are formulated in a more directed and operational form in the formulation of strategic objectives (strategic goals) that must be achieved are: a. Increased relevance, quantity, and quality of higher education for excellence nation's competitiveness; b. Increasing innovation for the excellence of the nation's competitiveness; and c. The realization of effective, efficient, deep integrity governance order for bureaucratic reform. From the description above, it is necessary to evaluate the 2015-2019 Research and Development strengthening program. These results will be used in the context of developing Renstra for strengthening research and development 2019-2014. The evaluation needs to be carried out in order that the strategic planning strengthening for the next period of research synergies with the previous period. The aim of this study is that the Strategic Plan for Strengthening Research and Development for the 2020-2024 period be more directed and sustainable.

Target.
In order to achieve the objectives, they must be formulated in a more directed and operational form in the form of strategic goals that must be achieved, which are: a. Increased relevance, quantity, and quality of higher education for the excellence of the nation's competitiveness; b. Increasing innovation for the excellence of the nation's competitiveness; and c. The realization of effective, efficient, integrated governance in the context of bureaucratic reform.

Novelty and technological breakthrough
The novelty and technological breakthrough of this research is the evaluation of all the 2015-2019 strengthening Research and Development programs, especially in terms of quality. So far, the measure of success has only been measured in terms of quantity. Research and development strengthening programs that are often reported or delivered are only limited to the amount that has been achieved. The data that must be collected is the data output above for 5 years, starting from 2015 to 2018. In this study also conducted a survey about service satisfaction/performance of the Director-General of Strengthening Research and Development.  The data in table 1 is data on research performance and community service outcomes reported by PT in the 2014-2018 period. The data is reported in Simlitabmas. The data above has been validated and verified, especially for reputable international journals (Scopus indexed publications), taken from data available at www.scopus.com. For international journal data in table 1 is a journal whose data is entered by PT in Simlitabmas and has been validated by Kemenristekdikti. The data is not only publications that are indexed by Scopus.    Actually, the top order (Basic Science/Mathematics) is not included in the 10 focus areas. The sequence of focus areas with high Scopus indexed publications are Social Humanities, Cultural Arts & Education; followed by ICT; Health and Medicine Technology while the least is Defense and Security. Thus, if the focus area will be prioritized, then all grant schemes under the Ministry of Research, Technology and Higher Education can be directed to focus areas whose publications are indexed on a large scale.

Strategic objectives-based analysis
In the framework of efficiency, effectiveness, and sharpening the work results of the Directorate General of Strengthening Research and Development, program management in the form of: activity planning, implementation of activities and reporting of activities improved to performance management (work results) in the form of: performance planning, performance implementation, performance measurement, performance control and performance reporting.
Improving the quality of research and development is also an urgent urgency to be improved. Higher education and the world of work are not just to prepare graduates who are ready to work because they have the skills or expertise needed by the industry. Higher education must also train graduates to be able to become independent entrepreneurs who open jobs for themselves and others. Education and the world of work are becoming an important focus at this time. Main Performance Indicator shown in table 5.  As of December 31, 2018, all performance indicators had been almost reached, even more than 100%, except for prototypes. Most likely, the prototype will also be fulfilled because there is still 1 year of work (in 2019). Thus, performance indicators need to be improved in the next strategic plan. In the new strategic plan also needs to be considered in terms of quality, for example, for international publications, at least 50% is in the form of journals, not from seminars. Intellectual Property Rights are also directed not only in terms of quantity but also measured by quality, for example, what amounts to an industrial scale.

Satisfaction survey-based analysis
A survey of the Public Satisfaction Level within the Directorate General of Research and Development Strengthening (Dirjen Risbang) has been collected in detail in table 6.   7, it can be seen that in all work units are dominated by respondents who answered the satisfied category. In the DSRP work unit, the most respondents answered in the satisfied category were 46.66%, the DRPM work unit was the most respondents who answered in the satisfied category by 66.16%, the DPTI work unit was the most respondents who answered in the satisfied category by 60.45 %, DPKI work units with the most respondents who answered in the satisfied category were 64.49%, SETDITJEN work units were the most respondents who answered in the satisfied category by 63.03%, and for DITJEN the most respondents who answered in the satisfied category were 51.35%.
Furthermore, the results of measurement of the level of public satisfaction based on categories of respondent types (Regional R&D, Research and Development Planning, LPNK; Rector; Lecturers; LPPM; LLDikti; BUMN; Society; Foreign Researchers and other Stakeholders) can be seen entirely in the table 8. In general, respondents who were very satisfied/satisfied with the performance of the Directorate General of Research and Development Strengthening were Regional R&D, KL R&D, and LPNK while the respondents who are less/dissatisfied are the public and foreign researchers.

Conclusion
Analysis based on the performance of PT obtained a sequence of focus areas with high indexed publications are Social Humanities, Cultural Arts & Education; followed by ICT; Health and Medicine Technology. While the least is Defense and Security. Thus, if the focus area will be prioritized, then all grant schemes under the Ministry of Research, Technology and Higher Education can be directed to the focus areas whose publications are indexed on many Scopus.
As of December 31, 2018, all performance indicators had been almost reached, even more than 100%, except for prototypes. Most likely, the prototype will also be fulfilled because there is still 1 year of work (in 2019). Thus, performance indicators need to be improved in the next strategic plan. In the new strategic plan also needs to be considered in terms of quality, for example, for international publications, at least 50% is in the form of journals, not from seminars. Intellectual Property Rights are also directed not only in terms of quantity but also measured by quality, for example, what amounts to an industrial scale.