Designing Online Learning Evaluation in Times of Covid-19 Pandemic

. Abstract The research objective is to design of learning evaluation that becomes strategy in the Covid Pandemic 19. The study used qualitative research methods with case studies that construct unique and important special realities through data collection interviews and discussions by using case study analysis. The data was collected through online media such as google meetings as well as direct observation from informants, who were determined by purposive sampling, namely the management and student representatives of study groups at the Open University of Purwokerto City and private education institution of Pakis school in Cilongok District in Banyumas regency, Central Java of Indonesia. The research result that the process of service and implementation of education as well as its evaluation during the Covid-19 pandemic must still take place using adaptation and innovation strategies in the form of online learning media through the application media for the Microsoft Teams and Learning Management System (LMS) program. Implementing innovative learning through online media has been successfully implemented practically and effectively, but there is still a need for special socialization and training on an ongoing basis. Evaluation of services and implementation of education is very important to do to provide program improvement and results and evaluation could be effectively carried out through google form and Learning Management System (LMS).


Introduction
Open University is a role model in implementing education that educates the nation's life by conducting instructorial education system.Open University is an important part of organizing education as strategic foundation in building and developing the quality of Human Resources (HR) to carry out the constitutional and state mandates, namely enrich the life of a nation.Open University instructorial education is a medium for Published by IDEAS SPREAD learning materials, services learning, network facilities, bandwidth, equipment, and funds to support the interactive process of learning (Jin et al., 2020;Mor & Winters, 2007;Suparto, 2012;Tan 2013).Education is organized with the management and service of learning programs that create student independence in learning, places, facilities, instructorial processes, and student satisfaction that affect learning outcomes, and the real time online system as the digital media to increases public trust and increases the effectiveness of implementing new student admissions (Ardhi, 2015;Suratno, 2018;Suryanto et al., 2013;Wardrip & Shapiro, 2016) Evaluation of the school's internal quality assurance system is carried out by discussing or sharing the results of observations from the Team and the observed teachers, both individually and in groups to be adjusted to the operational standards of the education system that have been set in schools (Aimah & Purwanto, 2019;Prastati, 2011;Sitthisak, 2008;Suratno, 2018).Open University needs to continue to carry out a sustainable and comprehensive evaluation through discussion studies and research in order to accommodate aspirations, input or recommendations and the participation of all parties, especially instructors, Study groups and students as positive and constructive as well as scientific contributions to improve service quality strategies and instructorial education of Open University.Thus, it becomes important and interesting to examine the Face-to-Face instructorial program evaluation strategy to improve the quality of service and education in the Program Unit Distance Learning at the Open University of the City of Purwokerto, Central Java, which has a very large and potential enthusiast.It is recorded that the number of active students until 2020/2021 is 10,000 students both in the Basic Education and Non-Education study programs.Open University instructorial education participates in improving the quality of human resources that are affordable, close and friendly in terms of time, place and cost for the community to remote areas, for all ages and social status.All can get education at Open University.It is necessary to carry out periodic and comprehensive evaluations, through discussion studies and research in order to accommodates the aspirations and recommendations of all parties such as instructors, study groups and instructor participants as a constructive and scientific contribution in improving the quality of service and education at Purwokerto which has potential enthusiasts and very large in the regency of Banyumas, Purbalingga, Cilacap and Kebumen areas, Central Java province of Indonesia.
The face-to-face instructorial education management system at the Open University is comprehensive and has quality standards of education by implementing (1) Socialization and instructorial training and instructor training which is always carried out every semester before the implementation of the instructorial to increase motivation, quality of planning and development of instructorial methods, socialization of assessment and evaluation of instructorials.(2) Provide guidelines for the design, implementation and evaluation of instructorials.(3) instructors are selected administratively and interviewed with competency qualifications in the instructorial.(4) The instructor prepares a course competency map, instructorial activity design, instructorial Program Unit, description of assignments, instructorial assignment criteria and grids as well as meeting notes submitted and endorsed by the Open University of Purwokerto leadership before the instructorial process.(5) Monitoring and evaluation of the instructorial process at the beginning and at the end.(6) The instructor becomes a motivator, facilitator and teacher for eight meetings with the target of mastering modules and fostering independent learning.(7) Collecting instructorial reports such as assignment attendance lists, meeting notes, and material slides, grade lists, answer sheets for three instructorial assignments and answer files for the smallest and largest grades, reports are submitted to the Distance Learning Program Unit of Open University and input or uploaded by instructor in the learning system through the website instructor https://instructorial.ut.ac.id.
In improving the quality of service and face-to-face instructorial education, evaluation is needed as an important stage in the management system, including Open University instructorial education.The implementation of evaluation is very important and strategic to improve the quality standard in terms of effectiveness, achievement of outputs and benefits through a process of identification, analysis and assessment starting from planning and implementing instructorials.
Based on the experience of being a instructor and research study (2019)(2020), there are several problems in implementing the Open University instructorial, the room facilities and instructorial media are still limited, administrative problems and instructorial schedules are still changing during one and two meetings, remote locations that hinder the instructorial process, low self-learning and less interactive.The service and learning process must still continue even during the Covid 19 Pandemic as a form of commitment in order to educate the nation's life that must not be stopped.The Covid 19 pandemic that has spread around the world starting in 2020, including in Indonesia, according to data from management agencies of Covid-19 has 1.4 million confirmed cases, 1.2 million were declared cured and 39 thousand died, while in Central Java Province in August 2020 there were 9.6 thousand confirmed cases, consisting of 3,097 patients treated, 5,703 patients recovered, and 868 patients died.The Covid 19 pandemic resulted in almost all activities being stopped, starting from economic, socio-religious and cultural activities including the educational process.However, the Covid 19 pandemic made learning become Published by IDEAS SPREAD challenging.It should be addressed wisely and people seek various solutions to carry out life activities including the learning process.Thus, the open university implements service and education programs using an online system via internet media such as the application of the Microsoft Teams program and with the virtual class.Online instructorial learning (OTL) is a class provided in the Learning Management System (LMS) to help instructors provide space to deliver learning material, and the administration of OTL.The virtual class can be accessed via the website, which has been implemented by the Open University including for the Distance Learning Program Unit at the Open University of the City of Purwokerto, Central Java in the Covid 19 Pandemic era to be precise from early 2020 to mid 2021.
Researchers consider that it is important to carry out research to design of instructorial learning evaluation was needed both with online and face-to-face learning program systems in the Distance Learning Program Unit at the Open University of Purwokerto, Central Java.The results of the evaluation can be used as material for socialization and implementation of the basic principles of social engineering under study and applications that can be formulated as input for planning service improvement programs and implementing the learning process.Therefore, it is necessary to add group, field or case study assignments.So it becomes important and interesting to research the evaluation strategy of face-to-face instructorial programs to improve the quality of service and education at Open University of Purwokerto which can be adopted by private education institution Tsyanawiyyah Pakis.

Method
The research used a qualitative case study method, according to Rashid et al. (2019) qualitative case study allows researchers to carry out in-depth exploration of unique and interesting phenomena in a particular context which is carried out through four stages, namely the foundation phase, the pre-field phase, the field phase and the reporting phase.The study used purposive sampling to determine informants, namely the management and student representatives of study groups of the Open University of Purwokerto City and private education institution Tsyanawiyyah Pakis in Cilongok District in Banyumas regency, Central Java of Indonesia.Data was collected through interviews and direct discussions, while maintaining the health protocol and through online media such as zoom meetings and google meetings.Data was collected trough documentation of service and learning process files from both the management and study group students as well as from instructors as teachers.
Research data analysis was carried out in case studies by carrying out a systematic amalgamation as a process in which the theoretical framework and results of field work are interpreted empirically and the causality of findings is sought simultaneously as a form of developing new concepts and theories as study material for further research (Creswell et al., 2007).

Results and Discussion
The research is designed through a preliminary study stage in 2019 to early 2020 before the Covid 19 pandemic such as observation, collecting documentation data, and interviews with research locations, reviewing research results and scientific journals as well as academic studies with colleagues, experts and practitioners, especially regarding education management and educational evaluation of online learning education.The online learning evaluation design at the open university is very relevant to the adoption of the Pakis school which has educational characteristics with teaching in the environment to explore protected forests and agriculture.Pakis Schools can make online-based teaching and services as an alternative to adaptive and innovative learning methods in the Covid 19 situation, which is limited to normal face-to-face education.So it is necessary to conduct workshops and comparative studies to the Open University in the City of Purwokerto to adopt online learning and services, especially for school management, teachers and students.

Education Trough Online Learning Program
The students of distance programs such as Open University have difficulties such as feeling bored because they do not interact or isolated, difficulty in understanding teaching materials, and difficulty in getting feedback on questions and assignments given and are not accustomed to distance learning, because they are used to learning face-to-face and there is instructor (teacher) guidance in the class at the previous school.Thus, the distance education system requires an academic program in the form of face-to-face instructorial services in order to help students optimally in the learning process.Based on the Regulation of the Minister of Education and Culture number 24 of 2012 concerning the Implementation of Distance Education in Higher Education, Article 1 (4) states that instructorials are a form of academic learning assistance that can be implemented face-to-face or through the use of information and communication technology.
The development of the education delivery system in the era of globalization and digitalization has used web and internet-based technology media.However, face-to-face learning still has to be carried out with appropriate Published by IDEAS SPREAD learning methods in achieving learning objectives, expected outcomes and motor skills as well as changes in behavior attitudes (Hammond et al., 2020;Mayers, 2013;Widyaningrum & Prihastari, 2020).According to the 2019/2020 Open University Organizing System Catalog, instructorial is a instructoring and assistance program organized by Open University from instructors aimed at supporting the student's independent learning process both individually and in groups.The implementation of instructorials at Open University has the first form of online instructorials through the learning process using the media website at https://elearning.ut.ac.id/.Both Face-to-Face instructorials are learning assistance services through face-to-face meetings or lectures between instructors and students as many as eight meetings for one semester.
During the Covid 19 pandemic, a instructorial process was carried out with an online system through the Microsoft Teams class in the even semester from March to August 2020 and in the next semester; from September to December 2020 using virtual class Online instructorial learning (OTL).OTL is a class provided in the Learning Management System (LMS) to help instructors provide space to deliver learning materials, organizing Online instructorial learning.The OTL class can be accessed via the https://lms.ut.ac.id/ page.The creation of the OTL class will be carried out by the Open University Learning Assistance Center based on the instructorial class permit data.
Programs and processes for implementing education by adapting and innovating using technological media have become a development of the challenges and demands of the times in the era of information and communication technology which are very important as an effective strategy especially in emergencies such as the Covid 19 Pandemic (An & Oliver, 2021;Moorhouse, 2020;Sabiq et al., 2020;Sulaiman et al., 2020;Verma., 2020;Williamson et al., 2020).
The use of service and learning media through the Learning Management System (LMS) is carried out in several stages, namely (1) Preliminary session which contains instructions for the content of information that must be explained in the introductory session, the introduction menu, the introductory forum, the discipline menu and the rules for implementing Online instructorial learning (OTL).The OTL classroom preparation that instructors need to do in the introductory session by updating the explanation that contains information: (a) The name and eye code according to the catalog, (b) The instructor's name and email address, (c) Greetings and motivation, (d) The discussion material to be presented in OTL for the next 8 week meetings, (e) The expected course learning outcomes that are expected to be achieved through the entire series of OTL activities, and (f) Closing greetings.
(2) In the OTL class instructorial session, starting from the 1st meeting to the 8th meeting session provides instructions on the content of information that must be explained in the 1st to 8th session of the OTL class.Then menus such as material, discussions, lecture meetings, assignment submissions, evaluation questionnaires and value summaries have been provided with details of the following activities: (a) Updating the explanation of each containing title information or the topic of each lecture session, (b) Greetings and giving motivation, (c) The scope of the discussion material that will be presented in OTL for each session, (d) The scope of activities that will be provided in the OTL class in each session, (e) the expected learning outcomes of the courses that are expected to be achieved through a series of activities OTL for each session, (f) Uploading learning material, both material to be presented at the OTL and supporting material, which are expected to help students in preparation for learning before attending the OTL for each session.The types of documents that can be used in presenting material in the OTL class including presentation documents (power point slides), learning videos, and links from open learning resources as well as Open Educational Resources (OER) on a website.Each learning material that has been uploaded in each session must be placed under the material menu in each session.(g) Updating the explanation at the discussion venue for each session which contains discussion topics that must be responded to by students, both before the OTL and after the OTL for each session.(h) Updating the explanation at the OTL attendance place for each session.(i) Updating the explanation at the OTL link which contains information on the OTL schedule for each session.(j) Specific for the 3rd session, 5th session, and 7th session, instructors are expected to update the explanation of the assignment collection point which contains information on how to do the assignment, about assignments, and time for submitting assignments.(k) At the end of the 8th session, instructors are expected to enter the OTL final score and upload the OTL report through the score entry application on the website of Open University Department.
Instructorials facilitate and motivate the learning process of students who are expected to have the motivation and ability to think, learn, observe, behave and carry out the goals of each course.The success of instructorials is determined not only by student motivation and abilities but also by the instructor who has the influence to become a facilitator or teacher.Learning processes such as instructoring and mentoring require participatory communication that is dialogic, egalitarian and empowering (Bhattacharya, 2020;Lawson, 2011;Martin & Lawson, 2013;Sulaiman & Ahmadi, 2020).Published by IDEAS SPREAD

Designing Evaluation of Online Educational
Management has elements that cannot be separated from each other or a complementary unit starting from planning, organizing, implementing and evaluating.In assessing or measuring the success of management and making appropriate, effective and accurate decisions, proper evaluation activities and accurate information data are needed.
Evaluation serves to identify problems and opportunities to meet and assess needs and explain the relevant context.Evaluation can be carried out before, during the process, and after the program is implemented, the results of the evaluation can become recommendations for materials for decision making or strategies to maintain, modify or improve things that are is no longer relevant (Arini et al., 2021;Daniel, 2020;Datta, 2007;Kurnia et al., 2017).
Characteristics in face-to-face education programs at Open University can be identified and analyzed by these three important components, namely: planning, implementation, and program results.Hence, to develop a face-toface instructorial program evaluation strategy Open University can use three components in the evaluation strategy (Planning, Implementation, and instructorial Results).Evaluation of the planning component is focused on perceptions of program management, independence of students in learning, and perceptions of place and instructorial facilities.Evaluation of program implementation is focused on the quality of the instructorial process.Evaluation of program results is focused on student satisfaction and learning outcomes.
Based on these, a face-to-face instructorial program management evaluation scheme can be made which will be used as research indicators, as in Figure 1.Quality educational institutions demand effective and efficient institutional management from the aspects of human resources, funds, and infrastructure as well as leaders and teachers who are open and adaptive to achieve goals.Quality standard education is not only judged by the quality of its graduates, but also related to customer indicators, namely: (1) Customer satisfaction, (2) Increasing customer interest and expectations, (3) Pleasing customers (Daniel, 2020;Hillman & Säljö, 2016;Khan & Usman, 2015;Vargas, 2015).Improving the quality of education in tertiary institutions is an important and strategic matter to continue with the strategy of improving the human resource subsystem, organizational structure, use of technology, and Published by IDEAS SPREAD organizational implementation processes.The higher education strategies in increasing quality graduates include: (1) Students as learners; (2) teaching staff or lecturers as educator (3) facilities and infrastructure (Asmawi, 2005;Bauman, 2009;Huiru, 2014;Spante et al., 2013).
Evaluation is an activity of collecting, analyzing, presenting important data and information to consider better decisions with indicators (1) readiness of lecturers, (2) readiness of the organizing team and (3) readiness and completeness of infrastructure or facilities (Budi et al., 208;Divayana & Sugiharni, 2016;Voigt & Swatman, 2010).Evaluation of the instructorial program assess the quality assurance of the Distance Learning Program Unit of Open University which provides open opportunities for students to be involved in evaluating the instructorial process regularly and continuously at each instructorial stage using the "instructor Evaluation Questionnaire" instrument (Sugiran et al., 2016).Opening access and approach to location as well as distributing questionnaires Researchers get permission and research support at the research location Obtaining data from the questionnaire 3.
Processing and analysis of the results of the questionnaire Identified problems, motives and potential of ex-drug addicts Materials for FGD and PDM 4.
The implementation of FGD I identified problems, potentials and prospects The results of the questionnaire were verified by FGD Identified problems, potentials & prospects 5.
Processing and analysis of the results of the FGD I Identified problems and evaluation results of face-to-face instructorial programs at Open University of Purwokerto 6.
Implementing PDM of practitioners and leaders of Open University of Purwokerto Participants are enthusiast and active in PDM Can analyze the evaluation of face-to-face instructorial programs at Open University of Purwokerto 7.
Conducting interviews and observations and documentation of study groups research targets at Open University of Purwokerto The results of the questionnaire, FGD I and III can be verified and triangulated Get more in-depth and complete data 8.
Processing and analysis of the results of the evaluation of the face-to-face instructorial program at Open University of Purwokerto Able to produce an evaluation of the face-to-face instructorial program at Open University of Purwokerto Producing papers and journal articles 9.
Seminar on research results and preparation of reports Get input on the results of the seminar Can prepare and submit research reports on time 10.
Meeting with government stakeholders conducted socialization and provided recommendations for research results The educational institution of the Purwokerto Open University, Central Java Madrasah Tsanawiyah Pakis Cilongok educational institution, Banyumas Regency, Central Java Community and education activists 11.

Process, analyze, and compile Research reports
Reports can be compiled Reports can be prepared and submitted 12.
Scientific publications Able to publish research results to scientific journals, websites and mass media The the concept of evaluation design can be designed as questionnaire either given directly or through online media such as google form or educational websites to respondents, such as study group administrators and students, namely: (1) Sample questionnaire for service evaluation and cooperation with educational institutions intended to obtain information about partner satisfaction level with cooperation programs conducted with educational institutions such as Open Universities or other institutions.The questionnaire is filled out by respondents giving a score of 4, 3, 2, or 1 for each aspect of the services provided by placing a cross in the available column.The higher the score given by the respondent, the higher the level of satisfaction with each aspect of the services provided by educational institutions are, as in table 2. The benefits of cooperation for partners 4 3 2 1 (2) Example of a questionnaire to evaluate the implementation of the online instructorial education process.The education implementation evaluation questionnaire can be given to student respondents by giving a score on each statement (based on the student's experience) according to the level of satisfaction and importance weight, by means of a cross mark on the numbers contained in the Satisfaction and Interest column.The higher the score you provide, the higher your level of satisfaction and the more important this aspect of the service is as in table 3.

Conclusion
Education is an important and strategic factor in determining the improvement of the human resource quality as actors that will determine the success and progress of development in all fields.The process of service and implementation of education must continue in the midst of the challenges of the Covid 19 epidemic which limits interaction space due to large-scale social restrictions.
The Covid 19 Pandemic period led to good educational ideas and programs that remained productive, creative, and innovative by implementing online education services and processes through various media application programs such as google classroom, google meetings, and zoom meetings at various universities, including the Open University with using the application of the Microsoft Teams and Learning Management System (LMS) media program that has been implemented by the online instructorial class long before the Covid 19 pandemic.
The online educational media that is used by educational institutions, even with situations and conditions between students and instructors, are still considered effective and attractive in the implementation process and the results of their evaluation.Because education through the media of Microsoft Teams and the Learning Management System (LMS) can still be carried out interactively as a form of participatory and empowering education.Online learning media uses more varied and interesting material for the learning process starting from shows from videos such as YouTube, news online and online references such as scientific journals and electronic books (e-books).
The successful implementation of the service and learning process through online methods such as by the Open University in Purwokerto City, can be adopted by other educational institutions such as educational institutions in remote areas with requirements for the availability of equipment and internet media access, including Madrasah Pakis Cilongok school, Banyumas Regency which has a characteristic as a natural school or green school.
The implementation of educational activities must still be improved by an evaluation program of service and learning processes in order to receive constructive input in increasing satisfaction, improvement and quality of education, especially by implementing online education.The preparation of equipment and access to online learning media is an important element with comprehensive and continuous socialization and training for operators, administrators, instructors and student in an adaptive, creative, and innovative online learning process.
Pakis school as a model of natural education with a green school motto that prioritizes face-to-face teaching and practice in agriculture and protected forests, but is still relevant to adopting online learning technology so that there is a balance between character education and technology education, especially during the Covid 19 pandemi Published by IDEAS SPREAD must be maintain social distancing to interact.Pakis school activities can also utilize technology and communication media for learning media to present and publish the uniqueness of learning in nature based on green to school.

Table 2 .
Sample questionnaire for service evaluation and cooperation

Table 3 .
Example of a questionnaire for evaluation of the educational process only filled in if you have taken either the Face to Face instructorial (FFT) or the Online instructorial (Tuton).If not, you can immediately fill out aspects of the Teaching Materials Service (Part D) describes the level of student satisfaction with Open University services ** the level of importance of students' perceptions of the importance of related services