Students' competence and understanding of scientific method in the life sciences at the University of KwaZulu-Natal.

Doctor of Agriculture (Zoology)

This thesis focuses on describing the conceptions and misconceptions that undergraduate Life Science students hold regarding aspects of the scientific method at the University of KwaZulu-Natal (UKZN). This research is necessary in order that instruction strategies can be formulated and implemented to address these misconceptions, in response to a global call to redefine how science is taught at tertiary level. The University of KwaZulu-Natal is located over a number of campuses with courses and curricula material being taught across campuses by different faculty staff. The apparent role that faculty staffs’ epistemologies, instructional strategies and assessment tools may perform in influencing students’ conceptions of scientific method led us to concentrate on some of these areas. Life Science courses are taught by a variety of instructors with differences in their understanding, views and opinions regarding the process of science as well as their pedagogic approaches to teaching this process. We initially investigate the views of lecturers regarding hypotheses and experimental design in their personal research in the Schools of Agriculture, Earth and Environmental Sciences and Life Sciences at UKZN, and how these compare to what is taught at the introductory biology level. Interestingly, only 46.7% of the respondents conduct hypothesis-driven investigations and less than 7% use predictions in their personal research. There is also much variation in faculty members’ ideas regarding research hypotheses, alternative hypotheses and their use of sample size, repetition and randomization in their personal research. Critical analysis of faculty’s approach to undergraduate teaching of Life Sciences indicates an over-emphasis of content teaching rather than the development of scientific reasoning and critical thinking. Undergraduate courses need to engage Life Science students in the process of scientific inquiry where they are encouraged to think deeply about the process of science, and in particular experimental design. Successful Life Science courses train students to critically evaluate experimental design, statistical approaches and inferences in its entirety. Consequently, we tested first and second year Life Science undergraduates understanding of various aspects of experimental design using an open-ended questionnaire. We found that undergraduates performed poorly in 1) producing a completely randomized design of treatments 2) describing the benefits of limiting sources of variability and 3) describing the limitations to the scope of inference for a biologist. They only showed improvement from first to second year in their ability to correctly identify treatments from independent variables. These results add to the growing body of Life Science research that indicates that undergraduate curricula are not adequately producing well-rounded, critical thinking scientists. Next, we focus on assessments. Faculty staff have been challenged by science educators to change their approach to teaching in order to more accurately reflect the practice of biology. Meeting these challenges requires the critical analysis of current teaching practices and adjustment of courses and curricula through curriculum reform. Assessments play a vital role in providing evidence of effective instruction and learning. Student responses from two formative tests and one final summative examination for an undergraduate biology cohort (n = 416) at UKZN were analyzed both quantitatively and qualitatively to determine students understanding of aspects of the scientific method. Quantitative analyses revealed that the majority of first-year undergraduate students at the end of an introductory biology course were able to identify hypotheses and dependent and independent variables correctly. However, qualitative analyses indicated that sometimes students confuse hypotheses with predictions and are unable to identify independent variables correctly. Critical analyses of the assessments using the Blooming Biology Tool revealed that assessment design can considerably influence student results. It is essential that clear objectives and competencies are set at the outset and that there is a synergistic relationship between instruction and assessment. Assessment design requires careful consideration of content being covered as well as cognitive skills being tested throughout the course. In addition, we determine the types of conceptions that third year biology students’ hold regarding hypotheses, predictions, theories and aspects of experimental design. These conceptions were compared across two geographically separated campuses of the UKZN, namely the Pietermaritzburg (n = 28) and Westville (n = 50) campuses. They were also compared to descriptions located in prescribed textbooks and course manuals throughout their undergraduate biological studies. Results indicate that there is variability between and across campuses in students’ descriptions of research hypotheses, predictions and theories, repetition and randomization. These conceptions were sometimes partial conceptions while in other instances they were completely incorrect. Interestingly, many of the students’ responses lacked essential elements which could be found in the prescribed textbook and course manuals. The variability in student responses across campuses could be a result of differences in faculty instruction and therefore more research is required to test this. These results also indicate the necessity for courses to be designed with more consistency in concepts to be developed. Lastly, we focus on students’ competency in aspects of scientific inquiry revealed through a third year research project that is mentored by faculty staff members. This chapter is designed to describe students’ ability to effectively apply scientific inquiry at the undergraduate exit year. Biology 390 projects were analyzed from 2012 (n = 26 students), 2013 (n = 46 students) and 2014 (n = 34 students). Journal formatted project write-ups were examined for reference to aims, objectives, hypotheses and predictions. Students’ ability to appropriately apply experimental design was also assessed by documenting their use of replicates, sample size, randomization and controls. Conceptions of the broad nature of the scientific process and scientific inquiry were also noted by surveying project introductions, discussions and conclusions for evidence of students’ ability to link their research into the greater network of scientific knowledge. There was an overemphasis in the use of statistical hypotheses compared to scientific hypotheses by BIOL 390 students in their project write-ups. Many students used predictions inappropriately and a large majority of students failed to incorporate critical aspects such as randomization and controls into their experimental designs. Explicit didactic discussions by mentors with their students are necessary in order to improve these conceptions of the scientific process. It is suggested that mentors become familiar with both learning theories and common misconceptions associated with the nature of science and scientific inquiry so that they are able to apply these to their mentoring approaches of students conducting research projects. As a whole, this thesis finds a general lack of understanding of the basic premises of what entails “science” at all levels of undergraduate study within the Life Sciences at UKZN. This worrying trend reflects research from elsewhere, and suggests reform is needed to ensure that UKZN can produce critical higher-order thinking science graduates capable of correctly understanding the full intricacies of the variety of approaches to conducting scientific research. Suggestions for reform include the need for Faculty staff to engage up to date pedagogical research on how science should be taught, a recognition that a move away from knowledge transfer alone towards including skills transfer is needed, training for faculty staff in terms of mentoring skills for participatory research experiences for undergraduates that includes scientific process mentoring, and curriculum reform that recognizes the need to set clear measurable objectives and outcomes for undergraduate courses. Lastly, we also recommend analyzing assessment types used at UKZN in order to ensure that sufficient higher-order cognitive skills are assessed, rather than predominantly lower-order cognitive skills as is currently the case.