High stakes examinations can have profound implications for how science is taught and learned. Limitations of school science such as the 'cookbook problem' can potentially be addressed if high stakes assessments target learning outcomes that are innovative. For example, less mindless procedural engagement and more thoughtful consideration of practical science can potentially improve science learning. In this paper, we investigate how practical work is represented in the assessment frameworks of several countries that demonstrate above average performance in the latest PISA science assessments. The main motivation is the need to understand if there are aspects of high stakes summative assessments in these countries that can provide insight into how best to structure national examinations. Assessment documents from a set of selected countries have been analysed qualitatively guided by questions such as 'what is the construct of practical science' and 'what is the format of assessment?' The examined jurisdictions used different approaches from traditional external pen-and-paper tests to internal teacher assessments that included different formats (e.g. laboratory report). Innovative approaches to the assessment of practical skills (e.g. PISA computer-based tasks) do not seem to be represented in these high-stakes assessments. Implications for innovative assessments for high-stakes purposes are discussed.

We investigated for the first time the genetic and environmental aetiology behind scientific achievement in primary school children, with a special focus on possible aetiological differences for boys and girls. For a representative community sample of 2,602 twin pairs assessed at age nine years, scientific achievement in school was rated by teachers based on National Curriculum criteria in three domains: Scientific Enquiry, Life Processes, and Physical Processes. Results indicate that genetic influences account for over 60% of the variance in scientific achievement, with environmental influences accounting for the remaining variance. Environmental influences were mainly of the non-shared variety, suggesting that children from the same family experience school environments differently. An analysis of sex differences considering differences in means, variances, and aetiology of individual differences found only differences in variance between the sexes, with boys showing greater variance in performance than girls.

Few studies have empirically investigated the specific factors in mentoring relationships between undergraduate researchers (mentees) and their mentors in the biological and life sciences that account for mentees' positive academic and career outcomes. Using archival evaluation data from more than 400 mentees gathered over a multi-year period (2005-11) from several undergraduate biology research programs at a large, Midwestern research university, we validated existing evaluation measures of the mentored research experience and the mentor-mentee relationship. We used a subset of data from mentees (77% underrepresented racial/ethnic minorities) to test a hypothesized social cognitive career theory model of associations between mentees' academic outcomes and perceptions of their research mentoring relationships. Results from path analysis indicate that perceived mentor effectiveness indirectly predicted post-baccalaureate outcomes via research self-efficacy beliefs. Findings are discussed with implications for developing new and refining existing tools to measure this impact, programmatic interventions to increase the success of culturally diverse research mentees and future directions for research.

is an environmental science outreach/education program that incorporates the Next Generation Science Standards (NGSS) 8 Practices with the goal of promoting knowledge and understanding of authentic scientific research in high school classrooms through air quality research. A quasi-experimental design was used in order to understand: 1) and 2) . Treatment students received instruction related to air pollution (airborne particulate matter), associated health concerns, and training on how to operate air quality testing equipment. They then participated in a yearlong scientific research project in which they developed and tested hypotheses through research of their own design regarding the sources and concentrations of air pollution in their homes and communities. Results from an external evaluation revealed that treatment students developed a deeper understanding of scientific research than did comparison students, as measured by their ability to generate good hypotheses and research designs, and equally expressed an increased interest in pursuing a career in science. These results emphasize the value of and need for authentic science learning opportunities in the modern science classroom.

Practical independent research projects (IRPs) are a feature of school science in a number of countries. To assess the impact of IRPs on students, a systematic review of the literature was undertaken. Thirty-nine papers met the review inclusion criteria, reporting on work from twelve countries. The review indicates that IRPs are often associated with wider initiatives such as authentic science, problem-based learning, and project-based learning. There is considerable variability in the nature of IRP work in relation to focus, models of provision, assessment, the involvement of external partners such as universities and employers, and funding, and this diversity affects judgements on the quality of the evidence base on impact. The majority of the research reviewed explored areas such as conceptual understanding, motivation to study science once it is no longer compulsory and attitudes to science, and the development of practical skills. Benefits were identified in relation to the learning of science ideas, affective responses to science, views of pursuing careers involving science, and development of a range of skills. Studies focusing on traditionally under-represented groups indicated that such students felt more positive about science as a result of undertaking IRPs. The review findings indicate that further work is needed to enhance the quality of the available evidence, to consider the ways in which IRPs can be validly assessed, to explore more fully the potential benefits for traditionally under-represented groups, and to explore more fully the potential longer-term benefits of participation in IRPs at high school level.

A randomised controlled trial (RCT) and a series of case studies were used to determine the impact of two variants of an intervention (a professional development programme) aimed at improving primary school science teachers' subject and pedagogic content knowledge, and enhancing their subject leadership ability. Ninety-six schools were randomly assigned to full or partial treatment groups or a 'business-as-usual' control group. Quantitative data were collected from teachers and pupils through an assessment of scientific knowledge based on standardised assessment items. Qualitative data were collected through interviews and lesson observation initially in thirty case study schools. There were three data collection points: pre- and post-intervention, and one year later. [Guskey, T. (1986). Staff development and the process of teacher change. , (5), 5-12.] model was used as the analysis framework. The quantitative data from the teachers' subject knowledge assessment indicated neither the full nor the partial training programmes had a statistically significant impact on teachers' performance. In contrast, the qualitative data suggested that many teachers in the full treatment group believed that their subject knowledge had improved and reported increased confidence in their teaching of science. Lesson observations provided corroborating evidence of change in teachers' practice, and some modest evidence of wider change in schools. There was no statistically significant improvement in pupil performance in subject knowledge assessments when teachers had participated in the intervention. In the context of research methods, the study suggests that a mixed-methods approach to evaluation is likely to yield a more rounded and nuanced picture of the overall impact of an intervention.

The traditional description of "the scientific method" as a stepwise, linear process of hypothesis testing through experimentation is a myth. Although the teaching and learning of the scientific method have been a curriculum and assessment goal, the notion of the 'scientific method' itself has been identified as being problematic. Many researchers have recognised there is no single scientific method. However, there does not seem to be any useful guidelines for how best to deal with the nature of scientific methods in school science, including in high-stakes summative assessment. The article presents the use of a framework to illustrate the diversity of scientific methods that goes beyond the traditional limitations of a scientific method, to provide a more comprehensive and inclusive account, including non-manipulative parameter measurements. The framework not only clarifies the definition of scientific methods but also is adapted as an analytical framework to trace how scientific methods are framed in high-stakes chemistry examination papers from three examination boards in England. Such analyses can potentially point to what is emphasised in chemistry lessons, given how instrumental high-stakes testing is for driving teaching and learning. Results from an empirical investigation of examination questions are presented, highlighting an imbalance in the representation of methods in chemistry tests.

Research has demonstrated that gesture produced during conversation can provide insights into scientific thinking and can aid scientific communication in adults and school-aged children. However, to date, there has been a limited exploration into the role of gesture in supporting young children's science communication, and how this is underpinned and shaped by their sensorimotor experiences. This study examines, identifies and conceptualises ways in which children spontaneously used gesture during their interaction-orientated discourse and how this mapped to their action experiences at a water table. Findings show how gestural communication in children under 5 years of age can convey different levels of complexity related to science thinking.

The goal of inclusive design to promote participation of marginalized groups in science is ubiquitous across informal science education, and in the growing field of citizen science. Yet the aspiration of equality in the sciences continues to be met with challenges. Despite decades of educational research studying the barriers of participation in science, progress has not yet reached expectation. In this paper we apply an ethnographic approach to examine outcomes of a diversification effort of a citizen science program in a museum-based genetics lab. We analyze data from interviews, artifacts and observations with participants from the program inside the lab. We share findings about how being intentional while designing towards equity resulted in a more diverse and accessible program while giving the participants the opportunity to build knowledge of, and skills in, genetics in an inclusive space. This paper concludes with findings on barriers to participation among individuals from underrepresented communities, and how relationships with diverse leaders can facilitate boundary crossings, foster positive identities in sciences and beget a new generation of diverse scientists.

The incorporation of epistemic aspects of science in science education continues to be a challenge for researchers and practitioners. The paper presents an empirical study investigating how epistemic framing of scientific methods can be incorporated in science teaching, learning and summative assessment, and what impact such framing has on student learning outcomes. The study was conducted with 969 secondary students taught by 152 teachers from a national sample in England. Teaching videos and summative assessments were framed by Brandon's Matrix, a theoretical framework derived from the work of a philosopher of science and focusing on the diversity of scientific methods ranging from hypothesis testing to non-manipulative parameter measurement. The findings are discussed, including (a) the students' views on the teaching videos and summative assessments, (b) the impact of the teaching videos on students' understanding of the epistemic aspects of scientific methods and (c) students' performance on summative assessments in the context of science topics covered in high-stakes examinations in England. The findings suggest that the students' understanding of scientific methods significantly improved after watching the videos. Furthermore, the students' performance on the summative assessment items indicated a high level of accuracy in responses.

High-stakes assessments prominently influence what is done in secondary school science lessons ('washback' effects). It is therefore important that assessments of knowledge and understanding gained from practical work are constructed to reward and incentivise effective practices in practical work. To do that, they must differentiate between pupils who have experienced practical work in different ways. This empirical, mixed-methods study identifies generalizable characteristics of written assessments that differentially reward pupils who experienced practical activities through hands-on work, teacher demonstration, video demonstration, or reading about the activity. Conclusions are drawn from 1486 post-intervention tests completed by pupils aged 14-15 in England, from lesson observations and teacher interviews. This study also identifies pedagogical practices that were more noticeable in practical work that was most rewarded by the written assessments: the work was teacher-guided; and pupils were encouraged to be active participants. Existing literature describes negative washback effects of high-stakes, written assessments that limit the use and effectiveness of practical work as a pedagogical tool. We describe ways in which written assessments could be constructed to better reward effective practices in practical work (practices that better support learning), with the intention of having positive washback effects on pedagogy by better incentivising these practices.