Conference Agenda
Overview and details of the sessions of this conference. Please select a date or location to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).
|
Daily Overview |
| Session | ||
Track 6-01: Evaluation in Higher Education
| ||
| Presentations | ||
Redefining academic value: constructing evaluation regimes for policy impact in an era of declining trust Overton, United Kingdom As trust in higher education faces increasing scrutiny, institutions must demonstrate value beyond traditional academic metrics. Policy impact - how research influences government decisions, regulations and guidelines - has emerged as a critical yet underused indicator of institutional value. Yet fundamental questions remain: How do we construct evaluation regimes that credibly measure societal contribution? What counts as a valuable impact and who decides? How can quality assurance practices enhance rather than undermine trust? Drawing on an analysis of global policy citation patterns across government reports, legislative documents and regulatory guidelines from more than 190 countries, we use the Overton database to examine how research influences policy, and what this reveals about measuring institutional value. We will do this in two ways - firstly, by identifying how research uptake patterns reveal the architecture of relationships and trust between research and policy communities via policy citations and secondly, by looking at examples of 'evidence' (scholarly or otherwise) mentioned or cited within government documents, from references to documents produced by other policy actors to mentions of individual researchers and projects. We'll explore how different types of policy actors use and attribute evidence across different contexts, and discuss what this might mean with regards to developing trusted relationships between researchers, institutions and policymakers. We present findings within a "Goals, Indicators, Stories" framework that addresses competing evaluation purposes: demonstrating accountability, supporting professional recognition and enabling strategic decision-making. The framework addresses key methodological challenges including data collection, quality assurance and evidence interpretation. We explore how transparent evaluation practices can make visible the connections between academic work and societal benefit, potentially rebuilding trust with policymakers and the public. Through this lens, we examine who is included – and excluded – in constructing evaluation regimes and the implications for institutional quality. This work provides practitioners with tools to navigate complex evaluation decisions, strengthen institutional resilience through credible impact measurement, and articulate universities' contributions to policy at a time when the relationship between higher education and society requires renewed attention. Recognition and Rewards in higher education. 1: University of Eastern Finland, Finland; 2: University of Eastern Finland; 3: University of Eastern Finland This paper presents the results of a four-year collaboration among ten European higher education institutions within a European university alliance YUFE, focusing on the Recognition and Rewards (R&R) of university staff. The following basic topics were dealt with in the project:1) evaluation of current good practices, 2) taking a first step towards designing and implementing R & R systems for academic and professional service staff within YUFE. The paper draws on desk research, an overview of current R&R practices across YUFE universities, and a set of pilot initiatives implemented at the alliance level. It synthesizes key insights from the literature on effective approaches to R&R in university settings, R&R approaches adopted at YUFE universities embedded within different European legislative and cultural contexts, reflecting varying degrees of institutional autonomy granted to universities. The paper also discusses the possibilities and limitations of developing alliance-wide R&R frameworks. The practical contribution relates to development of universities’ R&R systems. Our review includes both hard organizational R&R measures, such as salary systems and promotion models, and softer measures, such as positive feedback, symbolic employee rewards, and flexible job arrangements. Whereas limited organizational autonomy may restrict some universities to develop organization-specific hard measures, softer recognition measures may play even a more significant role (Deci & Ryan 2000). In a university setting, job autonomy sets an important prerequisite for work performance and a source of work motivation especially for teaching and research staff (Bellamy et al. 2003; Henkel 2005). Institutional autonomy varies between European universities. We identified several factors that set boundaries for developing harmonized R&R frameworks across European higher education institutions. These included, for example, national legislation, funding arrangements and collective bargaining agreements that set boundaries on the type of activities and outputs that universities reward, the type of job contracts offered, and institutional leeway in providing effective R&R mechanisms. In addition, institutional policies and practices vary significantly. Against this background, development of a common R&R system for autonomous universities within the context of an alliance does not aim at changing the overarching structural foundations, but rather lays on shared principles in R&R. For the YUFE alliance, these include following the principles of fairness, transparency, and equal treatment, which can also be seen as prerequisites for researcher mobility. In practice, this entails setting and agreeing upon work criteria or targets, assessing performance after a suitable period with constructive feedback, and offering rewards and/or recognition for the contributions made. For example, when developing universities’ career models and promotion systems, the requirement of equal treatment of employees makes it necessary to have reasonable and transparent criteria for the assessment of job performance. In recruitment, assessment processes should follow the principles of openness and transparency, enabling fair comparisons of performance across candidates and being consistent in applying the publicly declared criteria (cf. Esposito et al. 2015). We state that by improving the openness and fairness of R&R processes institutional policies and practices could be improved. While the criteria and processes may vary from institution to institution, the underlying logic and level of openness should remain clear. Building Adaptive Universities Beyond Rankings and Accreditation Corvinus University of Budapest, Hungary Higher education has entered a VUCA world, where rapid shifts in student aspirations, changing corporate expectations, geopolitical tensions, shrinking public resources, and an increasingly competitive global education market are redefining institutional priorities. These forces have fundamentally altered the way universities are governed, demanding a transition from traditional, compliance-driven governance to more agile, adaptive, and future-oriented leadership. Certainly, accreditation frameworks, ranking systems, and quality assurance tools have helped institutions improve a lot during the last twenty years or so, but they just aren’t enough anymore to make universities ready for constant adapting. The next step in how universities evolve seems to mean that they should move past a compliance oriented mindset , and instead start acting like continuously learning organizations , or something close to that. This paper presents a reflective scholar-practitioner viewpoint that grew out of my academic leadership run-ins across two very different higher-education contexts: one that is rapidly expanding and quite diverse in Asian Setup, and another that is a mature, internationally connected European university, if that makes sense. Instead of making a clean institutional comparison, the paper basically pulls together leadership lessons from the moment I helped steer various strategic moves, like accreditation and academic governance , curriculum change, faculty development, internationalisation, executive learning programmes, and also cross-sector partnerships. What becomes noticeable, at least to me, is that even when the policy atmosphere, governance habits, and institutional autonomy are clearly not the same, universities still seem to run into nearly the same strategic predicaments, again and again. Based on these experiences, the paper proposes the Adaptive Academic Governance Framework, a forward- looking leadership model meant to shore up institutional resilience and ongoing transformation. It suggests that adaptive universities aren’t just “managed” in the usual way, they’re built around six interlinked capabilities: strategic agility, quality as continuous learning not periodic evaluation, evidence-informed digital governance, globally networked partnerships, empowered academic communities, and student-centred value creation. Put together, these pieces shift governance from something mainly administrative into a more living capability that helps universities anticipate shifts, instead of only reacting to them later. The paper combines experiential and conceptual approaches to the topic and links reflective practices to modern debates in the areas of higher education governance, organisational learning and institutional transformation. Quality assurance should not only be seen as the goal of such initiatives as university accreditations but be transformed into the philosophy of continuous learning and adaptation. Similarly, international partnerships should transcend mere mobilities and MOUs and aim at joint creation of research, educational and societal value. The proposed theoretical framework can be viewed as contributing to the existing debate in higher education management since it focuses on the issue of institutional adaptability rather than performance measurement. The offered framework can help university leaders, policy-makers and academic managers to navigate the complexity of today's challenges without losing focus of academic values and public mission. While being based on my experience of cross-continental leadership practices, the framework is supposed to be generalisable. In today's world where universities are supposed to be excellent, entrepreneurial, international, digital and socially responsible, the key feature of successful institutions should not be the quality of their accreditation or ranking, but their ability to learn, adapt and change. | ||

