Towards inclusive learning environments in post-graduate medical education: stakeholder-driven strategies in Dutch GP-specialty training | BMC Medical Education | Full Text
Skip to main content

Towards inclusive learning environments in post-graduate medical education: stakeholder-driven strategies in Dutch GP-specialty training

Abstract

Background

A recent study found that ethnic minority General Practice (GP)-trainees receive more negative assessments than their majority peers. Previous qualitative research suggested that learning climate-related factors play a pivotal role in unequal opportunities for trainees in post-graduate medical settings, indicating that insufficient inclusivity had put minority students at risk of failure and dropout.

Study objectives

We aimed to develop broadly supported strategies for an inclusive learning climate in Dutch GP-specialty training.

Methods

We employed Participatory Action Research (PAR)-methods, incorporating Participatory Learning and Action (PLA)-techniques to ensure equal voices for all stakeholders in shaping Diversity, Equity, and Inclusion (DEI)-strategies for GP-specialty training. Our approach engaged stakeholders within two pilot GP-specialty training institutes across diverse roles, including management, support staff, in-faculty teachers, in-clinic supervisors, and trainees, representing ethnic minorities and the majority population. Purposeful convenience sampling formed stakeholder- and co-reader groups in two Dutch GP-specialty training institutes. Stakeholder discussion sessions were based on experiences and literature, including two relevant frameworks, and explored perspectives on the dynamics of potential ethnic minority trainees’ disadvantages and opportunities for inclusive strategies. A co-reader group commented on discussion outcomes. Consequently, a management group prioritized suggested strategies based on expected feasibility and compatibility.

Results

Input from twelve stakeholder group sessions and thirteen co-readers led to implementation guidance for seven inclusive learning environment strategies, of which the management group prioritized three:

• Provide DEI-relevant training programs to all GP-specialty training stakeholders;

• Appoint DEI ambassadors in all layers of GP-specialty training;

• Give a significant voice to minority GP-trainees in their education.

Conclusion

The study’s participatory approach engaged representatives of all GP-specialty training stakeholders and identified seven inclusive learning climate strategies, of which three were prioritized for implementation in two training institutions.

Peer Review reports

Introduction

Following international migration trends [1, 2], diversity among students and trainees is growing [3, 4], with each of them bringing their specific cultural values, family- and migration histories [5]. However, postgraduate medical ethnic minority GP-trainees still face underrepresentation [3, 4] and may encounter unequal opportunities for success compared to their majority peers [6,7,8,9]. Learning climate-related factors, notably those related to lacking inclusiveness, likely play a pivotal role in this discrepancy [10,11,12].

Educational opportunities in GP-specialty training primarily rely on in-clinic learning, encompassing formal and informal contexts. Formal learning, characterized by structured, planned, and accredited activities within educational institutions, coexists with less structured informal learning, which is self-directed and arises from in-clinic everyday experiences and interactions, often susceptible to unspoken norms. While both approaches complement each other in providing a well-rounded education, the informal context might inadvertently reflect dominant cultural values and attitudes, potentially affecting in-classroom learning [13,14,15]. Particularly for ethnic minority GP-trainees, this lacking transparency may contribute to an increased risk of facing underperformance assessments, as these unspoken norms and values may not be self-evidently familiar to them [10,11,12].

Learning environments are subject to complex dynamics. Understanding the interconnected constructs of these dynamics is crucial for implementing transformative changes [16]. Accordingly, changes for inclusive learning opportunities require input from all organizational layers [17].

Study objectives

With this study, we aimed to develop broadly supported recommendations for an inclusive learning climate in Dutch GP-specialty training.

Methods

Design

We used a qualitative Participatory Action Research (PAR) approach [18, 19], applying Participatory Learning and Action (PLA) techniques in stakeholder groups combined with insights from literature (Appendix) along with GP-trainees’ experiences related to inclusive education, to actively engage stakeholders in an inclusive dialogue [20,21,22]. This approach supported co-ownership, promoted compatibility with the organization’s actual needs, and facilitated successful implementation [23].

We employed two conceptual frameworks to shape the topic lists for stakeholder groups and guide result analysis.

  1. 1.

    The Building Equity Taxonomy (BET) framework for Diversity, Equity, and Inclusion (DEI), addressing students’ needs for equal educational opportunities, and covering the areas of physical integration, social-emotional engagement, equal learning opportunities, instructional excellence, and fostering inspired learners [24, 25] (Fig. 1). This framework is relevant to various educational settings, including GP-specialty training [12, 26,27,28,29].

Fig. 1
figure 1

Building Equity Taxonomy [24] compared to Maslow’s hierarchy of needs [25]

  1. 2.

    The Wensing & Grol framework implementation guidance, equivalent to the internationally recognized Consolidated Framework for Implementation Research (CFIR) [30]. It provides implementation guidance for complex organizations, including clinical healthcare and educational settings [30, 31] (Fig. 2). This framework underpinned our implementation guidance, which the management team used for prioritization.

Fig. 2
figure 2

The Wensing & Groll model for implementation guidance [30]

Setting

This study took place at Amsterdam UMC’s two GP-specialty training institutes (AMC and VUmc). These institutes have demonstrated commitment to inclusiveness in their 2020–2022 annual reports, and they collaborate with the six other Dutch GP-specialty training institutes under GP-specialty Training Netherlands (HN).

One in three medical graduates in the Netherlands aims to enter GP-specialty training. In response to national medical demands, HN annually expands its acceptance of new trainees, projecting 921 in 2023 and an anticipated 1,190 in 2024, distributed across eight training institutes. About 17% of these trainees belong to ethnic minority groups, with most having completed pre-training at Dutch Medical Schools and a smaller group having graduated abroad [7]. Due to General Data Protection Regulation (GDPR) restrictions, the precise distribution of minority trainees across the eight national institutes remains undisclosed. However, a prior quantitative study indicated that by 2023, our pilot institutes showed a relatively proportional representation of Dutch GP-specialty training [7]. However, it is essential to note that qualitative research emphasizes a thorough description of the setting to enrich readers’ contextual understanding rather than strict representativeness.

The Dutch GP-specialty training program is a three-year dual-track program, supporting professional growth by combining in-clinic experience learning with one-day-a-week in-faculty education. Entry assessments aspire to guarantee the applicants’ knowledge, motivation, and Dutch proficiency. The program includes protocolled assessments, such as practical observations, systematic testing, and reviews of learning objectives.

Study population

Acknowledging the essential need of broad support for inclusive organizational changes, we engaged participants from all backgrounds represented within the organization. Our study population encompassed the ethnic majority background as well as diverse ethnic backgrounds across all organizational layers (ranging from support personnel, management, educational staff (comprising both faculty and clinical educators), and trainees themselves), divided into two stakeholder groups, one co-reader group, and a management team group (Fig. 3).

Fig. 3
figure 3

Participant groups

Aiming to prevent eligible participants from experiencing researchers’ pressure, researchers sent information letters to team leaders, requesting them to forward in-faculty teachers, in-clinic supervisors, supporting bureau and management personnel, and trainees. From those interested, we purposefully selected twelve participants (six in each stakeholder group), striving for diversity regarding the position in the institute, age, gender, and ethnicity [32]. Stakeholders ranged from supporting bureau and management personnel (further in this text referred to as ‘staff’) to trainees, in-faculty teachers, and in-clinic supervisors representing diverse minority backgrounds as well as the majority background.

Stakeholder groups, each representing one GP-specialty training institute, provided input for inclusive strategies. Additionally, a co-reader group comprising interested individuals not in the stakeholder groups provided further insights through written comments. These groups represented diverse organizational layers, cultural backgrounds, ages, and gender. Representatives from management teams then evaluated and prioritized the suggested strategies.

Data collection

Data collection and analysis took place from January 2021 to December 2022. Two researchers (MN, NvM) familiar with PLA-techniques facilitated six 90-minute PLA-based sessions for each stakeholder group. The sessions focused on inclusive learning environments and GP-specialty training’s inclusivity. In a cyclical process [33](Fig. 4), participants engaged in PLA techniques such as ice-breaking, flexible brainstorming, free-associating, direct ranking, mind-mapping, and visual evaluation. These methods facilitated sharing experiences and opinions and aligning these with relevant literature (Appendix, Table 1) to identify suitable inclusive strategies. After each stakeholder group session, the facilitator-researchers held debriefing sessions to reflect on their roles and identify areas for improvement. Independently, they summarized the key findings from each session and reached consensus through discussions. They presented these summaries in subsequent sessions for a member check and made adjustments based on participants’ feedback. To ensure a broader perspective, the co-reader group commented anonymously on these approved summaries, allowing them to contribute their personal perspectives, opinions, and experiences freely. Stakeholder groups then discussed and implemented these comments in their final session (Fig. 3).

Fig. 4
figure 4

Cyclic phases until consensus of stakeholder groups’ processes [33]

Table 1 Characteristics of stakeholder-, co-reader-, and management group participants

The stakeholder group topic list focused on:

  1. 1.

    Exploring :

    1. a.

      The initial educational context;

    2. b.

      Potential learning climate-related disparities;

    3. c.

      Out-of-the-box wishes and key elements for an inclusive learning climate;

  2. 2.

    Strategy developing and preparing for implementation:

    1. a.

      Recommendations for inclusive GP-specialty training;

    2. b.

      Mapping onto the BET framework’s hierarchical levels of DEI [24](Fig. 1);

    3. c.

      Translating recommendations into actionable strategies.

    4. d.

      Identifying Wensing & Grol conditions and requirements for implementation [30](Fig. 2).

Due to the Covid-19 pandemic, we adapted the study’s in-person design to online methods for creative brainstorming. In these virtual sessions, physical distance and potential distractions of personal environments challenged trust and commitment, especially for GP-trainees who felt vulnerable sharing ideas with in-faculty teachers, in-clinic supervisors, and staff, who might also be their assessors in daily educational contexts [34]. To address this risk, we dedicated extra time, and utilized online tools: Zoom 5.13.11 for breakout rooms, Padlet 200.0.0 for visualizing PLA techniques, and concise PowerPoint presentations for member check summaries and goal-setting [35].

The facilitator-researchers (NvM, MN) collected audio recordings and written co-reader comments. An external bureau transcribed audio-recordings verbatim.

One researcher (NvM) regularly presented our findings during periodic staff meetings. These presentations not only aimed to keep the entire team informed but also played a crucial role in garnering broader support and incorporating diverse opinions for our project.

Data analysis

Within three days after each session, we (NvM, MN, and MV) analyzed the transcribed audio recordings and written co-readers’ comments, and discussed our analyses until consensus.

To provide actionable qualitative insights while responding to ongoing participant feedback, we adopted an inductive rapid qualitative data analysis approach inspired by Hamilton’s model [36,37,38,39]. This method prioritizes identifying key elements and mechanisms over extensive theoretical insights. Through structured data collection using topic lists and Participatory Learning and Action (PLA) techniques, along with expedited transcription, we efficiently analyzed ideas and condensed findings into concise formats like post-interview notes and matrix summaries. Although not a traditional thematic or framework analysis, we employed theme-informed and framework-informed codes to organize data, considering context and group dynamics, which allowed us to explore interactional group dynamics and communication styles in the participants’ discourse and its points of consensus or contention within specific statements [40]. We anticipated this method, aligned with the literature, to yield qualitative outcomes as consistent and rich as traditional in-depth transcription coding while facilitating the analysis of interconnected sessions [36, 41, 42].

We analyzed the stakeholders’ ideas, recommendations, and their identifyed Wensing & Grol conditions and requirements for implementation to create implementation guidance [30]. This guidance encompassed analyzing organizational structure, identifying change potential and barriers, defining the target population, describing tailored DEI-strategies, estimating timelines for internalization processes and implementation, and designing evaluation methods (Fig. 2). Subsequently, we invited management group participants for hybrid (online and in-person) meetings, where they engaged in substantive discussions to evaluate this guidance and prioritize recommended strategies, based on the expected feasibility and compatibility with their setting.

Reflexivity and ethics

Two authors, NM and MN, identify as minority females. While their unique backgrounds enhance sensitivity towards minority peers’ experiences, a potential challenge arises where these experiences resonating with them might be more salient. To mitigate this, we organized reflective debriefing sessions addressing diverse viewpoints and emphasizing the researchers’ roles as instruments in data collection and analysis. During these sessions, we engaged in candid discussions probing our experiences, expectations, preoccupations, and opinions that could have influenced our approach to data collection and analysis.

Also, the roles of participating stakeholders may have influenced views they shared in this research process. They spanned all organizational positions, ranging from department heads to trainees, in-faculty teachers, and in-clinic supervisors, representing both, majority and minority backgrounds. While deliberately seeking these varied insights, we remained mindful of potential power dynamics influenced by different positions or ethnic backgrounds. To foster a safe space and address these dynamics, facilitators employed PLA-techniques, such as ice-breakers. Also, they established clear agreements with all stakeholder group members regarding privacy, openness to differing views, and ensuring safety. Should any commitments be breached, facilitators were trained to address them promptly. In fact, stakeholders demonstrated remarkable respect and curiosity towards understanding each other’s perspectives throughout the process.

Results

Participant characteristics

Table 1 presents participant characteristics for the stakeholder, co-reader, and management groups. In total, 31 stakeholders participated, aged 24 to 60, including eight males, 24 staff members from diverse organizational positions, seven trainees, and 12 ethnic minority participants.

Attendance

The stakeholder group sessions had an attendance rate of 97%. All co-readers responded to the request for comments. During the hybrid management group session, 40% of participants attended in-person, while 60% joined online.

Stakeholder group sessions

In line with the topic list, we organized the results into two sections: [1]Exploring and [2] Strategy developing and preparing for implementation. In Sect. 2, the stakeholders aligned their results with the BET framework and structured them according to the Wensing & Grol framework.

Exploring

The initial educational context

Stakeholders defined inclusiveness in the GP-specialty training as collective curiosity and support for trainees’ unique professional identities, regardless of their characteristics or backgrounds. As preconditions for in-faculty teachers, in-clinic supervisors, and staff, participants mentioned [1] willingness to encounter emotional discomfort [2], embracing failures in order to learn, and [3] acknowledgement of unconscious bias.

‘… we will not always succeed to be without prejudice, that is allowed as long as we will put the effort in gaining awareness’ (participant 2, group 1).

Participants emphasized creating a safe learning environment where all voices, including minority voices, can be heard. They suggested reflective questions starting with:

Could you imagine that…’.

Participants highlighted parallel processes whereby educators foster trainees’ personal and professional development, and GPs support patients’ individual coping styles. Such an inclusive and safe learning environment would act as a flywheel, enhancing the institute’s inclusive image and attracting prospective minority trainees, teachers, and in-clinic supervisors.

Co-readers confirmed these view points and they added their concerns regarding prioritization by some staff members:

‘I have nothing to add. I think it is essential that diversity is given a priority, that we as staff all agree that this is important. The pitfall is that some of them might not see the importance’. (co-reader 2)

Potential learning climate-related disparities

Stakeholders from ethnic minority groups expressed distress experiences in a dominant white world:

‘The GP-specialty training population is predominantly white and female; trainees, in-faculty teachers, and in-clinic supervisors even seem to resemble one another. Without them saying or acting, I continuously feel the stress of having to adapt to them, which I will never be able to’ (participant 2, group 1).

Stakeholders discussed the majority’s naivety in understanding the experience of belonging to a minority and expressed concerns about some DEI programs potentially leading to paradoxical stigmatization. They noted instances where in-faculty teachers appointed minority trainees as representatives for their cultural groups, ignoring the vast diversity within these groups. Also, participants reported stereotyping case reports:

‘They always use the example of the non-Dutch speaking overweight Moroccan mother of seven children, not engaged in any sports, who favors sweet and fatty food, and suffers from diabetes’ (participant 3, group 2).

Co-readers added that this one-sided picture made minority trainees uneasy, feeling discussed rather than equal partners in GP-training. Additionally, they emphasized that presenting DEI programs as non-mandatory, implied that diversity and inclusiveness were not necessarily integral to GP-skills requirements.

‘Mandatory inclusive training for mentors, staff, and teachers holds significant importance, signifying our commitment. Participation in these courses should be integrated into evaluations and annual interviews’. (co-reader 4)

Out-of-the-box wishes and key elements for an inclusive learning climate

Upon the invitation to make a wish:

‘Wouldn’t it be wonderful if….‘,

stakeholders wished for diverse staff as role models, willing to learn from each other, normalizing various meaningful insights, and embracing diverse worldviews:

‘By using these differences, we keep each other awake and open-minded in exploring possibilities; thus, we allow ourselves to grow without assuming that our paved path is always the best way at the time’ (participant 3, group 1).

Stakeholders indicated the institute’s responsibility to educate GP-trainees for a diverse patient population as an essential component of an inclusive learning environment. Key elements related to such inclusiveness were:

The GP-specialty training should represent society in all its diversity:

‘It’s been a few years since I started GP-specialty training, of course, but… I’m just digging whether I had a feeling of: “I fit in there” or: “I recognize my roots there”. These are important feelings to me to feel safe at my work- and study place’ (participant 7, group 1);

A diverse GP workforce meets patients’ appreciation for GPs they can identify with:

‘Regarding this cultural background or ethnicity, I have the impression that patients from ethnic minorities often liked that I obviously am not Dutch, they said, “oh, you are not Dutch, are you?“, it led to recognition, a little laugh, and connected us. Having a doctor just like them helped my patients to share their concerns.’ (participant 2, group 2);

GP-trainees need identifiable and diverse educational role models:

‘The moment you sit down together and see that diversity, …brings different working styles, learning styles, or communication styles… that you realize we have to do it together, the greater the diversity, the more we learn from one another, the higher we rise, the more fun and creative ideas…’ (participant 4, group 2);

Diverse GP-trainee cohorts improve mutual learning processes:

‘To me, utilizing diversity means that there’s always someone in the classroom who says, “Okay, so what if we look at it from that perspective or through those glasses?’ (participant 1, group 1).

Co-readers agreed and added that GP-specialty training already utilized diversity among in-faculty teachers to some extent:

‘Great idea! Diversity among teachers is already being leveraged to some extent. Trainees can synthesize a blend of styles and insights from different teachers and mentors. Expanding on this concept could help cultivate a more inclusive learning environment’. (co-reader 1)

Strategy developing and preparing for implementation

Recommendations for an inclusive GP-specialty training

Participants (stakeholders in collaboration with co-readers) made six fundamental recommendations and mapped these onto the BET framework levels to ensure all aspects of inclusive education would be covered [24] (Table 2).

Table 2 Stakeholders’ and co-readers’ recommendations related to Building Equity Taxonomy (BET) levels

Actionable strategies

From these recommendations, participants derived seven actionable strategies for promoting inclusive GP-specialty training (Table 3).

Table 3 Suggested actionable strategies
  1. 1.

    Provide a clear message of inclusiveness in all internal and external communications.

Participants explored various means and media platforms for promoting the GP-specialty training’s DEI core values (websites, ads, social media, podcasts), focusing on design, content, and appeal to the target group. They recommended involving trainees with media experience rather than exclusively hiring specialized communication consultants.

  1. 2.

    Appoint DEI ambassadors in all layers of the organization.

Participants suggested involving employees as DEI ambassadors to effectively spread DEI core values in the organization. Ambassadors would undergo comprehensive training in DEI, reflective skills, leadership, and change management. They would also attend conferences, masterclasses, join knowledge networks, and contribute to think tank initiatives as part of their preparation.

  1. 3.

    Facilitate procedures for secure incident reporting.

Participants highlighting the significant impact of unintentional discriminatory behavior, often resulting in experiencing barriers to reporting such incidents. They proposed implementing low-threshold and secure reporting procedures with targeted questions on DEI and (micro)aggression. Regular team sessions would enable open discussions based on anonymous reports, fostering inclusive education, uncovering organizational trends, and providing support for trainees who faced discrimination, microaggression, or exclusion. Confidential advisors would receive training in DEI, reflective skills, and relevant legislation.

  1. 4.

    Give a significant voice to minority trainees in ongoing program development.

Participants advised inviting minority trainees to round table discussions, fostering insider perspective exchange with mutual respect, critical reflection, and empathy. Including these diverse voices would promote resilience and professional growth and attract eligible trainees and staff from diverse backgrounds.

  1. 5.

    Assign more than one in-faculty teacher per group / in-clinic training.

GP-trainees - like all individuals - naturally mirror the behavior of significant others, such as teachers, in-clinic supervisors, or peers. Participants believed that trainees with multiple role models would outperform those with single role models. They suggested introducing dual in-faculty teachers and dual in-clinic supervisors as additional role models and an extra pair of eyes during education. To ensure success, participants recommended training programs for optimum role model utilization.

  1. 6.

    Offer ‘just-in-time’ learning.

Participants agreed that effective learning is closely related to immediate learning needs. For GP-trainees, such learning needs often arise from societal encounters in the consultation room, e.g., guiding Muslims during Ramadan while simultaneously managing diabetes or comprehending increasing PTSD symptoms around Keti Koti (Afro-Surinamese Emancipation Day). Timely incorporating these contextual factors into training programs could provide directly applicable knowledge.

  1. 7.

    Provide mandatory DEI relevant training programs for professional development.

Participants emphasized the necessity of new knowledge, skills, and attitudes. They considered within-group differences valuable learning tools for diverse personal and professional development paths. Well-trained staff and trainees could drive inclusive knowledge networks, empower the organization, and positively influence external perceptions. Thus, they recommended mandatory and tailored training programs aligned with the anticipated learning needs from the suggested strategies. Where applicable, they advised considering outsourcing.

Conditions and requirements for implementation

Participants indicated the importance of in-faculty teachers, in-clinic supervisors, and staff having the courage to be vulnerable. They emphasized the essence of transparent norms and values and a welcoming learning environment, and they highlighted an attitude of:

‘… genuinely enjoying to support a diverse population in their growth towards their professional identities’ (participant 6, group 2).

‘Implementing these ideas demands courage and vulnerability, particularly as their execution could inadvertently carry stigmatizing effects’. (co-reader 6)

In this context, they mentioned the risk of unconscious bias, which could require external expert trainers at certain stages:

‘Well, you know, I had a trainee of Moroccan descent, and it shocked me that, while I always thought to be very open, diversity-minded, and curious for everything and everyone, I found it way more difficult to connect than I’d admit. I wonder what would have helped me unveil this blind spot in an earlier stage…’ (participant 5, group 1).

‘… allow and embrace the differences, see them as opportunities that actually add learning qualities, and not take them away? So, professionalism will become more colorful, and it can be viewed from different points of view, not just the traditional, established perspectives and routes’ (participant 1, group 1).

Ultimately, we provided the management group with implementation guidance for these seven strategies, along with an analysis of the target group and context, and summaries of relevant literature on DEI best practices in educational settings (Appendix). The management team agreed that enhancing DEI should have priority in Dutch GP-specialty training:

‘We should acknowledge that we are trailing behind societal advancements in diversity. Therefore, maintaining a strong focus on this topic must stay a priority’ (participant 5, management group).

Based on these comprehensive data, the management group prioritized strategies that covered the overarching recommendations and BET-levels (detailed in Table 3; Fig. 1), which aided in selecting strategies with anticipated effectiveness. To enhance alignment with the organizational requirements and feasibility, they considered implementation requirements, staff feedback from our presentations during periodic meetings, and opportunities for synergy with existing projects in other Amsterdam UMC departments.

‘We can see that literature describes these strategies as effective and we assume that stakeholders meticulously aligned them with the institute’s needs. Let us not repeat that process but rather look into strategies that can be implemented effectively in our setting’ (participant 1, management group).

‘For each suggested strategy, this guidance envisions its coverage and practical implications. Now, it is up to us to consider how far we are willing to commit. This process prompts pertinent questions on specific effective actions’ (participant 2, management group).

The management group prioritized three strategies:

  • Appoint DEI ambassadors in all organizational levels,

  • Give a significant voice to minority trainees in ongoing program development,

  • Provide mandatory DEI-relevant training programs for professional development to all involved in GP-specialty training.

Discussion

Summary of findings

In twelve PLA-based stakeholder sessions, participants explored perspectives on potential disparities, underlying causes, and aspirations for an inclusive learning climate in the Dutch GP-specialty training. They suggested seven strategies based on six overarching recommendations, which they presented embedded in an implementation guidance to the management group:

  1. 1.

    Provide a clear message of inclusiveness in all internal and external communications.

  2. 2.

    Appoint DEI ambassadorsFootnote 1 in all layers of the organization

  3. 3.

    Facilitate procedures for secure incident reporting.

  4. 4.

    Give a significant voice to minority trainees in ongoing program development.

  5. 5.

    Assign more than one in-faculty teacher per group / in-clinic supervisor per trainee.

  6. 6.

    Offer ‘just-in-time’ learning.

  7. 7.

    Provide mandatory DEI relevant training programs for professional development.

The management team selected strategies 2, 4, and 7, deeming them most effective, feasible, and aligned with the organization’s requirements.

Comparison to existing literature

Worldwide attention to inclusive learning climates in postgraduate medical education revealed the complexity and multidimensionality of educational constructs and institutes [29, 43]. Interpretations of formal and informal learning contexts within these environments depend on the perspectives of various stakeholders [15]. Consequently, unconsciously normalized rules and codes across all layers may implicitly exclude ethnic minority professionals and -trainees in many ways throughout their careers [44].

This paper extends the literature on inclusive GP-specialty training [15, 43, 44], detailing the efforts to design- and create broad support for inclusive training strategies. Like most organizational changes, implementing inclusive strategies in GP-specialty training posed challenges and demanded a focus on building confidence and trust in novel approaches [45]. Hence, understanding the values and expectations of target groups and tailoring strategies to meet their needs and aspirations was crucial. Our study involved representatives from all key stakeholders, including ethnic minority trainees, aiming to address critical research gaps and enhance knowledge quality, relevance, and impact [46]. Collaborative decisions, rooted in an equal and reciprocal partnership, empowered stakeholders, raised management team awareness and inspired the research team [47]. These effects mirror findings in previous PAR studies on inclusive primary healthcare [48] and highlight PAR’s role as a catalyst for transformative change in GP-specialty training [33].

Stakeholder insights, combined with DEI-strategy literature, underscored the need for a gradual, committed cultural shift towards inclusivity in the learning environment. Based on these insights, the management group recognized that this transformation would necessitate a set of strategies addressing inclusiveness at various levels rather than relying on one single intervention [26, 28, 49, 50]. They employed our Wensing and Grol-based implementation guidance to select the following feasible strategies aligned with the GP-specialty training context as a first step in an ongoing process:

  • Providing mandatory DEI-relevant training programs to all stakeholders supports cultural responsiveness within all strategies to be implemented. It facilitates understanding how cultural backgrounds and experiences influence teaching and learning [49]. Ultimately, it fosters engagement and motivation to create collaborative learning environments and accommodate learners’ needs based on their diverse backgrounds [26].

  • Appointing DEI ambassadors in all layers of the organization has in other contexts proven to enhance the effectiveness of DEI-related strategic initiatives [51]. DEI ambassadors engage change agents within their teams, foster collaboration and effective communication, facilitate diversity goals, and involve key stakeholders in sustainable, inclusive changes [50].

  • Giving a significant voice to minority trainees empowers and amplifies their agency. Including their experiences and perspectives in staff meetings and brainstorming sessions is a crucial first step toward an open and innovative culture. Prior research indicated that promoting minority trainees’ participation requires supportive supervision, encouraging them to share transformative ideas [28].

Strengths and limitations

Our participatory approach fostered broad support across all organizational levels. PLA-based stakeholder discussions facilitated open dialogue, refined ideas, and sparked valuable insights. Co-reader feedback prompted stakeholder group participants to reevaluate their interpretation of specific experiences. This approach allowed diverse perspectives and theoretical idea saturation, aiding participants in identifying seven actionable strategies with high potential for effective implementation. In turn, these results allowed the management group to leverage their organizational expertise and prioritize three strategies they considered feasible and compatible with the organization’s requirements.

While most post-graduate medical education settings share similarities, contextual variations, such as educational emphasis and cultural factors, may exist, leading to potential limitations in the transferability of our findings. Nonetheless, the dynamics between informal and formal in-classroom learning remain pertinent across various postgraduate medical contexts, where in-clinic learning, shaped by day-to-day experiences and supervisor-trainee dynamics, inevitably influences formal learning objectives and settings. Also, our study’s confinement to two Dutch GP-specialty training institutes and its relatively modest participant count may require caution in the transferability of our findings to other similar settings. In light of this, it is noteworthy that statistics from a previous quantitative study suggest that by 2023, our pilot institutes closely mirrored Dutch GP-specialty training in terms of minority trainee [7]. Moreover, we provided meticulous descriptions of our setting to enhance contextual understanding, aiding in assessing transferability to similar settings. Additionally, the explicit commitment to inclusiveness by the participating GP-specialty training institutions, which could be instrumental in promoting successful implementation, could pose challenges when transferring the results to less DEI-focused settings.

Still, employing multiple sources by connecting stakeholder perspectives to relevant literature and two frameworks enabled participants to structure their thoughts and opinions on the organization’s DEI strengths and limitations, along with the opportunities and challenges for implementation. For future researchers, this approach may prove valuable in identifying overarching concepts and theories that transcend specific individuals or contexts and facilitate the assessment of the transferability of our findings to similar educational settings [52,53,54,55].

Implications for further research and practice

Fostering a DEI-minded culture in post-graduate medical training calls for a multifaceted strategy. As training institutes diversify and curricula address nuanced topics, skills for adeptly navigating complex conversations become increasingly critical for educational staff. The ongoing process of promoting inclusive teaching, assessment, and curriculum design abilities will necessitate the inclusion of a wide range of perspectives. Consequently, we recommend involving stakeholders from the most diverse backgrounds possible. Also, the explicit commitment to inclusiveness by the participating GP-specialty training institutions may pose challenges when transferring the results to less DEI-focused settings. Therefore, we suggest further investigation in such contexts to better understand the transferability of our results.

Ensuring high-quality, inclusive learning environments in postgraduate medical education is crucial for educational opportunities and the overall quality of healthcare [56]. However, this inclusiveness is not solely shaped by the beliefs and values of teachers; it is also intricately influenced by the complex social and cultural dynamics within educational institutions [29]. Inclusiveness strategies are catalysts for enduring cultural transformation, demanding the consistent integration of multiple strategies through incremental steps over an extended period [43]. The three strategies identified in our study, which were prioritized for implementation, represent initial strides toward instigating this cultural transformation. Subsequent phases involving evaluation, adaptation, and implementation of additional strategies are imperative for sustaining engagement in a culture of inclusive postgraduate medical education. All Dutch GP-specialty training institutes closely monitor our findings and have committed to implementing mandatory DEI-relevant training programs for their staff and trainees.

Additional research on the impact of the implemented strategies and the level of stakeholder engagement throughout the implementation phase is needed. This follow-up research should encompass inclusive teaching methods, assessment strategies, curriculum design, attitudes, and the ethnic minority trainees’ experienced inclusion aligned with the BET framework.

Conclusion

Engaging stakeholders in PLA-based sessions at two Dutch GP-specialty training institutes proved instrumental in identifying recommendations for an inclusive learning climate. Stakeholders identified seven tangible DEI-strategies, addressing all five BET aspects:

  1. 1.

    Provide a clear message of inclusiveness in all internal and external communications: enhances inclusive accessibility and a diverse learning community;

  2. 2.

    Appoint DEI ambassadors in all layers of the organization: promotes knowledge exchange, reflection on potential biases, and active engagement in DEI networks;

  3. 3.

    Facilitate secure DEI-incident reporting procedures;

  4. 4.

    Give a significant voice to minority trainees in ongoing program development: empowers them and creates reciprocal learning;

  5. 5.

    Assign more than one teacher per group / in-clinic training: creates multiple role models and perspectives;

  6. 6.

    Offer ‘just-in-time’ learning: fosters social and educational engagement;

  7. 7.

    Provide mandatory DEI-relevant training programs for professional development: promotes DEI-expertise and awareness among all involved.

Based on anticipated feasibility and effectiveness, the management group prioritized strategy numbers 2, 4, and 7 for implementation.

Our integrative approach supported collaborative, context-specific strategy development and prioritization, effectively balancing anticipated effectiveness and compatibility. As such, this approach will prove valuable in identifying widely supported DEI strategies within varying and complex post-graduate medical educational contexts.

Data availability

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.

Notes

  1. Ambassadors actively promote DEI values within teams by exchanging knowledge and experiences, enhancing expertise through training and literature, and addressing diversity cases through consultancy roles.

References

  1. Abel GJ, Cohen JE. Bilateral international migration flow estimates for 200 countries. Sci Data. 2019;6(1):82.

    Article  Google Scholar 

  2. Netherlands S. How many people immigrate to the Netherlands? Web page. The Hague, the Netherlands: Statistics Netherlands; 2022. 25/03/2022.

    Google Scholar 

  3. Jabbarpour Y, Westfall J. Diversity in the Family Medicine workforce. Fam Med. 2021;53(7):640–3.

    Google Scholar 

  4. Wusu MH, Tepperberg S, Weinberg JM, Saper RB. Matching our mission: a Strategic Plan to create a Diverse Family Medicine Residency. Fam Med. 2019;51(1):31–6.

    Article  Google Scholar 

  5. Dinos S, Ascoli M, Owiti JA, Bhui K. Assessing explanatory models and health beliefs: an essential but overlooked competency for clinicians. BJPsych Adv. 2017;23(2):106–14.

    Article  Google Scholar 

  6. Stegers-Jager K, Steyerberg E, Cohen-Schotanus J, Themmen A. Ethnic disparities in undergraduate pre-clinical and clinical performance. Med Educ. 2012;46:575–85.

    Article  Google Scholar 

  7. van Moppes NM, Willems S, Nasori M, Bont J, Akkermans R, van Dijk N et al. Ethnic minority GP trainees at risk for underperformance assessments: a quantitative cohort study. BJGP Open. 2023;7(1).

  8. Esmail A, Roberts C. Academic performance of ethnic minority candidates and discrimination in the MRCGP examinations between 2010 and 2012: analysis of data. BMJ (Clinical Res ed). 2013;347:f5662.

    Google Scholar 

  9. Jones AC, Nichols AC, McNicholas CM, Stanford FC. Admissions is not enough: the racial achievement gap in Medical Education. Acad Med. 2021;96(2):176–81.

    Article  Google Scholar 

  10. Bullock JL, Lockspeiser T, Del Pino-Jones A, Richards R, Teherani A, Hauer KE. They Don’t See a Lot of People My Color: A Mixed Methods Study of Racial/Ethnic Stereotype Threat Among Medical Students on Core Clerkships. Acad Med. 2020;95(11S Association of American Medical Colleges Learn Serve Lead: Proceedings of the 59th Annual Research in Medical Education Presentations):S58-s66.

  11. Diaz T, Navarro JR, Chen EH. An Institutional Approach to fostering inclusion and addressing racial Bias: implications for diversity in Academic Medicine. Teach Learn Med. 2020;32(1):110–6.

    Article  Google Scholar 

  12. Roberts L, Belonging R, Inclusion, Diversity in Medical Education. Acad Medicine: J Association Am Med Colleges. 2020;95:661–4.

    Article  Google Scholar 

  13. Karnieli-Miller O, Vu TR, Holtman MC, Clyman SG, Inui TS. Medical students’ professionalism narratives: a window on the informal and hidden curriculum. Acad Med. 2010;85(1):124–33.

    Article  Google Scholar 

  14. Sagasser M, Kramer A, Fluit L, Weel C, Van der Vleuten C. Self-entrustment: how trainees’ self-regulated learning supports participation in the workplace. Adv Health Sci Education: Theory Pract. 2017;22.

  15. Schönrock-Adema J, Bouwkamp-Timmer T, Hell E, Cohen-Schotanus J. Key elements in assessing the educational environment: Where is the theory? Advances in health sciences education: theory and practice. 2012;17.

  16. Goodyear P, Carvalho L. The Analysis of Complex Learning Environments. 2019. pp. 49–65.

  17. Kumagai AK, Lypson ML. Beyond cultural competence: critical consciousness, social justice, and multicultural education. Acad Med. 2009;84(6):782–7.

    Article  Google Scholar 

  18. Brydon-Miller M, Maguire P. Participatory action research: contributions to the development of practitioner inquiry in education. Educational Action Res. 2009;17(1):79–93.

    Article  Google Scholar 

  19. Chevalier J, Buckles D. Participatory Action Research: Theory and Methods for Engaged Inquiry2019.

  20. Bozalek V, Biersteker L. Exploring power and privilege using participatory learning and action techniques. Social Work Educ. 2010;29(5):551–72.

    Article  Google Scholar 

  21. de Brún T, Brún M, Weel-Baumgarten E, Burns N, Dowrick C, Lionis C et al. Using Participatory Learning & Action (PLA) research techniques for inter-stakeholder dialogue in primary healthcare: an analysis of stakeholders’ experiences. Res Involv Engagem. 2017;3.

  22. Allaham S, Kumar A, Morriss F, Lakhanpaul M, Wilson E, Sikorski C, et al. Participatory learning and action (PLA) to improve health outcomes in high-income settings: a systematic review protocol. BMJ Open. 2022;12:e050784.

    Article  Google Scholar 

  23. Ukowitz M. Who defines innovation in education? Participatory action research and organisational learning. Educational Action Res. 2023;31(2):366–83.

    Article  Google Scholar 

  24. Smith D, Frey N, Pumpian I, Fisher D. Building equity: policies and practices to empower all learners. ASCD; 2017.

  25. Maslow AH. Motivation and personality. Harper & Row; 1970.

  26. Carter P, Darling-Hammond L. Teaching diverse learners. Handbook of research on teaching. 2016:593–638.

  27. Severiens S, Wolff R. Study success of students from ethnic minority backgrounds: an overview of explanations for differences in study careers. Routledge Int Handb High Educ. 2009:61–72.

  28. Voogt J, Taris T, van Rensen E, Schneider M, Noordegraaf M, Schaaf MF. Speaking up, support, control and work engagement of medical residents. A structural equation modelling analysis. Med Educ. 2019;53.

  29. Gay G. Culturally responsive teaching: theory, research, and practice. teachers college; 2018.

  30. Wensing M, Grol R. Knowledge translation in health: how implementation science could contribute more. BMC Med. 2019;17(1):88.

    Article  Google Scholar 

  31. Fernandez ME, Ten Hoor GA, van Lieshout S, Rodriguez SA, Beidas RS, Parcel G, et al. Implementation mapping: using intervention mapping to develop implementation strategies. Front Public Health. 2019;7:158.

    Article  Google Scholar 

  32. Mays N, Pope C. Qualitative research in health care. Assessing quality in qualitative research. BMJ. 2000;320(7226):50–2.

    Article  Google Scholar 

  33. Cordeiro L, Rittenmeyer L, Soares CB. Action research methodology in the health care field: a scoping review protocol. JBI Database Syst Rev Implement Rep. 2015;13(8):70–8.

    Article  Google Scholar 

  34. Akman H, Plewa C, Conduit J. Co-creating Value in Online Innovation communities. Eur J Mark. 2018;53.

  35. Fernandez A, Shaw G. Academic Leadership in a time of Crisis: the coronavirus and COVID-19: academic leadership in a time of crisis. J Leadersh Stud. 2020;14.

  36. Taylor B, Henshall C, Kenyon S, Litchfield I, Greenfield S. Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open. 2018;8:e019993.

    Article  Google Scholar 

  37. Brown-Johnson C, Safaeinili N, Zionts D, Holdsworth LM, Shaw JG, Asch SM, et al. The Stanford Lightning Report Method: a comparison of rapid qualitative synthesis results across four implementation evaluations. Learn Health Syst. 2020;4(2):e10210.

    Article  Google Scholar 

  38. Lewinski AA, Crowley MJ, Miller C, Bosworth HB, Jackson GL, Steinhauser K, et al. Applied Rapid Qualitative Analysis to develop a contextually appropriate intervention and increase the likelihood of Uptake. Med Care. 2021;59:S242–51.

    Article  Google Scholar 

  39. Nevedal A, Reardon C, Opra Widerquist M, Jackson G, Cutrona S, White B, Damschroder L. Rapid versus traditional qualitative analysis using the Consolidated Framework for Implementation Research (CFIR). Implement Sci. 2021;16.

  40. Vicsek L. A Scheme for analyzing the results of Focus Groups. Int J Qualitative Methods. 2007;6(4):20–34.

    Article  Google Scholar 

  41. Vindrola-Padros C, Johnson G. Rapid Techniques in Qualitative Research: a critical review of the literature. Qual Health Res. 2020;30:1596–604.

    Article  Google Scholar 

  42. Gale R, Wu J, Erhardt T, Bounthavong M, Reardon C, Damschroder L, Midboe A. Comparison of rapid vs in-depth qualitative analytic methods from a process evaluation of academic detailing in the Veterans Health Administration. Implement Sci. 2019;14.

  43. Miles S, Ahuja A. Learning from difference: Sharing international experiences of developments in inclusive education. The SAGE handbook of special education. 2007:131 – 45.

  44. Waldring IE. The fine art of boundary sensitivity: second-generation professionals engaging with social boundaries in the workplace. University of Antwerp; 2018.

  45. May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: normalization process theory. Implement Sci. 2009;4(1):29.

    Article  Google Scholar 

  46. O’Reilly-de Brún M, de Brún T, Okonkwo E, Bonsenge-Bokanga J-S, De Almeida Silva MM, Ogbebor F, et al. Using Participatory Learning & Action research to access and engage with ‘hard to reach’ migrants in primary healthcare research. BMC Health Serv Res. 2016;16(1):25.

    Article  Google Scholar 

  47. Weis L, Fine M. Working Method: Research and Social Justice. Working Method: Research and Social Justice. 2004:1-186.

  48. O’Reilly-de Brún M, De Brún T. The use of Participatory Learning & Action (PLA) research in intercultural health: some examples and some questions. Engaging service-users in co-designing primary health care. 2010:27.

  49. Lupton KL, O’Sullivan PS. How Medical Educators Can Foster Equity and Inclusion in Their Teaching: A Faculty Development Workshop Series. Acad Med. 2020;95(12S Addressing Harmful Bias and Eliminating Discrimination in Health Professions Learning Environments):S71-s6.

  50. Kolluru S, Wanat MA, Ficzere CH, Akiyode O, Haber SL, Hayatshahi A, et al. Review of Best practices for Diversity, Equity, and inclusion committees within Colleges of Pharmacy. Am J Pharm Educ. 2023;87(4):ajpe9043.

    Article  Google Scholar 

  51. Miguel A, Sloughter JM, Dorsey JM, Hartley R, Shih FJ, Crevier J, editors. What’s Next? From Analysis to Action. 2021 CoNECD; 2021.

  52. Carminati L. Generalizability in qualitative research: a tale of two traditions. Qual Health Res. 2018;28(13):2094–101.

    Article  Google Scholar 

  53. Shenton A. Strategies for ensuring trustworthiness in qualitative Research projects. Educ Inform. 2004;22:63–75.

    Article  Google Scholar 

  54. Maxwell J. Why qualitative methods are necessary for generalization. Qualitative Psychol. 2020;8.

  55. Polit D, Beck C. Generalization in quantitative and qualitative research: myths and strategies. Int J Nurs Stud. 2010;47:1451–8.

    Article  Google Scholar 

  56. Brown J, Chapman T, Graham D. Becoming a new doctor: a learning or survival exercise? Med Educ. 2007;41:653–60.

    Article  Google Scholar 

Download references

Acknowledgements

We affirm that no individuals other than the listed authors provided professional writing or analysis services. Still, we thank all anonymous participants whose contributions enriched this study.

Funding

We declare that the authors have no external funding to report.

Author information

Authors and Affiliations

Authors

Contributions

All authors have made substantial contributions to the conception OR design of the work; OR the acquisition, analysis, OR interpretation of data; OR have drafted the work or substantively revised it. All authors have approved the submitted version (and any substantially modified version that involves the author’s contribution to the study); and have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. Contributions per author: N.M. van Moppes: Conception, Design of the work, Acquisition, Analysis and interpretation of data, Drafted the work and integrated all revisions; M. Nasori: Conception, Design of the work, Acquisition, Analysis and interpretation of data, Substantively revised the work; J. Bont: Substantively revised the work; J.M. van Es: Substantively revised the work; M.R.M. Visser: Conception, Design of the work, Substantively revised the work; M.E.T.C. van den Muijsenbergh: Conception, Design of the work, Substantively revised the work.

Corresponding author

Correspondence to N.M. van Moppes.

Ethics declarations

Ethics approval and consent for participate

Participation in the study was voluntary, with informed consent for participation and publication obtained from all participants. The Dutch Association for Medical Training’s Ethical Review Board approved the study (file number 2020.6.1). Data handling adhered to the General Data Protection Regulation and Amsterdam UMC Clinical Research Unit procedures, and we shared the study results with all participants.

Competing interests

We declare that the authors have no competing interests as defined by BMC Medical Education or any other interests that might be perceived to influence the results and/or discussion reported in this paper.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

van Moppes, N., Nasori, M., Bont, J. et al. Towards inclusive learning environments in post-graduate medical education: stakeholder-driven strategies in Dutch GP-specialty training. BMC Med Educ 24, 550 (2024). https://doi.org/10.1186/s12909-024-05521-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-024-05521-z

Keywords