References

Allan HT, Smith P. Are pedagogies used in nurse education research evident in practice?. Nurse Educ Today. 2010; 30:(5)476-479 https://doi.org/10.1016/j.nedt.2009.10.011

Biggs J, Tang C. Teaching for quality learning at university, 4th edn. Maidenhead: Open University Press; 2011

Bryman A. Social research methods, 4th edn. Oxford: Oxford University Press; 2012

Clark E, Draper J, Rogers J. Illuminating the process: enhancing the impact of continuing professional education on practice. Nurse Educ Today. 2015; 35:(2)388-394 https://doi.org/10.1016/j.nedt.2014.10.014

Creswell JW, Creswell JD. Research design: qualitative, quantitative, and mixed methods approaches, 5th edn. London: Sage Publications; 2017

Crozier K, Moore J, Kite K. Innovations and action research to develop research skills for nursing and midwifery practice: the Innovations in Nursing and Midwifery Practice Project study. J Clin Nurs. 2012; 21:(11-12)1716-1725 https://doi.org/10.1111/j.1365-2702.2011.03936.x

Doody O, Slevin E, Taggart L. Focus group interviews in nursing research: part 1. Br J Nurs. 2013a; 22:(1)16-19 https://doi.org/10.12968/bjon.2013.22.1.16

Doody O, Slevin E, Taggart L. Preparing for and conducting focus groups in nursing research: part 2. Br J Nurs. 2013b; 22:(3)170-173 https://doi.org/10.12968/bjon.2013.22.3.170

Draper J, Beretta R, Kenward L, McDonagh L, Messenger J, Rounce J. ‘Ready to hit the ground running’: alumni and employer accounts of a unique part-time distance learning pre-registration nurse education programme. Nurse Educ Today. 2014; 34:(10)1305-1310 https://doi.org/10.1016/j.nedt.2014.06.007

Draper J, Clark L, Rogers J. Managers' role in maximising investment in continuing professional education. Nurs Manage. 2016; 22:(9)30-36 https://doi.org/10.7748/nm.22.9.30.s29

Froggatt K, Hockley J. Action research in palliative care: defining an evaluation methodology. Palliat Med. 2011; 25:(8)782-787 https://doi.org/10.1177/0269216311420483

Gurukkal R. Towards Outcome-based Education. Higher Education for the Future. 2018; 5:(1)1-3 https://doi.org/10.1177/2347631117740456

Gijbels H, O'Connell R, Dalton-O'Connor C, O'Donovan M. A systematic review evaluating the impact of post-registration nursing and midwifery education on practice. Nurse Educ Pract. 2010; 10:(2)64-69 https://doi.org/10.1016/j.nepr.2009.03.011

Gould D, Drey N, Berridge EJ. Nurses' experiences of continuing professional development. Nurse Educ Today. 2007; 27:(6)602-609 https://doi.org/10.1016/j.nedt.2006.08.021

Hegney DG, Francis K. Action research: changing nursing practice. Nurs Stand. 2015; 29:(40)36-41 https://doi.org/10.7748/ns.29.40.36.e8710

Jayasekara RS. Focus groups in nursing research: methodological perspectives. Nurs Outlook. 2012; 60:(6)411-416 https://doi.org/10.1016/j.outlook.2012.02.001

Jonas D, Burns B. The transition to blended e-learning. Changing the focus of educational delivery in children pain management. Nurse Educ Pract. 2010; 10:(1)1-7 https://doi.org/10.1016/j.nepr.2009.01.015

Koch LF. The nursing educator's role in e-learning: A literature review. Nurse Educ Today. 2014; 34:(11)1382-1387 https://doi.org/10.1016/j.nedt.2014.04.002

Krueger R, Casey M. Focus groups. A practical guide for applied research, 5th edn. Thousand Oaks (CA): Sage Publications; 2015

Lahti M, Kontio R, Pitkänen A, Välimäki M. Knowledge transfer from an e-learning course to clinical practice. Nurse Educ Today. 2014; 34:(5)842-847 https://doi.org/10.1016/j.nedt.2013.09.003

Lee NJ. An evaluation of CPD learning and impact upon positive practice change. Nurse Educ Today. 2011; 31:(4)390-395 https://doi.org/10.1016/j.nedt.2010.07.012

Lumbers M. Approaches to leadership and managing change in the NHS. Br J Nurs. 2018; 27:(10)554-558 https://doi.org/10.12968/bjon.2018.27.10.554

Manley K, Martin A, Jackson C, Wright T. A realist synthesis of effective continuing professional development (CPD): a case study of healthcare practitioners' CPD. Nurse Educ Today. 2018; 69:134-141 https://doi.org/10.1016/j.nedt.2018.07.010

Ousey K, Roberts D. Improving access to CPD for nurses: the uptake of online provision. Br J Community Nurs. 2013; 18:(2)78-83 https://doi.org/10.12968/bjcn.2013.18.2.78

Pawson R. The science of evaluation. A realist manifesto.London: Sage Publications; 2013

Ryder M, Browne F, Galvin C, Leonard O, O'Reilly J. Fit for purpose? Evaluation of CPD courses for nurses in an Irish university teaching hospital. Br J Nurs. 2018; 27:(8)434-441 https://doi.org/10.12968/bjon.2018.27.8.434

Schnetter VA, Lacy D, Jones MM, Bakrim K, Allen PE, O'Neal C. Course development for web-based nursing education programs. Nurse Educ Pract. 2014; 14:(6)635-640 https://doi.org/10.1016/j.nepr.2014.06.007

Shaha M, Wenzel J, Hill EE. Planning and conducting focus group research with nurses. Nurse Res. 2011; 18:(2)77-87 https://doi.org/10.7748/nr2011.01.18.2.77.c8286

Shin S, Park J-H, Kim J-H. Effectiveness of patient simulation in nursing education: meta-analysis. Nurse Educ Today. 2015; 35:(1)176-182 https://doi.org/10.1016/j.nedt.2014.09.009

Stott A, Mozer M. Connecting learners online: challenges and issues for nurse education—Is there a way forward?. Nurse Educ Today. 2016; 39:152-154 https://doi.org/10.1016/j.nedt.2016.02.002

Stringer E. Action research, 4th edn. Thousand Oaks (CA): Sage Publications; 2013

Tame SL. Secret study: A new concept in continuing professional education. Nurse Educ Today. 2011; 31:(5)482-487 https://doi.org/10.1016/j.nedt.2010.09.007

Winter R, Munn-Giddings C. A handbook for action research in health and social care.Oxon: Routledge; 2013

Stakeholder perceptions of curriculum design, development and delivery for continuing e-learning for nurses

24 September 2020
Volume 29 · Issue 17

Abstract

Background:

This paper reports the qualitative findings from stage 5 of an action research project which involved the redesign of continuing professional education (CPE) courses in one organisation.

Aim:

The aim of this study was to explore key stakeholders perceptions of the teaching, learning and outcomes of a new curriculum design for CPE involving e-learning.

Method:

This project used participatory action research, involving stakeholders as participants in a process of inquiry about the change. The study took place in an academic teaching hospital and consisted of three focus group interviews with a total of 20 nurses. Participants included stakeholders who had developed curricula and managers from clinical areas where CPE courses had been undertaken.

Findings:

Four main themes emerged, revealing staff perceptions on the process of change and their own ‘lightbulb moments’ experienced during this process. Results also indicate that the change has resulted in learner-focused CPE, with a range of opportunities for continued educational development in future.

Conclusion:

Key stakeholders' experience is seldom reported in studies related to CPE. This study provides an insight into the experiences of key stakeholders in relation to the development and delivery of CPE courses. Stakeholders indicated that they were able to see the benefits of implementing new CPE curricula they had contributed to. They also commented that clinical-pertinent and competence-based courses were more learner focused as a result of combining online content with supported workshops.

Healthcare organisations currently face multiple challenges in delivering safe, effective nursing care in environments that are becoming increasing complex (Draper et al, 2014). Acute tertiary hospitals require knowledgeable, skilled registered nurses to care for patients in specialist areas (Ryder et al, 2018); thus, continuing professional education (CPE) is fundamental in ensuring that frontline nurses are able to practise safely and effectively (Manley et al, 2018). Although much of the literature calls for empirical evidence in relation to the impact and outcomes of CPE (Hegney et al, 2015; Lee, 2011; Clark et al, 2015), it is also essential that an understanding of the process for the development and delivery of effective CPE is established. There is little empirical evidence in relation to the outcomes of CPE, so further evidence is required into the key roles of stakeholders in the process of development and delivery of effective CPE (Draper et al, 2014).

This article sets out to understand the perceptions of stakeholders about a new curriculum design, and its development and delivery for continuing e-learning education for nurses in an acute environment. It reports on stage 5 of an action research project from focus groups that involved key stakeholders. The overall project was developed for the purpose of redesigning and restructuring CPE courses for nurses in an acute academic teaching hospital in the Republic of Ireland. Stage 1 of the action research project has been reported in Ryder et al (2018) and involved the initial evaluation of existing CPE courses.

The action research cycle used in this project is outlined in Figure 1. Stage 2 involved the development of a template for e-learning content underpinned by constructive alignment theory (Biggs and Tang, 2011) and instructional design principles that were aligned with the concept of a flipped classroom. Stage 3 involved initial implementation and observation with stakeholders, while stage 4 involved full implementation of the redesigned and restructured CPE courses.

Figure 1. Action research cycle for the changes in the design and structure of continuing professional development for nurses

Methodology

CPE is a collaborative process involving management, and clinical and education staff. Participatory action research was identified as a suitable methodology because it facilitates a collaborative relationship involving stakeholders as participants in a process of inquiry about change (Froggatt and Hockley, 2011; Stringer, 2013). Evaluation is fundamental to action research through the process of data gathering and comparing the situations before and after a change of current workplace practices as they relate to the design, development and delivery of CPE (Froggatt and Hockley, 2011; Crozier et al, 2012).

Recruitment and sampling

Purposeful sampling was used to select participants (Creswell, 2017). A total of 48 nurses from across the organisation were invited to participate in the study. Those invited had all been involved in the development, delivery and support of the CPE courses. Three focus groups were held, with a total of 20 nurses taking part in the interviews. Participants were drawn from a range of roles across the organisation: education and practice development, clinical facilitation, clinical nurse managers, and clinical nurse specialists. Details of the focus groups and participants are presented in Table 1.


Description Number Gender Job position of focus group participants Duration of focus group
Group 1 Education staff 7 Female (7) Director of education and practice development (1) 66 min 50 s
Assistant director of nursing (1)
Nurse tutors (4)
Nurse manager (1)
Group 2 Facilitators and authors of the learning units 8 Female (8) Clinical nurse specialist (1) 56 min 13 s
Advanced nurse practitioner (1)
Clinical facilitators (6)
Group 3 Managers 5 Female (4) Assistant director of nursing (1) 47 min
Male (1) Ward managers (4)

Data collection

The research design ultimately guided how the focus groups were constructed. Each group was made up of homogeneous participants in terms of the nature of their experience of the change process. Ground rules for the conduct of the focus group were outlined to participants in order to ensure that each felt secure in sharing their experiences and to help make them feel at ease (Jayasekara, 2012: Krueger and Casey, 2015). Data were collected from all three focus groups.

Focus groups are widely acknowledged as a useful and effective mechanism, whereby a group jointly constructs meaning about a topic (Bryman, 2012; Jayasekara, 2012). The primary goal of focus groups is to use interaction resulting from discussion among participants to increase the depth of the enquiry and reveal aspects of the phenomenon assumed to be otherwise less accessible (Doody et al, 2013a). The use of focus groups with key stakeholders completed the action research process, whereby stakeholders were seen as equals to the researcher, participating in a process of inquiry and change through continual alteration between practical decision-making and reflective evaluation (Froggatt and Hockley, 2011; Stringer, 2013; Winter and Munn-Giddings, 2013).

The focus groups were conducted by a moderator external to the organisation (MC) and the principal investigator (MR). The external moderator assisted in establishing neutrality regarding the change process and also reduced the potential for coercion or conflict of interest (Shaha et al, 2011). The moderators were experienced researchers, and were skilled at interviewing and managing groups, group dynamics and group discussion (Doody et al, 2013b). The duration of the focus groups was between 47 minutes and 66 minutes 50 seconds, and all focus groups were completed in one sitting. The duration of the focus groups was sufficient to address the required topic areas in order to answer the research question, while ensuring that it was within the general physical and psychological limits for participants (Krueger and Casey, 2015).

A semistructured interview guide, which was based on teaching, learning and outcomes, was used for the focus groups (Box 1). The three topic headings had been previously used in stage 1 of this study in the format of a self-assessment questionnaire. The schedule was used as a guide to stimulate discussion, however the moderator also probed responses and asked specific questions related to responses that were not specifically included in the interview guide (Doody et al, 2013b). The moderators were responsible for creating a safe environment and facilitated discussion whereby all participants were enabled to share their opinions while maintaining the topic based on the interview guide (Shaha et al, 2012). All focus group interviews were digitally recorded, downloaded and securely transmitted via email for transcription.

Semistructured interview guide

Teaching

  • Are various teaching approaches used?
  • Are they appropriate?
  • Tell me about your experience writing learning units?
  • Tell me about your experience supporting others who are writing learning units?
  • Were the learning units purposeful and focused?
  • Tell me about your experience of teaching when facilitating a CPD course comprised of self-directed learning units?
  • Did the pace of teaching appear appropriate for the participants?
  • Did the teaching/learning units direct assessments?
  • Are the learning units linked to clinical teaching?
  • Does the clinical teaching result in direct improvement in clinical skills?
  • Learning

  • Is there evidence of active participation in the learning units and CPD programme?
  • Is there evidence of successful collaboration between clinical and academic learning?
  • Is the clinical area conducive to learning?
  • Are the students being challenged by the learning content?
  • Are the students motivated during their period of learning?
  • Can you identify the motivators for the students?
  • How does the learning environment affect learning?
  • Outcomes

  • Do the learning outcomes meet the needs of the department?
  • Are students gaining new knowledge?
  • Are students gaining new skills specific to the clinical specialist area?
  • Are students using new knowledge and skills in practice?
  • Do the students adopt a learning attitude during the course?
  • Have the students progressed since they enrolled in the course?
  • How has the clinical area benefited from the course?
  • Data analysis

    Thematic analysis was used to identify themes that emerged as being important (Creswell, 2017). Data were analysed using MAXQDA, a data management software package.

    Ethical considerations

    Ethical approval was obtained from the nursing research and innovation committee of the organisation where the study took place. All participants were assured of confidentiality and anonymity in reporting. Prior to commencement of the focus group interviews, the purpose of the study and the ground rules for the focus group were reviewed and each participant completed a consent form.

    Results

    Data analysis yielded four main themes:

  • The process of change
  • Light bulb moments
  • Learner focused
  • Future opportunities.
  • Theme 1. The process of change

    Participants reflected on their experience of engaging with a new way of delivering CPE courses (including the development of e-learning units) as a process of change and spoke freely about their personal journey, highlighting the importance of feeling and being supported through the process, particularly by education staff.

    ‘Again, it was a bit of a learning curve, engaging with it. And I had to do it within, you know, a time frame, obviously. But the nurse tutor I worked with, it was a very different situation. She worked hand in hand with me.’

    Focus group 2

    ‘From a content perspective, she [education staff member] approached me and I approached my clinical colleagues, who were the clinical facilitators also, to peer review it. And some of the clinical managers as well … And I got a lot of support, actually. And it felt like collaboration …'

    Focus group 1

    Some participants voiced their concerns regarding a feeling of isolation and being left to work on content development without sufficient support, which was attributed to continued staff challenges, particularly skill mix in areas of high acuity.

    ‘It definitely felt, like, we did all the work, without it being planned or, you know, this is what we're going to do. It was definitely done on top of our other work, and this is happening, and because we are so short staffed.'

    Focus group 2

    Overall, the participants in all the focus groups were keen to speak openly about their experience of the change process and the personal and professional impact it had had.

    Theme 2. Lightbulb moments

    Participants across all focus groups reflected on their personal experience of engaging with the development of education materials and facilitating learning. For many, this engagement brought with it what is best described as ‘lightbulb moments’, when participants began to sense a greater personal and group responsibility and understanding of the nature of the education development and its impact—mostly positive—on themselves, the organisation and, ultimately, on patient care.

    ‘… I think, as the whole group, we're kind of on the same page. There's so many variables involved and definitely educational background. I mean, I was dealing with one or two people who'd … they were working so autonomously, maybe in the role … that they were actually able to do this with very little guidance.’

    Focus group 1

    ‘So in the area where I work, with several facilitators, it's been quite revolutionary. It's really a structured education. Whereas before … in the last year or so, we've had an influx of new junior nurses. There was a real need to structure the education, whereby it was clear to all senior staff who was on what pathway and on what stage. So having a structured orientation, where we have now, like, an Excel sheet, where we can quickly access who is … and [a] flag even for staff on allocation, [to see] who is at what stage, has been revolutionary.’

    Focus group 2

    While acknowledging the difficulties inherent with change in an acute clinical environment, participants were keen to articulate a sense of ownership of continuing education development, design and delivery.

    Theme 3. Learner focused

    Participants spoke positively about the impact on staff who had participated in the newly developed CPE courses. There was an overall feeling that the newly developed courses, both online content and related workshops, were more learner focused, clinically relevant and competence driven than previous CPE education offerings.

    ‘So, before, it was just delivering education, no tricks, no underhand, nothing. And then … you left them in a classroom and you gave them an exam. Or you gave them blended learning … So that's another thing to get your head around. It's not a trick: you present the information, they seek it out and then they answer the question. So that's another thing to change.'

    Focus group 1

    ‘… the purpose of the learning units is to kind of enhance their knowledge. And then the purpose of the workshops, or the scenarios, is to develop clinical skills. And combined together, with the workshops and the scenarios and the enhanced knowledge, you should see clinical skills improving. So, you know, just to be clear with what the purpose of each part of it is. And my experience with the feedback, significantly from senior staff, is that there is a hugely increased level of standardised competence emerging … I'm trying to think about four groups through now. So you can, they can, see the difference, but it's standardised as well … you know what I mean.'

    Focus group 2

    One group did express concern about the amount of material that was being delivered and thought it was important that student overload would be avoided, while ensuring that competence was firmly addressed.

    ‘Like we just overloaded our group, though. And we tend to anyway; they were doing, maybe, four learning units and a couple of workshops in one week … of brand new concepts. Like mechanical ventilation … so, you know, on Monday we'd expect them to start their learning and we're doing a workshop on Friday … Maybe it was just about the level of information.'

    Focus group 2

    Notwithstanding some of the concerns, participants were clear in their appreciation that the new delivery format had changed to a more learner-focused model.

    Theme 4. Future opportunities

    Participants were keen to explore the future of education development and delivery and the need to continue to use the process that had been implemented. Doing so they felt would help nurses who have been working for a long period feel more able to access ongoing development.

    ‘Some of the older staff … we have a lot of older staff who would love to have some access to the units … so if that could be something that could be looked at, and I do understand that you have to have a security thing … I would have a number of people that are working in the unit.’

    Focus group 3

    Further opportunities in the future were considered, one being the potential to explore the possibility of increasing simulation to enhance learning.

    ‘I just thought … one thing we had kind of talked about doing … it'll be a little bit further down the line. It's like a full team, like simulated scenarios, so that will draw in the expertise in a non-didactic way … but bring very good examples and cases for, like, our specialised kind of critical areas.’

    Focus group 2

    A key aspect for the future was to ensure greater communication across the organisation so that positive developments in education are shared at all levels. This would have the potential to positively increase the uptake and completion of CPE.

    ‘From a communication, organisational point of view I think there needs to be more communication from nurses, what's going on in different areas … what positive stuff is happening, initiatives, where are we now from where we were last year. I know the nurse managers see it at meetings, but that's not filtering, it's all right saying that you know your team, but it's not really filtering down.’

    Focus group 3

    Participants anticipated an exciting future for CPE and also the opportunities it presented for staff who have worked in the organisation for a long time.

    Discussion

    Change of any kind is difficult, but within a clinical environment with significant acuity the process can be even more difficult (Lumbers, 2018). Participants had to engage with a new way of designing and delivering education using a new theoretical framework, which required a shift of focus from the educator to the learner. It is understandable that such a change to e-learning can cause uncertainty because clinical educators were faced with a new set of circumstances that may challenge their role concept (Koch, 2014). In addition, clinical educators were themselves engaged in a personal journey developing skills for the design and delivery of e-learning. It also marks a significant change in the role of the teacher, with a move from knowledge provider to knowledge facilitator (Biggs and Tang, 2011; Koch, 2014). This was significant because evidence indicates that a number of factors need to be considered when education for nurses is being restructured for e-learning (Schnetter et al, 2014; Stott and Mozer, 2016).

    The importance of communication throughout the change process is paramount. At the outset of CPE course development communication regarding expectations of participants, the intended outcomes, time frames and resources must be clearly articulated (Lee, 2011). The use of the action research process in this study clearly facilitated communication between all stakeholders. It has been recognised that there is often a lack of integration between practice and education (Allan and Smith, 2010) and that effective partnerships need to be formed between key stakeholders, where a mutual understanding of each other's perspectives, aspirations and constraints is established (Clark et al, 2015). Draper et al (2016) also identified the need for managers and educators to develop ‘symbiotic relationships’ and work collectively on curriculum development. The shared journey for all the participants reflected a genuinely collaborative partnership between educators and clinicians in the design, development and delivery of learner-focused e-learning.

    Participants in this study acknowledged in their 'lightbulb moment' that they now saw the benefits of implementing the new CPE curriculum and their personal contribution to the process. This is an achievement to be celebrated, because the attitudes within an organisation and the attitudes of staff can be particularly hard to change (Lee, 2011). The focus groups were made up of key stakeholders from the clinical, education and managerial section of the organisation, and thus the gatekeepers for the success or failure of the new CPE curricula. Managers have previously been identified as playing a central role in developing and maintaining positive organisational cultures (Draper et al, 2016) and therefore how new knowledge and skills are implemented (or not) in practice (Gould et al, 2007; Tame 2011). Positive change and transfer of skills into the practice environment was identified in this study. This reflects previous findings which reported examples of CPE leading to practice enchantments and knowledge transfer into daily practice (Lahti et al, 2014). This is a significant finding in our study because there is a dearth of evidence to identify the impact on practice of CPE courses (Gijbels et al, 2010).

    Participants in the study identified that, by combining online content supported by workshops, the CPE courses resulted in a learner-focused, clinically pertinent and competence course. This finding provides evidence to support the strategies used in the redesigned curriculum to achieve the predetermined CPE course learning outcomes.

    Future opportunities identified by participants included the potential to incorporate other technology-enhanced teaching and learning methods, such as simulation, and to embed it into CPE curricula. The use of simulation as an educational tool is becoming increasingly prevalent in nursing education (Shin et al, 2015). The introduction of further simulation had not been identified as a key feature in the original action research project. The potential to integrate it with existing strategies will need to be explored further by the action research team.

    Improving access to CPE through the effective use of e-learning has the potential to support the availability of education for all staff to access meeting personal and professional demands (Ousey and Roberts, 2013). It also has the potential to assist participants to learn in a manner that is adaptable to their workplace and promotes lifelong learning by development of independence (Jonas and Burns, 2010).

    Conclusion

    To date, the impact of CPE courses has mostly been evaluated from the student's perspective, with little consideration to the course leaders or service providers (Gijbels et al, 2010). This paper contributes to the limited evidence of the impact of CPE from the perspective of key stakeholders. It reports on the perceptions of key stakeholders on the development, design and delivery of a new model of CPE education. By doing so, it has explored the ‘journey through’ (Pawson, 2013) the change of CPE design and delivery. This is a process that is not often explored, but it is essential to understand in order to achieve a positive outcome from any CPE intervention (Clark et al, 2015). The process of change reported by the stakeholders was, as expected, difficult for some, but for the majority it was worth the effort because positive outcomes for staff and patients were evident. The benefits of engaging with innovative ways for staff to access and undertake ongoing education for professional development were demonstrated.

    KEY POINTS

  • Participatory action research enabled collaborative working and enriched communication during the change progress
  • A collaborative relationship between all stakeholders for the development of e-learning in continuing professional education (CPE) curricula provides for learner focused CPE courses
  • The changed curricula for CPE provides opportunities for existing staff to update skills and also to further use technology-assisted learning
  • Evaluation of stakeholders' perceptions and experiences of CPE curricula are essential for the effective development of CPE for nursing staff
  • CPD reflective questions

  • Think about different approaches to delivering education. What kind of education delivery works best for you?
  • How do you perceive the role of e-learning in your current role?
  • Reflect on your most recent learning experience? Was e-learning part of content delivery?