Teaching Gatekeeping to Doctoral Students: A Qualitative Study of a Developmental Experiential Approach

Brenda Freeman, Tricia Woodliff, Mona Martinez

 

In addition to developing teaching, clinical supervision, and research skills, new entrants into the counselor education workplace will also face the challenging responsibility of gatekeeping. Gatekeeping can be both anxiety-provoking and time-intensive for new faculty members. To enhance the confidence and competence of new entrants into counselor education faculty positions, strong doctoral preparation in gatekeeping is critical. In this article, the authors describe a developmental experiential model to infuse gatekeeping instruction into counselor education and supervision doctoral courses. The model includes six experiential gatekeeping modules designed for instruction at three developmental levels. A phenomenological qualitative study of the model was conducted, leading to the discovery of four themes: importance of gatekeeping, behind the curtain, understandings vary by developmental level, and uneven responses to experiential learning. Developmental, pedagogical, and administrative implications for counselor educators are discussed.   

Keywords: counselor education, gatekeeping, doctoral preparation, experiential model, phenomenological

 

For new entrants into the counselor education higher education workplace, involvement in gatekeeping can be unavoidable and challenging. Although direct gatekeeping responsibilities may be conducted by associate and full professors in many institutions (Schuermann et al., 2018), assistant professors often teach courses in which gatekeeping issues arise. Evidence suggests that faculty perceptions of gatekeeping differ by academic rank (Schuermann et al., 2018), with untenured professors reporting greater concerns about gatekeeping than tenured faculty (Gaubatz & Vera, 2002). Bodner (2012) asserted that “faculty and supervisors may receive little guidance on how to implement such [gatekeeping] procedures in a highly ethical manner and/or how to approach complex and challenging gatekeeping dilemmas” (p. 60).

The gatekeeping role is taught during doctoral preparation. In the doctoral standards set by the Council for Accreditation of Counseling and Related Educational Programs (CACREP), Section B (Doctoral Professional Identity) requires the instruction of students in five core areas, two of which (teaching and supervision) include gatekeeping standards (CACREP, 2015). Supervision standard 2.i. requires programs to include in the curriculum “evaluation, remediation, and gatekeeping in clinical supervision” (CACREP, 2015, p. 35). Teaching standard 3.f. states that the curriculum must include “screening, remediation, and gatekeeping functions relevant to teaching” (CACREP, 2015, p. 36). The inclusion of gatekeeping in CACREP standards signals the importance of providing doctoral students with the knowledge, skills, and experiences necessary for them to be effective in their future role as gatekeepers.

There is a dearth of literature on pedagogy for teaching gatekeeping to doctoral students. Barrio Minton et al. (2018) conducted an analysis of select published articles and concluded that there has been a lack of focus on doctoral-level counselor education preparation. With limited publications centered on doctoral preparation and a generally minimal focus on pedagogy, the instructional approaches to prepare doctoral students for gatekeeping are largely unknown.

The purpose of our study was to design and deliver a developmental experiential model for increasing doctoral student competence in gatekeeping and to examine student reactions to these learning experiences. We have titled the gatekeeping instructional approach the Developmental Experiential Gatekeeping (DEG) Model. The DEG Model was designed and implemented at one CACREP-accredited counselor education and supervision (CES) doctoral program in the Western United States with a focus on preparing students for academic positions. This article presents the results of a phenomenological qualitative study of the experiences and reactions of doctoral students to the DEG Model. The insights gleaned from the study are discussed from the standpoint of improving pedagogy for gatekeeping instruction. The rationale for the study was that gatekeeping is a challenging aspect of counselor education teaching and supervision roles, particularly for new entrants into academia. Effective preparation in gatekeeping practices may not decrease the strain of dealing with difficult student remediation, suspension, and potential legal issues, but preparation is necessary to bolster strong gatekeeping and remediation practices.

Developmental Framework With Experiential Pedagogy

The DEG Model is an approach to instructing doctoral students in gatekeeping through the delivery of six curricular units divided into three developmental levels. The model was developed and implemented at a midsize institution (classified in the Carnegie system as an R1: Doctoral University – Very High Research Activity) with three counseling master’s programs and a doctoral program in counselor education and supervision located in the Western region of the United States. All programs were fully accredited under the CACREP 2016 standards (CACREP, 2015).

The DEG Model is grounded in both developmental and experiential pedagogy. The developmental framework, based in cognitive developmental theory, endorses sequential movement in learning processes within an established hierarchy (Bloom, 1956; Loevinger, 1976; Piaget, 1977). Higher levels are not attained without first accomplishing less complex levels of cognitive understanding. The development of formal operations, in which more sophisticated connections and abstract concepts are understood, is gradual and is based upon the interaction between cognition and experiences (Case et al., 2001; Eggen & Kauchak, 2001). Formal operations are situation specific (Eggen & Kauchak, 2001). Students may have reached formal operations in learning domains where they have a supporting framework of experiences, such as in post-internship counseling skills, and yet not function in formal operations in other content domain areas (such as research skills).

The experiential learning approach, reportedly a more powerful pedagogy than didactic instruction alone (Borowy & McGuire, 1983; Shreeve, 2008), is focused on gaining knowledge through direct experience. The process typically begins with preparation for the experience, followed by engaging in the experience, and culminating with reflection or testing of observations (Galizzi, 2014; Kolb & Kolb, 2009). Positive outcomes associated with experiential pedagogy include increased student engagement in the learning processes, improvements in cognitive functioning, greater acquisition of knowledge across a variety of subject areas (Galizzi, 2014; Greene et al., 2014; Tretinjak & Riggs, 2008), increases in historical empathy, improved critical thinking, and greater cultural open-mindedness (Greene et al., 2014). Borders et al. (1996) found didactic and experiential practices were related to a significant increase in student self-appraisal of supervision capacity. It is reasonable to assume that because experiential activities in supervision led to greater student competence, experiential activities in gatekeeping may also lead to greater student competence.

Research supports that experiential learning is an efficacious approach to teaching multicultural counseling (Kim & Lyons, 2003), particularly when the experiences closely emulate real world applications (Furr & Carroll, 2003; Granello, 2000). Although research on experiential learning related to teaching gatekeeping was not found, experiential learning in gatekeeping may be similar to multicultural counseling in that the experiential activities often used in the instruction of multiculturalism may be unfamiliar or uncomfortable for students. The DEG activities were unfamiliar experiences for doctoral students. Also parallel to instruction in multiculturalism, there is a gatekeeping culture that is unfamiliar to most doctoral students. Students must be introduced to the culture of gatekeeping, including the cultural norms and the development of a gatekeeping mindset.

Two assumptions were foundational to the pedagogy of the DEG Model. First, the authors assumed the DEG Model would have greater impact on student learning if delivered over more than one semester to allow time for integration of knowledge. Second, to maximize the advantages of experiential pedagogy, we assumed each DEG module should provide students with the opportunity for reflection after every experiential activity.

The DEG Model

The DEG Model was structured through a hierarchy informed by developmental principles (Bloom, 1956). Level 1 modules designed to meet the overall learning goal, To increase student understanding of concrete knowledge related to gatekeeping, dispositional assessment, and admissions, were delivered in a first-semester, first-year doctoral seminar course. Although experiential assignments were included with each module, the focus in Level 1 was on student acquisition of concrete knowledge (Bloom, 1956). The modules in Level 2 were integrated into an introductory course in clinical supervision and were designed to address Bloom’s Taxonomy (1956) comprehension and application levels. The learning goal for the Level 2 modules was To increase student knowledge and applied skills related to remediation and gatekeeping in clinical supervision. The Level 3 modules, designed to be consistent with Bloom’s Taxonomy (1956) analysis and synthesis levels, were infused into Doctoral Seminar II, a course with a focus on teaching pedagogy. The modules were designed toward the following goal: To develop student skills in analysis and synthesis of knowledge related to gatekeeping, with a focus on developing a systems understanding of gatekeeping. Each module described in the next section incorporated an experiential element and a written reflection.

DEG Modules
     The specific content domains for each module were driven by the literature. Table 1 includes descriptive material on the content for each module. The overall design of the DEG Model involved the infusion of six gatekeeping modules over a 16-month time frame in three sequential CES doctoral courses.

 

Table 1 

DEG Modules: Developmental Level, Content Domains, and Source Material

Level DEG Module Content Domain Examples of Source Materiala
Level 1, Module 1 Grappling With Gatekeeping Through Dialogue Purposes and processes of gatekeeping; rationale for gatekeeping; ethics in gatekeeping; licensure boards and accreditation bodies and gatekeeping Bodner, 2012; Brown, 2013; American Counseling Association, 2014; Council for the Accreditation of Counseling and Related Educational Programs, 2015; Lumadue & Duffey, 1999
Level 1, Module 2 Professional Fit and the Prevention of Future Adversity: Dispositional Assessment in Admissions Admissions procedures in counselor education; suitability and dispositional assessment; impairment and problematic dispositional behaviors; dispositional assessment approaches Elpers & FitzGerald, 2013; Swank & Smith-Adcock, 2013; Winograd & Tryon, 2009; Brear et al., 2008; Tate et al., 2014; Reddy & Andrade, 2010; Taub et al., 2011; Swank et al., 2012; McCaughan & Hill, 2015

 

Level 2, Module 1 Gatekeeping Issues in Clinical Supervision Through the Lens of the Discrimination Model Supervisor roles in gatekeeping; giving feedback to supervisees; evaluation of supervisees; discrimination model

 

Association for Counselor Education and Supervision Taskforce on Best Practices in Clinical Supervision, 2011; Swank, 2014; Gazzola et al., 2013; Gizara & Forrest, 2004; Miller, 2010; Bernard, 2006; Bhat, 2005
Level 2, Module 2 Mentoring Students Through Monitoring Remediation Designing and monitoring remediation plans Dufrene & Henderson, 2009; Henderson, 2010; Kress & Protivnak, 2009; Lamb et al., 1987; McAdams et al., 2007; McDaniel, 2007; Russell & Peterson, 2003; Bemak et al., 1999; Crawford & Gilroy, 2013; Russell et al., 2007
Level 3, Module 1 Gatekeeping Through a Systems Lens: Designing an Ecological Gatekeeping Map Ecological model and gatekeeping; collaboration and teaming in gatekeeping; shadow organization; higher education culture Forrest et al., 2008; Johnson et al., 2008; Jacobs et al., 2011; Goodrich & Shin, 2013

 

Level 3, Module 2 The End of the Road: Gatekeeping and Heartbreaking Adversity Legal issues in gatekeeping; due process; working with legal counsel; documentation; managing grievances Brown-Rice, 2012; Elpers & FitzGerald, 2013; Enochs & Etzbach, 2004; Forrest et al., 1999; Frame & Stevens-Smith, 1995; Homrich, 2009; Hutchens et al., 2013; Kerl et al., 2002; McAdams et al., 2007

aSource materials appear in order of recommended reading.

  

Grappling With Gatekeeping in Level 1, Module 1
In this module, for three consecutive classes (9 clock hours), first-year students were required to read and discuss journal articles on foundational gatekeeping topics selected by second-year students with guidance from the instructor. The structured class instruction and discussions on the readings were facilitated by the second-year students. The experiential component for first-year students was engagement in structured dialogue. The experiential component for second-year students was teaching gatekeeping and leading discursive discussion with first-year students under live faculty supervision. Students then reflected on the process. 

Dispositional Assessment in Admissions in Level 1, Module 2
     Armed with background knowledge from Module 1, students participated in the dispositional assessment training video for the Professional Disposition Competence Assessments—Revised Admissions (PDCA-RA; Freeman & Garner, 2020; Garner et al., 2020). The training video entails participant ratings of dispositions during admissions interview clips without training, followed by training in the assessment process, post-training rating of interview clips, and instructions on use of the PDCA-RA in actual admissions interviews. Following the PDCA-RA training, the doctoral students co-interviewed (with CES faculty) the master’s program applicants, using the PDCA-RA as the admissions dispositional assessment tool. This was followed by written reflections about the experience.

Gatekeeping Issues in Clinical Supervision in Level 2, Module 1
     This module was preceded by several weeks of instruction in clinical supervision theory and the assignment of one master’s-level supervisee to each doctoral student. Midway through the semester, students were instructed in best practices for giving evaluative formative and summative feedback in clinical supervision through the lens of the discrimination model (Bernard, 1997). The experiential component of this module consisted of students being required to deliver either formative or summative (positive or corrective) evaluative feedback to clinical supervisees related to the expected student dispositions under faculty supervision. Students then reflected on the process.

Mentoring Students Through Monitoring Remediation in Level 2, Module 2
     This module was designed to provide doctoral students with an experiential opportunity to partner with faculty in providing support for master’s students working on mild remediation issues. Examples of mild remediation issues included problems with class attendance or punctuality, difficulty adjusting to the professional expectations of graduate school, and challenges with interpersonal relationships in the classroom. The faculty team working in concert with the master’s student needing remediation determined the nature of the specified growth experiences for the master’s student. The doctoral students then implemented structured processes to support the remediation process, such as facilitating a reflective process on a student’s effort to become more culturally sensitive or serving as an accountability partner for a student working to become more conscientious. Doctoral students were not involved in working with any students where dismissal was a likely outcome. Doctoral students then wrote journal reflections on the experience.

The Ecological Gatekeeping Map in Level 3, Module 1
     With the developmental goal of synthesizing complex knowledge, students were tasked with creating an ecological gatekeeping map. The process began with didactic instruction in Bronfenbrenner’s (1977) ecological systems theory, followed by discussions of microsystems, mesosystems, exosystems, and macrosystems in higher education. The goal was to assist students in acquiring a systems perspective on gatekeeping, including subsystem interactions that influence the feasibility and outcomes of remediation, suspension, and dismissal of counseling students. As part of the module, students were introduced to the concept of the shadow organization (Allen & Pilnick, 1973). Allen and Pilnick (1973) described organizations as having two organizational structures—one being the visible structure obvious in the university organizational chart and the other (the shadow organization) consisting of the unwritten cultural expectations and daily behaviors of the institution. An example of the shadow organization influencing gatekeeping would be if the counseling handbook states that the program gatekeeps, but there is an unwritten culture in which the administration will not allow the program to dismiss even the most unethical student. Working as a team, the students had 6 weeks to interview administrators and faculty, collect policy and procedure documents, read and apply relevant literature, and prepare a group presentation of a visual ecological gatekeeping map.

Gatekeeping and Heartbreaking Adversity in Level 3, Module 2
     The final DEG module began with assigned readings of gatekeeping legal cases. Students were then charged with the responsibility to create a non-academic dismissal scenario, write and compile all documentation, and prepare to dramatize the scenario through a mock dismissal hearing. Roles adopted by students for the mock hearing included the fictitious master’s counseling student, the faculty member central to the dismissal scenario, the department chair, and the college dean. The mock hearing was enacted and was judged in real time by a university attorney and a university administrator (a dean or provost). Immediately following the hearing, the judges processed the hearing with the students, offering legal and procedural corrections. Students then reflected on the experience.

Method

The question “What are the lived experiences of doctoral students as they engage in gatekeeping instruction?” was addressed through qualitative methodology. Because we were interested in the subjective experiences of the student learners, the qualitative study was conducted using a phenomenological approach (Creswell, 2013; Moustakas, 1994). Investigation through deep exploration of lived experiences is part of the phenomenological paradigm (Creswell, 2014). Deep exploration of lived experiences with the gatekeeping experiential activities was congruent with the goal of understanding the journey of doctoral students to capture the essential meanings of gatekeeping. Husserl (2001) postulated that it was possible for researchers to bracket their own experiences to capture the essence of the experiences of others, which was one of the objectives in this analysis. The ontological assumption, informed by the constructivist paradigm, was that socially constructed multiple realities of gatekeeping exist (Mertens & Wilson, 2012).

The study was primarily conducted as scholarly inquiry into the developing professional identity of doctoral students relevant to the gatekeeping role. Aligned with the research question, the data analysis was accomplished through a phenomenological tradition, with a primary goal of revealing rich and concrete descriptions of the learning process and the translation of formal and experiential instruction into professional identity.

Subsequent to the analysis, the findings were also used to inform program development and pedagogy for counselor educators. This secondary use of the findings to inform program improvement is aligned with the values branch of program evaluation in which participant responses to program experiences are often viewed through a qualitative, constructivist perspective (Abma & Widdershoven, 2008). The use of the findings to inform counselor education pedagogy did not influence the interview protocol, data collection, or analysis process, which were conducted utilizing the phenomenological approach.

Participants
     For phenomenological studies, Creswell (2013) recommends between 3 and 15 participants. At the point of data collection, there were 12 students enrolled in the CACREP-accredited counselor education and supervision doctoral program where the DEG modules were delivered. The doctoral program was housed in the College of Education at a midsize university, classified in the Carnegie system as an R1: Doctoral University – Very High Research Activity.

Each of the 12 potential doctoral student participants had experienced some or all of the DEG modules, allowing the research team to gain insights from different levels of doctoral student professional identity development. Two students were removed from the participant pool because of a conflict of interest, yielding a participant pool of 10 students. Following human subjects research review board (IRB) approval, the 10 potential participants were contacted by email and invited to participate in the study. All 10 consented to be interviewed; however, one student was unavailable during the data collection window, leaving nine study participants.

As a precaution to mask the identity of the participants, specific demographics are not reported in this article. In general terms, the participants were primarily self-reported females, predominantly White, and ranged between 24 and 39 years old. Educationally, all participants had earned master’s degrees in counseling prior to entering the doctoral program. The students earned their counseling master’s degrees in institutions located in the West, South, Southwest, East, Midwest, and Rocky Mountain regions.

Procedure
     All nine doctoral student participants agreed to be interviewed and to allow electronic recording. Face-to-face interviews ranging in length from 30 to 60 minutes were conducted by a single member of the research team. No incentives were offered. Participants were informed that they could skip any of the interviewer questions. The items for the semi-structured interview protocol were first written by the lead author and then piloted with the second and third authors. The final items were determined by consensus of the research team. The interview protocol included nine items. Three were global items such as “Describe your learning experiences with gatekeeping and remediation in counselor education.” Of the remaining six items, each was dedicated to one of the DEG units. The interviewer first asked the student if they recalled having participated in the specific unit, followed by the prompt: “Please describe your experience with this unit. What was that learning experience like for you?” The same question was repeated for each of the six units.

Although the DEG Model was part of required coursework, participation in the study was strictly voluntary. To protect student participants from social pressure to participate in the study, all communications with participants were initiated by a single member of the research team with no evaluative relationship to the students. Further, the interviews were conducted during a time frame when no participants were enrolled in courses instructed by any member of the research team.

As a second source of data, student reflections were collected at the end of each unit. The reflections were ungraded and were used in the study to triangulate the interview data for the purpose of considering the consistency between the interview data and the reflections, part of the establishment of trustworthiness. The reflection data consisted of written, open-ended reflections on the experiences of students with each of the DEG modules. The reflections were submitted immediately following the experience with each DEG module. To scaffold the reflection process for students who found unstructured, open-ended reflections challenging, three prompts were offered: “Please share your reactions to the learning experience you engaged in today.” “What did you learn today that you consider to be important to your understanding of gatekeeping and remediation?” and “What questions come to mind as a result of engaging in this learning experience?”

Data Analysis
     The overarching purpose of the data analysis process is to bring structure and order into understanding the data for the purpose of addressing the research questions (Patton, 2015). In phenomenological research, there are many paradigms and differing worldviews on data analysis, including the issue of whether it is most suitable to analyze participant narratives through an ideographical approach or amass the data into qualitative themes (Moules et al., 2015). Accumulation of data with an analysis of themes was selected as the phenomenological data analysis approach. The results of the study were analyzed through Creswell’s (2014) approach to phenomenological analysis. Throughout the analysis, the research team bracketed their presuppositions and assumptions. The purpose of bracketing was to allow the voices of the participants, not the researchers, to dominate the analysis.

Following the interviews, the recordings were transcribed (using pseudonyms), and the transcriptions were reviewed for accuracy. The analyses of both the interviews and the reflections were conducted using NVivo12 (QSR International). The interview analysis was a three-part process that included open coding, thematic analysis, and thematic integration (Rossman & Rallis, 1998). The process began with reading and rereading the transcripts to deduce a list of core meanings for each transcript. This work was conducted by the lead author and verified by independent analysis of the second author. Once core meanings of individual transcripts were agreed upon, the meanings were cross-analyzed for repetition and clustered into themes and subthemes by the first and second authors working independently of one another. Team consensus was reached, and the data were then organized into a codebook. Data saturation was accomplished when it was determined that no new themes were emerging. The themes were then reviewed in relation to one another to clarify overlapping areas and collapse subthemes into broader themes. Direct quotes were extracted to support both textural and structural descriptions. After the analysis of the interview data, student reflections were analyzed using the codebook derived from the interview data. An “inconsistent” codebook category was created to code data inconsistent with the data found in the interviews. An “other coding” category was created to code data that reflected new concepts or themes not apparent in the interview data.

Reflexivity
     An important aspect of considering trustworthiness in phenomenological research is addressing bias (Creswell, 2013). The research team consisted of two White female researchers and one Hispanic and American Indian female researcher. One was a tenured full professor with extensive CES experience. Another had conducted research related to dispositional assessment. The third member of the research team had no specific background or personal experiences with gatekeeping. The team members had a wide range of experience in program evaluation and qualitative research. The shared assumptions of the research team were that understanding gatekeeping was an important professional obligation and that doctoral students with career aspirations of entering counselor education needed a solid foundation in gatekeeping.

Trustworthiness
     The process of establishing trustworthiness began with an understanding that the findings represented only one of many interpretations of the data (Corbin & Strauss, 2008). Early in the process, we consulted with a qualitative research expert who confirmed the analysis process (D. Barone, personal communication, December 2, 2018). Peer debriefing was used throughout the process (Creswell, 2014). The debriefing process included the research team presenting tentative findings at one regional and one national counselor education conference, a process that fostered research team deliberation on the interpretation of the data.

The areas for bracketing were identified prior to the interviews and consisted primarily of the delineation of the presuppositions and assumptions of the research team in order to avoid hindering the capacity of the team to listen to the participants. The actual bracketing was performed during the analysis stage by making notations of areas where presuppositions and assumptions might influence interpretation. Participants were not asked to bracket their assumptions. Direct quotes were heavily relied upon in the analysis to assure that the voices of the participants were heard throughout the process. An expert reviewer, a counselor educator not involved in the study, audited the results (Creswell, 2014; Patton, 2015), providing the team with feedback. Last, member checking was used to ascertain that we had not misunderstood or used participant statements out of context.

Results

The analysis yielded four themes: importance of gatekeeping, behind the curtain, understandings vary by developmental level, and uneven responses to experiential learning. Pseudonyms used during data collection were replaced with participant numbers for reporting purposes.

Importance of Gatekeeping
     The theme importance of gatekeeping describes the valuing of gatekeeping, remediation, and dispositional assessment by participants. Across all participants, gatekeeping and related processes were perceived as critically important. The rationale for valuing gatekeeping varied from participant to participant, with most offering more than one justification. Five participants positioned their responses within the professional mandate to protect the public. P1 stated:

I learned that some of my experiences as a counselor really influenced the importance that I put on gatekeeping . . . I’ve been doing counseling . . . so I had exposure to what it looks like when counselors in the field aren’t well suited or act from their own personal needs.

Two participants reflected that the protection of the public was particularly important because of the attraction of emotionally wounded individuals to the profession. As stated by P2:

[Gatekeeping and remediation] . . . are extremely important because people oftentimes I find go into the counseling field for the wrong reasons. Whether it’s a personal history with mental health issues and they’re trying to solve their own issues or because. . . maybe they like the power differential that is created in a helping relationship . . . they want to somehow take advantage.

Protecting counseling programs, universities, and the profession was also expressed as a reason for valuing gatekeeping. P3 stated: “The counseling profession is our own and needs to be protected,” later adding, “Despite how difficult it can be, if warranted, I want to play hardball to protect my students, other faculty, alumni, program, and the profession.”

Behind the Curtain
     Eight of the nine participants reported that they had limited awareness of gatekeeping and related processes in their master’s programs. P4 stated: “I mean, I’m sure we were gate checked in my master’s program, but I don’t really remember anything about it.” Participants discussed the process of learning about gatekeeping after the experience of being unaware of it in their master’s programs, noting that this process gave them a glimpse of what goes on behind the curtain. P9 described it as being given a different seat in the house, stating:

In my master’s program, I didn’t have any knowledge of anything like this . . . but now in my first year of the doctoral program, I feel like I have so much more of an understanding and kind of . . . like a different seat in the house. I can see how it all works and the importance of it.

Feelings associated with peeking behind the curtain were varied. P3 described it with positive affect: “So the first seminar class was really helpful. It was very much like the Wizard of Oz, pulling the curtain back and seeing what goes on behind everything in higher education.” P4 reported it to be an unsettling experience: “So our first year when we were learning about it, it was still a bit mysterious . . . kind of scary . . . I didn’t really know this process was going on . . . not like, so overtly. . . . it was kind of like, oh my God.”

Understandings Vary by Developmental Level
     All participant interviews reflected the theme understandings vary by developmental level. Some participants overtly addressed changes in developmental understandings, like P3, who said simply: “I thought it was tricky until it wasn’t.” She described her journey as becoming more comfortable over time. P5 reported: “I think the scaffolding was appropriate. . . . more content focused initially and then more at the process level with the application piece later on. It wasn’t like we were jumping right into applicability before we actually understood the different concepts.”

From the standpoint of developmental level, Level 1 students like P6 were inclined toward a concrete understanding of the concepts: “So my understanding of gatekeeping and counselor education is that it’s a process to make sure that the counseling students are where they’re supposed to be . . . academically and emotionally.” More advanced students like P1 reflected greater complexity in their understandings:

So part of our responsibility as counselors is to make sure the field is engaging ethically, and if we’re allowing people that are wounded in such a way that they’re not able to engage productively as counselors, then as a profession we’re acting essentially unethically. . . . Counseling is fundamentally about the person of the counselor and so we have to take that into account as counselor educators . . . gatekeeping or remediation become a big part of the more nebulous component of what makes a good counselor.

Another developmental issue was that the experiential frame or voice reflected by the participants varied throughout the process. Sometimes, particularly but not exclusively early in the developmental process, participants spoke with a student voice. At other points, participants reflected on their experiences through the perspectives of a clinical supervisor or counselor educator, reflecting a faculty voice. Sometimes participants shifted between the two voices. P5 directly addressed this issue:

So each of us was going through the process of being evaluated because there was a gatekeeping process for us as doctoral students . . . and so knowing that that was happening for us at the same time we were teaching it . . . it was just a pretty complex process.

P4’s comment on learning to give direct feedback in the clinical supervision unit reflects a conflicted voice:

But with a supervisee, it was different because you’re also in this evaluative role. . . . I wanted to like, be really supportive, you know . . . [but] I also had to evaluate their work. I wanted to be direct, but I also don’t want to give them a bad evaluation. It was just very difficult.

In this statement regarding the Level 1 module, P8 spoke through a counselor educator perspective:

I’m thinking about potentially becoming a faculty member . . . in interviewing at universities, I’d like to really try to understand their philosophy of gatekeeping and remediation to see if it could, like, be a good fit for me. If I went to a school and found out they didn’t do gatekeeping, I would have a really hard time being there . . . it’s just kind of like, “Well, what are we doing to ensure that the people we’re serving are protected?”

Uneven Responses to Experiential Learning
     Across all nine interviews, participants indicated a strong, positive response to experiential learning. However, some experiential elements were more powerful than others. Reflecting on the experience of participating in the PDCA-RA training video and the master’s admissions interviews, P7 stated: “I think it was just really, really fun to be a part of the training . . . and then to actually get the chance to do it again during admissions.” Teaching gatekeeping was described as a positive experience by P4:

Being forced to teach anyone anything is a good learning experience . . . a lot of pressure is on me. Like, oh, I really, really need to know this stuff so I can teach it pretty well. So, I definitely knew my presentation . . . so that was a good learning experience.

In relation to the mock hearing, P5 reflected: “I learned a lot. I was actually the student in the mock hearing and so I learned . . . from their perspective what they might experience, but I also learned from the other side of it too, from the institution side.”

Not all experiential activities were considered impactful. Three participants reflected that the remediation experiential module was confusing. The confusion may reflect on the module but could also be related to the concept that remediation is not a science and requires judgment, experience, and consultation with others. Stated by P8: “It was hard for me to tell [if the student made improvements] because I didn’t have like a clear baseline.” P1 reported: “I mostly ended up just having confusing conversations with the student.”

The ecological gatekeeping map also appeared to be lacking in experiential power. Although the group experience of working together on the module was deemed valuable, three participants could not recall what they learned from the experience. A word count showed participants gave shorter descriptions on the ecological map than on any of the other experiential units. It is possible that a deeper level of preparation in the ecological model would enhance the experiential learning. Understanding the system elements of higher education and how they overlap with gatekeeping is fraught with complexity, even for junior faculty.

Analysis of Reflections Data
     The data from the reflections were used to triangulate the interview data. In general, there was a high level of consistency between the reflections (submitted immediately following the modules) and the qualitative interviews (conducted after a time lapse). One interesting finding more evident in the reflections than in the interviews was the description of the emotional reactions to gatekeeping material. At the end of the analysis process, we created word clouds (pictorial displays of word frequencies) of the most common words used by participants. Through this process, we discovered there was a high frequency of a minimum of 12 emotionally laden words such as “scary” and “upsetting” in the data set, with more emotionality expressed in the reflections than in the interviews. Because the reflections were written, it appears that students were more likely to express emotional reactions in reflections than in the qualitative interviews. It is also possible that because the reflections were collected right after the experiential learning activities, emotional reactions were more accessible when the students wrote their reflections than at the time of the interviews.

Discussion and Implications

The CACREP expectation that counselor educators instruct doctoral students in gatekeeping and the awareness that new entrants to the counselor education workplace may experience considerable distress in their roles as gatekeepers inspired the study. Although gatekeeping and remediation may require a relatively small time commitment for new counselor educators, the nature of the work can be difficult and legalistic. The predominant goals of the study were to develop and infuse into the doctoral curriculum an experiential model for gatekeeping instruction and to gain insights into the lived experiences of doctoral students as they engaged in the learning modules.

The DEG Model is presented as one approach to doctoral instruction in gatekeeping. The experiential and developmental foundations for the approach are strongly supported in research, but literature on the application of these theories to the context of teaching gatekeeping to doctoral students was not available. Thus, the DEG Model and the qualitative study of the student learning experiences with the model are exploratory in nature. Nine students reported their perceptions and reactions to the DEG Model. An analysis of the lived experience of the students led to the discovery of four themes: importance of gatekeeping, behind the curtain, understandings vary by developmental level, and uneven responses to experiential learning. 

All nine participants were of one mind that gatekeeping, dispositional assessment, and remediation are important. Given that all nine students were from different master’s programs representing institutions located in various regions of the country, this finding suggests that gatekeeping has assumed a position of primacy as an essential function in counseling academic programs and an expected role for counselor educators. Earlier gatekeeping research reported hesitancy in trainees related to gatekeeping because of factors such as program culture, lack of protection for the gatekeepers, and confusion about the standards for gatekeeping (Shen-Miller et al., 2015). The results of this study suggest a possible shift in the perspective of new entrants to the counselor education workplace. In addition, state licensure boards have underscored the importance of gatekeeping the profession. Shen-Miller et al. (2015) also found that trainee ambivalence about the gatekeeping role mirrored faculty ambivalence, suggesting that faculty modeling of appropriate gatekeeping and remediation may be a critical factor in the changing attitudes of doctoral students. An alternative viewpoint is that though the students unanimously supported a belief that gatekeeping is important, their belief system may not translate well to their first actual gatekeeping situation as a counselor educator. The study participants had no direct experience with the often painful situations faculty face when legal action or student grievances are directed against them.

The behind the curtain theme illuminated the lack of transparency in gatekeeping, in that students were surprised by the gatekeeping processes. The finding is puzzling because remediation and gatekeeping literature encourages transparency in identification of dispositions, remediation processes, and reasons students might be dismissed from any given academic program. Perhaps for legal or other reasons counselor education programs are somewhat opaque in their explanations of gatekeeping.

The results provide support for delivering content in gatekeeping through developmental and experiential approaches. Consistent with developmental theory (Piaget, 1977) and findings in doctoral instruction in clinical supervision instruction (Baker et al., 2002; Granello & Hazler, 1998), students began the process with concrete understandings and moved toward more complex interpretations. Also, mirroring other studies in doctoral pedagogy (Dollarhide et al., 2013; Granello & Hazler, 1998), students attributed learning to engagement in experiential activities, rarely referencing lectures or reading assignments except as sources of foundational knowledge.

Aligned with developmental theory (Piaget, 1977), we learned that experiential learning must be carefully cross-walked to parallel to the developmental level of the participants. Two of the six modules (Mentoring Students Through Monitoring Remediation and Gatekeeping Through a Systems Lens: Designing an Ecological Gatekeeping Map) contained experiential elements that in retrospect the authors believe were not well aligned with the developmental levels of the students. Regarding the remediation module, at the time of the study, the doctoral students were working to embrace the new roles of teacher, researcher, and clinical supervisor. Adding the difficult-to-define role of remediation mentor was perhaps experienced as role overload. On the ecological map, the authors hypothesized that the task was too complex, requiring more didactic instruction and experience with systems in organizations.

The finding that two experiential elements were perhaps not targeted at the designated developmental level was less critical than the underscoring of the importance of conducting research on pedagogy in doctoral-level courses. Until conducting the study, we were unaware that the two experiential units were problematic and would have argued that the ecological gatekeeping map was one of the strongest experiential components in the DEG Model.

Implications for Counselor Education
     The findings of the study led to insights that inform program development and pedagogy for counselor educators. The values branch of program evaluation (Abma & Widdershoven, 2008) advocates the use of qualitative analysis to develop deeper understandings of how knowledge is constructed.

The finding that doctoral students expressed more emotion in the immediate aftermath of experiential activities reinforces the importance of prompt attention to emotional processing after experiential components. The emotional–motivational theory on learning posits that anxiety negatively impacts concentration and desired outcome as well as reduces interest in engaging in future learning experiences in the content area. This relationship is well documented in research on math anxiety (Passolunghi et al., 2019). Anxiety was expressed in some student reflections, but not unexpectedly, as gatekeeping can be laden with conflict.

The results point to several practical pedagogical issues referred to in program evaluation theory by Stufflebeam (2003) as input factors. One such factor is that experiential pedagogy requires more instructional time than didactic instruction. The authors concluded that the importance of gatekeeping and the overall positive results justified the time investment but recognize the difficulties involved in implementing time-intensive experiential activities. The findings reflect another counselor education input issue, which is the importance of building strong relationships with administrators and the legal department in order to offer students the opportunity to gain perspectives on gatekeeping from stakeholders outside the core counseling faculty. The End of the Road: Gatekeeping and Heartbreaking Adversity module could not be implemented without strong relationships with administrators and legal services.

The unique contributions of this study for counselor educators include an underscoring of the importance of instructing doctoral students in gatekeeping and the power of using experiential strategies. The interview data showed that students initially had a concrete interpretation of gatekeeping, but through participation in the experiential modules, they reported more comprehensive understandings. The importance of matching the learning experience to the developmental level of the student has been previously well established in developmental theory, but through the study we gained the insight that doctoral instruction in gatekeeping should begin at a concrete developmental level. The doctoral students in our study may have been advanced in terms of clinical and research skills, but their initial understanding of gatekeeping was unidimensional.

The study also underscores the importance of helping students reflect and identify their individual belief systems and personal approaches to gatekeeping. Although legal services may recommend that faculty consistently speak in one voice on gatekeeping issues, an essential first step in eventually developing departmental consensus is transparency between individual faculty on their differing perspectives. Beyond the department level, this ongoing conversation is also foundational to growing the profession in our collective understanding of gatekeeping. The study highlights the importance of starting this process at the doctoral student level.

Limitations and Future Research

One limitation of the study is that qualitative research is not intended to be generalized. Therefore, it is unknown if the findings apply to doctoral students enrolled in other counselor education programs. Although there were advantages in utilizing a participant pool with different levels of engagement in the DEG Modules, a limitation associated with this research team decision was that participants who had only experienced early modules may have reflected different perspectives if they had been interviewed after participation in the final modules. Second interviews were not conducted. Another limitation is that the students, though not enrolled in courses from the lead author at the time of the study, may still have been influenced to offer a positive perspective on their learning experiences. Follow-up post-graduation interviews could be a useful mechanism to address this limitation.

A limitation inherent in the design of the DEG Model is that although the design was appropriate for the context of one CES doctoral program, it may not be applicable to the institutional environments of other CES doctoral programs. The context of a high research institution may differ from an institution with a stronger focus on teaching, which could influence student reactions to the DEG Model. A second limitation related to the model itself is that departmental agreement was necessary to infuse gatekeeping material into three courses with different instructors with differing personal values and beliefs on gatekeeping. In addition, agreement to include doctoral students in master’s remediation experiences and admissions interviews was necessary to implement the DEG Model. This level of faculty collaboration may not be possible in all doctoral programs.

More research on counselor education doctoral preparation is needed. The dearth of CES research on pedagogy for instructing doctoral students is apparent in content areas well beyond gatekeeping. Within pedagogy for doctoral student preparation in gatekeeping, research is needed on outcome measures for the attainment of gatekeeping competence. In addition, a greater understanding of the impact of the personal experiences of those doctoral students who were remediated during their master’s preparation on their perspectives as future gatekeepers would be useful to the profession. Also, research on the amount of instructional time needed to effectively teach gatekeeping to a level of minimum competence is needed.

 

Conflict of Interest and Funding Disclosure
The authors reported no conflict of interest
or funding contributions for the development
of this manuscript.

 

References

*References marked with an asterisk indicate literature included in Table 1.

Abma, T. A., & Widdershoven, G. A. M. (2008). Evaluation and/as social relation. Evaluation, 14(2), 209–225. https://doi.org/10.1177/1356389007087540

Allen, R. F., & Pilnick, S. (1973). Confronting the shadow organization: How to detect and defeat negative norms. Organizational Dynamics, 1(4), 3–18. https://doi.org/10.1016/S0090-2616(73)80020-8

*American Counseling Association. (2014). ACA code of ethics. https://www.counseling.org/docs/ethics/2014-aca-code-of-ethics.pdf

*Association for Counselor Education and Supervision Taskforce on Best Practices in Clinical Supervision. (2011, April). Best practices in clinical supervision. https://acesonline.net/wp-content/uploads/2018/11/ACES-Best-Practices-in-Clinical-Supervision-2011.pdf

Baker, S. B., Exum, H. A., & Tyler, R. E. (2002). The developmental process of clinical supervisors in training: An investigation of the supervisor complexity model. Counselor Education and Supervision, 42(1), 15–30. https://doi.org/10.1002/j.1556-6978.2002.tb01300.x

Barrio Minton, C. A., Wachter Morris, C., & Bruner, S. L. (2018). Pedagogy in counselor education: 2011-2015 update. Counselor Education and Supervision, 57(3), 227–236. https://doi.org/10.1002/ceas.12112

*Bemak, F., Epp, L. R., & Keys, S. G. (1999). Impaired graduate students: A process model of graduate program monitoring and intervention. International Journal for the Advancement of Counselling, 21(1), 19–30.
https://doi.org/10.1023/A:1005387309472

Bernard, J. M. (1997). The discrimination model. In C. E. Watkins, Jr. (Ed.), Handbook of psychotherapy supervision (pp. 310–327). Wiley.

*Bernard, J. M. (2006). Tracing the development of clinical supervision. The Clinical Supervisor, 24(1–2), 3–21. https://doi.org/10.1300/j001v24n01_02

*Bhat, C. S. (2005). Enhancing counseling gatekeeping with performance appraisal protocols. International Journal for the Advancement of Counselling, 27(3), 399–411. https://doi.org/10.1007/s10447-005-8202-z

Bloom, B. S. (Ed.). (1956). Taxonomy of educational objectives: The classification of educational goals. David McKay Company.

Bodner, K. E. (2012). Ethical principles and standards that inform educational gatekeeping practices in psychology. Ethics & Behavior, 22(1), 60–74. https://doi.org/10.1080/10508422.2012.638827

Borders, L. D., Rainey, L. M., Crutchfield, L. B., & Martin, D. W. (1996). Impact of a counseling supervision course on doctoral students’ cognitions. Counselor Education and Supervision, 35(3), 204–217.
https://doi.org/10.1002/j.1556-6978.1996.tb00224.x

Borowy, T. D., & McGuire, J. M. (1983). Experiential versus didactic teaching: Changes in self-actualization. The Journal of Humanistic Education and Development, 21(4), 146–152.
https://doi.org/10.1002/j.2164-4683.1983.tb00227.x

*Brear, P., Dorrian, J., & Luscri, G. (2008). Preparing our future counseling professionals: Gatekeeping and the implications for research. Counselling and Psychotherapy Research, 8(2), 93–101.
https://doi.org/10.1080/14733140802007855

Bronfenbrenner, U. (1977). Toward an experimental ecology of human development. American Psychologist, 32(7), 513–531. https://doi.org/10.1037/0003-066X.32.7.513

*Brown, M. (2013). A content analysis of problematic behaviors in counselor education programs. Counselor Education and Supervision, 52(3), 179–192. https://doi.org/10.1002/j.1556-6978.2013.00036.x

*Brown-Rice, K. (2012). Examining counselor educators’ use of impairment in gatekeeping terminology. In Ideas and research you can use: VISTAS 2012, 1. https://www.counseling.org/resources/library/VISTAS/vistas12/Article_21.pdf

*Case, R., Demetriou, A., Platsidou, M., & Kazi, S. (2001). Integrating concepts and tests of intelligence from the differential and developmental traditions. Intelligence, 29(4), 307–336.
https://doi.org/10.1016/S0160-2896(00)00057-x

Corbin, J., & Strauss, A. (2008). Basics of qualitative research (3rd ed.). SAGE.

Council for Accreditation of Counseling and Related Educational Programs. (2015). 2016 CACREP standards. http://www.cacrep.org/wp-content/uploads/2017/08/2016-Standards-with-citations.pdf

*Crawford, M., & Gilroy, P. (2013). Professional impairment and gatekeeping: A survey of master’s level training programs. The Journal of Counselor Preparation and Supervision, 5(1). https://doi.org/10.7729/51.0030

Creswell, J. W. (2013). Qualitative inquiry and research design: Choosing among five approaches (3rd ed.). SAGE.

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE.

Dollarhide, C. T., Gibson, D. M., & Moss, J. M. (2013). Professional identity development of counselor education doctoral students. Counselor Education and Supervision, 52(2), 137–150.
https://doi.org/10.1002/j.1556-6978.2013.00034.x

*Dufrene, R. L., & Henderson, K. L. (2009). A framework for remediation plans for counseling trainees. In G. G. Walz, J. C. Bleuer, & R. K. Yep (Eds.), Compelling counseling images: VISTAS 2009 (pp. 149–159). American Counseling Association.

Eggen, P., & Kauchak, D. (2001). Educational psychology: Windows on classrooms (5th ed.). Merrill/Prentice Hall.

*Elpers, K., & FitzGerald, E. A. (2013). Issues and challenges in gatekeeping: A framework for implementation. Social Work Education, 32(3), 286–300. https://doi.org/10.1080/02615479.2012.665867

*Enochs, W. K., & Etzbach, C. A. (2004). Impaired student counselors: Ethical and legal considerations for the family. The Family Journal, 12(4), 396–400. https://doi.org/10.1177/1066480704267240

*Forrest, L., Elman, N., Gizara, S., & Vacha-Haase, T. (1999). Trainee impairment: A review of identification, remediation, dismissal, and legal issues. The Counseling Psychologist, 27(5), 627–686.
https://doi.org/10.1177/0011000099275001

*Forrest, L., Shen Miller, D. S., & Elman, N. S. (2008). Psychology trainees with competence problems: From individual to ecological conceptualizations. Training and Education in Professional Psychology, 2(4), 183–192. https://doi.org/10.1037/1931-3918.2.4.183

*Frame, M. W., & Stevens-Smith, P. (1995). Out of harm’s way: Enhancing monitoring and dismissal processes in counselor education programs. Counselor Education and Supervision, 35(2), 118–129.
https://doi.org/10.1002/j.1556-6978.1995.tb00216.x

Freeman, B. J., & Garner, C. M. (2020). Training video and tools: The Professional Disposition Competency Assessment System (Revised) [Unpublished admissions tool]. University of Nevada, Reno.

Furr, S. R., & Carroll, J. J. (2003). Critical incidents in student counselor development. Journal of Counseling & Development, 81(4), 483–489. https://doi.org/10.1002/j.1556-6678.2003.tb00275.x

Galizzi, M. (2014). Bringing Adam Smith’s pin factory to life: Field trips and discussions as forms of experiential learning. Journal of the Scholarship of Teaching and Learning, 14(5), 27–47.
https://doi.org/10.14434/josotlv14i5.12938

Garner, C., Freeman, B., Stewart, R., & Coll, K. (2020). Assessment of dispositions in program admissions: The Professional Disposition Competency Assessment—Revised Admission (PDCA-RA). The Professional Counselor, 10(3), 337–350. https://doi.org/10.15241/cg.10.3.337

Gaubatz, M. D., & Vera, E. M. (2002). Do formalized gatekeeping procedures increase programs’ follow-up with deficient trainees? Counselor Education and Supervision, 41(4), 294–305.
https://doi.org/10.1002/j.1556-6978.2002.tb01292.x

*Gazzola, N., De Stefano, J., Thériault, A., & Audet, C. T. (2013). Learning to be supervisors: A qualitative investigation of difficulties experienced by supervisors-in-training. The Clinical Supervisor, 32(1), 15–39. https://doi.org/10.1080/07325223.2013.778678

*Gizara, S. S., & Forrest, L. (2004). Supervisors’ experiences of trainee impairment and incompetence at APA-accredited internship sites. Professional Psychology: Research and Practice, 35(2), 131–140.
https://doi.org/10.1037/0735-7028.35.2.131

*Goodrich, K. M., & Shin, R. Q. (2013). A culturally responsive intervention for addressing problematic behaviors in counseling students. Counselor Education and Supervision, 52(1), 43–55.
https://doi.org/10.1002/j.1556-6978.2013.00027.x

Granello, D. H. (2000). Contextual teaching and learning in counselor education. Counselor Education and Supervision, 39(4), 270–283. https://doi.org/10.1002/j.1556-6978.2000.tb01237.x

Granello, D. H., & Hazler, R. J. (1998). A developmental rationale for curriculum order and teaching styles in counselor education programs. Counselor Education and Supervision, 38(2), 89–105.
https://doi.org/10.1002/j.1556-6978.1998.tb00561.x

Greene, J. P., Kisida, B., & Bowen, D. H. (2014). The educational value of field trips. Education Next, 14(1), 78–86. https://www.educationnext.org/the-educational-value-of-field-trips

*Henderson, K. L. (2010). The remediation of students in counseling graduate programs: Behavioral indicators, terminology, and interventions [Unpublished doctoral dissertation]. University of New Orleans.

*Homrich, A. M. (2009). Gatekeeping for personal and professional competence in graduate counseling programs. Counseling & Human Development, 41(7), 1–24.

Husserl, E. (2001). Logical investigations (2nd ed.). Routledge.

*Hutchens, N., Block, J., & Young, M. (2013). Counselor educators’ gatekeeping responsibilities and students’ first amendment rights. Counselor Education and Supervision, 52(2), 82–95.
https://doi.org/10.1002/j.1556-6978.2013.00030.x

*Jacobs, S. C., Huprich, S. K., Grus, C. L., Cage, E. A., Elman, N. S., Forrest, L. M., Schwartz-Mette, R., Shen-Miller, D., Van Sickle, K., & Kaslow, N. (2011). Trainees with professional competency problems: Preparing trainers for difficult but necessary conversations. Training and Education in Professional Psychology, 5(3), 175–184. https://doi.org/10.1037/a0024656

*Johnson, W. B., Elman, N. S., Forrest, L., Robiner, W. N., Rodolfa, E., & Schaffer, J. B. (2008). Addressing professional competence problems in trainees: Some ethical considerations. Professional Psychology: Research and Practice, 39(6), 589–599. https://doi.org/10.1037/a0014264

*Kerl, S. B., Garcia, J. L., McCullough, C. S., & Maxwell, M. E. (2002). Systematic evaluation of professional performance: Legally supported procedure and process. Counselor Education and Supervision, 41(4), 321–332. https://doi.org/10.1002/j.1556-6978.2002.tb01294.x

Kim, B. S. K., & Lyons, H. Z. (2003). Experiential activities and multicultural counseling competence training. Journal of Counseling & Development, 81(4), 400–408. https://doi.org/10.1002/j.1556-6678.2003.tb00266.x

Kolb, A. Y., & Kolb, D. A. (2009). The learning way: Meta-cognitive aspects of experiential learning. Simulation & Gaming, 40(3), 297–327. https://doi.org/10.1177/1046878108325713

*Kress, V. E., & Protivnak, J. J. (2009). Professional development plans to remedy problematic counseling student behaviors. Counselor Education and Supervision, 48(3), 154–166.
https://doi.org/10.1002/j.1556-6978.2009.tb00071.x

*Lamb, D. H., Presser, N. R., Pfost, K. S., Baum, M. C., Jackson, V. R., & Jarvis, P. A. (1987). Confronting professional impairment during the internship: Identification, due process, and remediation. Professional Psychology: Research and Practice, 18(6), 597–603. https://doi.org/10.1037/0735-7028.18.6.597

Loevinger, J. (1976). Ego development. Jossey-Bass.

*Lumadue, C. A., & Duffey, T. H. (1999). The role of graduate programs as gatekeepers: A model for evaluating student counselor competence. Counselor Education and Supervision, 39(2), 101–109.
https://doi.org/10.1002/j.1556-6978.1999.tb01221.x

*McAdams, C. R., III, Foster, V. A., & Ward, T. J. (2007). Remediation and dismissal policies in counselor education: Lessons learned from a challenge in federal court. Counselor Education and Supervision, 46(3), 212–229. https://doi.org/10.1002/j.1556-6978.2007.ub00026.x

*McCaughan, A. M., & Hill, N. R. (2015). The gatekeeping imperative in counselor education admission protocols: The criticality of personal qualities. International Journal for the Advancement of Counselling, 37, 28–40. https://doi.org/10.1007/s10447-014-9223-2

*McDaniel, K. Z. (2007). Using the right tool for the right situation: Tailoring remediation plans for problem trainees within accredited marriage and family therapy programs. [Unpublished doctoral dissertation]. Kansas State University.

Mertens, D. M., & Wilson, A. T. (2012). Program evaluation theory and practice (1st ed.) Guilford.

*Miller, C. M. (2010). Endorsement for licensure: Practices and challenges reported by counselor supervisors. [Unpublished doctoral dissertation]. University of Virginia.

Moules, N. J., McCaffrey, G., Field, J. C., & Laing, C. M. (2015). Conducting hermeneutic research: From philosophy to practice. Peter Lang Publishing.

Moustakas, C. (1994). Phenomenological research methods. SAGE.

NVivo qualitative data analysis. (2012). Pty Ltd. (Version 12) [Computer software]. QSR International.

Passolunghi, M. C., Cargnelutti, E., & Pellizzoni, S. (2019). The relation between cognitive and emotional factors and arithmetic problem-solving. Educational Studies in Mathematics, 100(3), 271–290.
https://doi.org/10.1007/s10649-018-9863-y

Patton, M. Q. (2015). Qualitative research and evaluation methods (4th ed.). SAGE.

Piaget, J. (1977). The development of thought: Equilibration of cognitive structures. Basil Blackwell.

*Reddy, Y. M., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & Evaluation in Higher Education, 35(4), 435–448. https://doi.org/10.1080/026029309286259

*Rossman, G. B., & Rallis, S. F. (1998). Learning in the field: An introduction to qualitative research (1st ed.). SAGE.

*Russell, C. S., DuPree, W. J., Beggs, M. A., Peterson, C. M., & Anderson, M. P. (2007). Responding to remediation and gatekeeping challenges in supervision. Journal of Marital and Family Therapy, 33(2), 227–244. https://doi.org/10.1111/j.1752-0606.2007.00018.x

*Russell, C. S., & Peterson, C. M. (2003). Student impairment and remediation in accredited marriage and family therapy programs. Journal of Marital and Family Therapy, 29(3), 329–337.
https://doi.org/10.1111/j.1752-0606.2003.tb01210.x

Schuermann, H., Avent Harris, J. R., & Lloyd-Hazlett, J. (2018). Academic role and perceptions of gatekeeping in counselor education. Counselor Education and Supervision, 57(1), 51–65.
https://doi.org/10.1002/ceas.12093

Shen-Miller, D. S., Schwartz-Mette, R., Van Sickle, K. S., Jacobs, S. C., Grus, C. L., Hunter, E. A., & Forrest, L.
(2015). Professional competence problems in training: A qualitative investigation of trainee perspectives. Training and Education in Professional Psychology, 9(2), 161–169. https://doi.org/10.1037/tep0000072

Shreeve, M. W. (2008). Beyond the didactic classroom: Educational models to encourage active student involvement in learning. The Journal of Chiropractic Education, 22(1), 23–28. https://doi.org/10.7899/1042-5055-22.1.23

Stufflebeam, D. L. (2003). The CIPP model for evaluation. In T. Kellaghan, D. Stufflebeam, & L. A. Wingate (Eds.), International handbook of educational evaluation (pp. 31–62). Springer.

*Swank, J. M. (2014). Assessing counseling competencies: A comparison of supervisors’ ratings and student supervisees’ self-ratings. Counseling Outcome Research and Evaluation, 5(1), 17–27.
https://doi.org/10.1177/2150137814529147

*Swank, J. M., Lambie, G. W., & Witta, E. L. (2012). An exploratory investigation of the Counseling Competencies Scale: A measure of counseling skills, dispositions, and behaviors. Counselor Education and Supervision, 51(3), 189–206. https://doi.org/10.1002/j.1556-6978.2012.00014.x

*Swank, J. M., & Smith-Adcock, S. (2013). Creative group strategies for interviewing applicants for counselor education programs. The Journal of Counselor Preparation and Supervision, 5(1). https://doi.org/10.7729/51.0039

*Tate, K. A., Bloom, M. L., Tassara, M. H., & Caperton, W. (2014). Counselor competence, performance assessment, and program evaluation: Using psychometric instruments. Measurement and Evaluation in Counseling and Development, 47(4), 291–306. https://doi.org/10.1177/0748175614538063

*Taub, D. J., Servaty-Seib, H. L., Wachter Morris, C. A., Prieto-Welch, S. L., & Werden, D. (2011). Developing skills in providing outreach programs: Construction and use of the POSE (Performance of Outreach Skills Evaluation) rubric. Counseling Outcome Research and Evaluation, 2(1), 59–72. https://doi.org/10.1177/2150137811401019

Tretinjak, C. A., & Riggs, E. M. (2008). Enhancement of geology content knowledge through field-based instruction for pre-service elementary teachers. Journal of Geoscience Education, 56(5), 422–433.
https://doi.org/10.5408/jge_nov2008_riggs_422

*Winograd, G., & Tryon, G. S. (2009). Counseling expectations among students in an opportunity program: Dispositional and cultural influences. Journal of Counseling & Development, 87(4), 438–448.
https://doi.org/10.1002/j.1556-6678.2009.tb00128.x

 

Brenda Freeman, PhD, NCC, LCPC, CPC, is a professor at the University of Nevada, Reno. Tricia Woodliff, PhD, NCC, ACS, CPC, is an assistant professor at the University of Nevada, Reno. Mona Martinez, PhD, CPC, is Downing Clinic Director at the University of Nevada, Reno. Correspondence may be addressed to Brenda Freeman, William Raggio Building Rm. 3007, University of Nevada, Reno/0281, Reno, NV 89557, brendafreeman@unr.edu.

Recruiting, Retaining, and Supporting Students From Underrepresented Racial Minority Backgrounds in Doctoral Counselor Education

Jennie Ju, Rose Merrell-James, J. Kelly Coker, Michelle Ghoston, Javier F. Casado Pérez, Thomas A. Field

 

Few models exist that inform how counselor education programs proactively address the gap between diverse student needs and effective support. In this study, we utilized grounded theory qualitative research to gain a better understanding of how 15 faculty members in doctoral counselor education and supervision programs reported that their departments responded to the need for recruiting, retaining, and supporting doctoral students from underrepresented racial minority backgrounds. We also explored participants’ reported successes with these strategies. A framework emerged to explain the strategies that counselor education departments have implemented in recruiting, supporting, and retaining students from underrepresented racial minority backgrounds. The main categories identified were: (a) institutional and program characteristics, (b) recruitment strategies, and (c) support and retention strategies. The latter two main categories both had the same two subcategories, namely awareness and understanding, and proactive and intentional efforts. The latter subcategory had three subthemes of connecting to cultural identity, providing personalized support, and faculty involvement.  

Keywords: underrepresented racial minority, recruitment, retention, counselor education, doctoral

 

For the past several years, doctoral counselor education and supervision (CES) programs accredited by the Council for Accreditation of Counseling and Related Educational Programs (CACREP) have experienced a greater enrollment of students from diverse backgrounds (CACREP, 2014, 2015). According to the CACREP Vital Statistics report (2018), two-fifths of doctoral students have a diverse racial or ethnic identity. This stands in contrast to the less than 30% of full-time faculty in CACREP-accredited programs who identify as having a diverse racial or ethnic identity. In 2012, the total doctoral-level enrollment in CACREP institutions was 2,028, where 37% of the students were from racially or ethnically diverse backgrounds (CACREP, 2014). Enrollment increased to 2,561 in 2017, with 1,016 students from racially or ethnically diverse communities, which translates to 39.7% of total enrollment (CACREP, 2018).

Accompanying this trend is a growing awareness that diverse doctoral students in counseling and related disciplines are not receiving adequate support and preparation to succeed (Barker, 2016; Henfield et al., 2011; Hollingsworth & Fassinger, 2002; Zeligman et al., 2015). CACREP-accredited programs are charged with making a “continuous and systematic effort to attract, enroll, and retain a diverse group of students and to create and support an inclusive learning community” (CACREP, 2016, section 1.K.). Yet few models exist that inform how CES programs proactively address the gap between diverse student needs and effective support. Literature is limited on this topic. Little is known about effective and comprehensive structures for recruiting, supporting, and retaining CES doctoral students from underrepresented minority (URM) backgrounds that take into consideration CACREP standards, student needs, economics, sociocultural barriers, and student opportunities.

In this study, we used Federal definitions of URM status in higher education to guide our inquiry. A section of the U.S. Code pertaining to minority persons provides the following definition for minority, and it is the one we chose to use in our study: “American Indian, Alaskan Native, Black (not of Hispanic origin), Hispanic (including persons of Mexican, Puerto Rican, Cuban, and Central or South American origin), Pacific Islander, or other ethnic group” (Definitions, 20 U.S.C. 20 § 1067k, 2020). This definition is important to higher education, as it is used by institutions to allocate funding for URM students. We note here that cultural diversity also spans other aspects of minority status, such as gender identity, sexual/affectional identity, and ability/disability status, among others. We restricted the focus of this study to exploring racial identity pertinent to URM status, following the U.S. Code definition.

Recruitment of Doctoral Students From URM Backgrounds
     Understanding the diversification of doctoral students in CES programs begins by first considering effective methods for recruitment used by those programs. Recruitment of CES doctoral students of color may necessitate intentional and active approaches, such as building personal connections in the community and family (Hipolito-Delgado et al., 2017; McCallum, 2016). CES doctoral programs might consider recruitment not as a yearly endeavor, but a long-term, day-to-day strategy. Early exposure, responsiveness to student needs (e.g., financial needs), commitment to diversity (e.g., hiring and retaining faculty members from diverse backgrounds), community relationships, and program location have all been identified as important factors to consider in the extant literature.

Early Exposure and Recruitment
     Programs can promote more representative recruitment through earlier exposure to the disciplinary field and community connections (Grapin et al., 2016; Hipolito-Delgado et al., 2017; McCallum, 2016). Introducing the possibility of pursuing doctoral studies in CES during the high school and undergraduate experience can increase student familiarity with the profession and may promote their long-term attention to the field (Luedke et al., 2019; McCallum, 2016). McCallum (2015, 2016) found that early familial and social messages about the low viability of doctoral studies was a deterrent among African American students and that mentorship and exposure to doctoral careers by professionals can help renew interest. Many undergraduate students from culturally diverse backgrounds lack opportunities to learn and develop ownership of doctoral-level professions and in some cases lack knowledge that those professions even exist (Grapin et al., 2016; Luedke et al., 2019).

Responsiveness to Needs and Commitment to Diversity
     To successfully recruit doctoral students from culturally diverse backgrounds, CES programs need to be responsive to potential students’ needs. In fact, a program’s commitment to diversity and the demonstration of that commitment through student and faculty representation have been found to be highly influential factors in applicants’ decisions to enter a doctoral program (Foxx et al., 2018; Grapin et al., 2016; Zeligman et al., 2015). An additional aspect of this responsiveness in recruitment is the program’s ability to ensure and provide financial support to incoming students (Dieker et al., 2013; Proctor & Romano, 2016). Given the unique barriers experienced by culturally diverse communities throughout the educational system, doctoral programs can be prepared to compensate for some of these obstacles through financial and academic support.

Community Relationships and Program Location
     In keeping with recruitment as a long-term endeavor, research has found that community relationships and program location are essential when recruiting doctoral students from culturally diverse backgrounds (Foxx et al., 2018; Hipolito-Delgado et al., 2017). CES programs can look to build relationships with their local culturally diverse communities and recruit from those communities, rather than looking nationally for their doctoral students (Foxx et al., 2018; Hipolito-Delgado et al., 2017). Proctor and Romano (2016) found that proximity to representative communities and applicants’ support systems had a significant impact on their decision to enter doctoral programs. Community connections also offered more opportunities to clarify admission requirements for interested students, a barrier for many first-generation students (Dieker et al., 2013; Hipolito-Delgado et al., 2017).

Support and Retention of Culturally Diverse Doctoral Students

Once admitted to a doctoral program in CES, program faculty are required by the CACREP (2015) standards to make a continuous and systematic effort to not only recruit but also to retain a diverse group of students. To do so, faculty should be attentive to both common and unique personal and social challenges, experiences of marginalization and isolation, and acculturative challenges that students from URM backgrounds may face.

Personal and Social Challenges
     Students from URM backgrounds have faced ongoing challenges with their ability to establish a clear voice and ethnic identity in predominately Euro-American CES programs (Baker & Moore, 2015; González, 2006; Guillory, 2009; Lerma et al., 2015). This phenomenon has been written about for decades (Lewis et al., 2004). Lewis et al. (2004) described the lived experiences of African American doctoral students at a predominantly Euro-American, Carnegie level R1 research institution. Key themes that emerged included feelings of isolation, tokenism, difficulty in developing relationships with Euro-American peers, and learning to negotiate the system. Further review of the literature found consistent challenges across diverse students, especially with establishing voice and ethnic identity (Baker & Moore, 2015; González, 2006; Lerma et al., 2015). Guillory (2009) noted that the level of difficulty American Indian students will face in college depends in large measure on how they see and use their ethnic identity. Utilizing a narrative inquiry approach, Hinojosa and Carney (2016) found that five Mexican American female students experienced similar challenges in maintaining their ethnic identities while navigating doctoral education culture.

Challenges of Marginalization and Isolation
     Marginalization and isolation were additional common themes across diverse groups. Blockett et al. (2016) concluded that students experience marginalization in three areas of socialization, including faculty mentorship, professional involvement, and environmental support. Other researchers have also concluded that both overt and covert racism is a contributing factor to marginalization in the university culture (Behl et al., 2017; González, 2006; Haizlip, 2012; Henfield et al., 2013; Interiano & Lim, 2018; Protivnak & Foss, 2009). Study themes also indicated that students often expressed frustration from tokenism in which they felt expectations to represent the entire race during doctoral programs (Baker & Moore, 2015; Haizlip, 2012; Henfield et al., 2013; Lerma et al., 2015; Woo et al., 2015). Henfield et al. (2011) investigated 11 African American doctoral students and found that the challenges included negative campus climates regarding race, feelings of isolation, marginalization, and lack of racial peer groups during their graduate education. Similarly, using critical race theory to examine how race affects student experience, Henfield et al. (2013) found African American students experienced a lack of respect from faculty because of their racial and ethnic differences. Students who had previously studied at historically Black colleges and universities (HBCUs) or Hispanic serving institutions (HSIs) reported that the lack of racial/ethnic diversity representation during doctoral study in predominantly White institutions (PWIs) contributed to their experience of stress, anxiety, and irritation (Henfield et al., 2011, 2013).

Culture and Acculturation Challenges
     Collectivity and community seem to be consistent values that doctoral students from URM backgrounds have expressed as missing or not understood by faculty (González, 2006; Lerma et al., 2015). For example, faculty may not understand familia, a Latinx student’s obligation to family  (González, 2006; Lerma et al., 2015). Several authors have reported that culturally diverse doctoral students experience difficulty adjusting to a curriculum or program that values a Eurocentric individualist form of counseling (Behl et al., 2017; Interiano & Lim, 2018; Woo et al., 2015).

International students also experience similar anxiety and stress during their doctoral studies in the United States. In addition to adjusting to speaking and writing in a language that may not be their primary language, their supervision skills and clinical abilities can be questioned by Euro-American supervisees despite international students having advanced training and supervisory status (Behl et al., 2017). Interiano and Lim (2018) used the term “chameleonic identity” (p. 310) to describe foreign-born doctoral students’ attempts to adapt to the Euro-American cultural context of their CES programs. They posited that international students experienced a sense of conflict, loss, and grief associated with the pressure to adopt cultural norms embedded in Euro-American counseling and higher education in the United States.

Strategies to Support and Retain Culturally Diverse Doctoral Students

     To address these stressors and barriers to persistence in doctoral studies, faculty members can employ several strategies to support and retain students from culturally diverse backgrounds, such as mentorship, advising, increasing faculty diversity, understanding students’ cultures, and offering student support services.

Mentorship
     Some scholars recommend intentional utilization of mentorship as a strategy for improving retention and graduation rates of diverse students in higher education (Evans & Cokley, 2008; Rogers & Molina, 2006). Chan et al. (2015) defined mentoring relationships as a “one-to-one ongoing connection between a more experienced member (mentor) and less experienced member (protégé) that is aimed to promote the professional and personal growth of the protégé through coaching, support and guidance” (p. 593). Chan and colleagues added that mentoring can involve transferring needed information, feedback, and encouragement to the protégé as well as providing emotional support.

Zeligman and colleagues (2015) indicated that mentoring impacts both the recruitment and the retention of doctoral students from URM backgrounds. The quality and significance of mentoring relationships and participants’ connection with faculty members during a doctoral program seems to influence choice in continuing doctoral study for URM students (Baker & Moore, 2015; Protivnak & Foss, 2009). Blackwell (1987) noted that the most powerful predictor of enrollment and graduation of African American students at a professional school was the presence of an African American faculty member serving as the student’s mentor.

Although a powerful tool for recruiting and retaining diverse doctoral students, mentoring can also create retention issues if inadequate or problematic. Students may receive ambiguous answers to advising questions and may not receive support when life circumstances interfere with study (Baker & Moore, 2015; Henfield et al., 2013; Interiano & Lim, 2018). In such situations, some students may seek other faculty mentors within the department (Baker & Moore, 2015; Henfield et al., 2013; Interiano & Lim, 2018) or may specifically establish mentoring relationships with faculty from diverse cultural backgrounds to receive greater support for their experience of being a person of color (González, 2006; Woo et al., 2015; Zeligman et al., 2015). Diverse students may also seek mentors from outside of their doctoral program. Woo and colleagues (2015) found that international students selected professional counseling mentors from their home community that they considered to be caring and nonjudgmental of their doctoral work in comparison to faculty supervisors they felt were neither culturally sensitive nor supportive of international students.

Because of an existing disparity in the availability of African American counselor educators and supervisors who can serve as mentors to African American doctoral counseling students, Euro-American counselor educators and supervisors can provide mentorship support to underrepresented African American doctoral students. Brown and Grothaus (2019) conducted a phenomenological study with 10 African American doctoral counseling students. The authors found that trust was a primary factor in establishing successful cross-racial relationships, and that African American students could benefit from “networks of privilege” (p. 218) during cross-racial mentoring. The authors also found that if issues of racism and oppression are not addressed, it can interfere with establishing mentoring relationships.

Establishing same-race, cross-race, and/or cultural community affiliations provides support to culturally diverse doctoral students. In addition, increasing faculty diversity can be a viable measure to support and retain diverse doctoral students.

Increasing Faculty Diversity
     The presence of diverse faculty members in CES has been discussed in the literature as a positive element in the recruitment, support, and retention of diverse doctoral students (Henfield et al., 2013; Lerma et al., 2015; Zeligman et al., 2015). Henfield and colleagues (2013) emphasized the need to proactively recruit and retain African American CES faculty to attract, recruit, and retain African American CES doctoral students. Recruiting and retaining faculty members from URM backgrounds requires intentional effort. Ponjuan (2011) suggested the development of mentoring policies that establish Hispanic learning communities and improve overall departmental climate as efforts to help increase the number of Latinx faculty at an institution. The next section discusses the relational significance of having counselor educator mentors who share cultural backgrounds and worldviews.

Understanding of Students’ Culture
     Lerma et al. (2015) recommended that doctoral faculty in CES programs be responsive to both the professional and personal development of their students. One area of dissonance for doctoral students from URM backgrounds involves differences in cultural worldview. Marsella and Pederson (2004) posited that “Western psychology is rooted in an ideology of individualism, rationality, and empiricism that has little resonance in many of the more than 5,000 cultures found in today’s world” (p. 414). Ng and Smith (2009) found that international counselor trainees, particularly those from non-Western nations, struggle with integrating Eurocentric theories and concepts into the world they know. This presents opportunities for counselor educators to intentionally search for appropriate pedagogies and to critically present readings and other media that portray the multicultural perspective (Goodman et al., 2015).

Counseling departments can promote, facilitate, and value a multicultural orientation when focusing on student success and development. Lerma et al. (2015) and Castellanos et al. (2006) emphasized the need to understand the importance of family and peer support among Latinx students and faculty, specifically in recreating familia in the academic environment to help increase resilience. When working with African American students, Henfield et al. (2013) recommended that faculty should possess an understanding and respect of African American culture and be more “cognizant of how a history of oppression may influence students’ perception, behavior, and nonbehavior” (p. 134). Faculty members should also possess an understanding of student financial difficulties and potential knowledge gaps in preparation for graduate school (González, 2006; Zeligman et al., 2015).

Student Support Services
     Another effective area of support for doctoral students from diverse backgrounds is student-based services. These services include broader institutionally based resources, student-guided groups or activities, and community-based efforts. Institutional resources that seem to hold promise in increasing support for and the potential success of diverse students include race-based organizations (Henfield et al., 2011). Peer support has been consistently identified as an important factor in doctoral student persistence (Chen et al., 2020; Henfield et al., 2011; Rogers & Molina, 2006). Student-centered organizations can effectively provide a sense of belonging and an environment that facilitates peer support among those with shared interests on campus (Rogers & Molina, 2006). Henfield et al. (2011) found that African American students sought collaborative support through race-based campus organizations and with students who share similar backgrounds and interests. Multicultural-based, student-centered organizations and events are resources that institutions utilize as active support for multicultural individuals that contribute to “sustaining diverse students to reach the finish line of graduation with a strong foundation from which to launch their counseling career” (Chen et al., 2020, p. 10).

Chen et al. (2020) and Behl et al. (2017) have both reported that writing centers are an important support for international students as well as students from refugee, immigrant, and underprivileged communities. Ng (2006) reported that counseling students from non–English-speaking countries often experience challenges related to English proficiency. Chen et al. (2020) added that tutoring in writing is critical for students who come from cultures that are unaccustomed to the formal use of writing styles (e.g., APA style). Furthermore, helping international students understand classroom norms and culture through an orientation as part of the onboarding process can be a preventive support (Behl et al., 2017).

Purpose of the Present Study
     The CACREP standards have created expectations and requirements for counseling programs to recruit, retain, and support students from diverse backgrounds. There now exists a wide swath of literature that has reported a variety of efforts toward these goals (Baker & Moore, 2015; Evans & Cokley, 2008; Rogers & Molina, 2006; Woo et al., 2015). Yet at the time of writing, there is not a clearly articulated path for CES programs to follow with regard to these efforts. For example, there is currently no information available regarding which strategies are more successful or easier to implement than others. This study aimed to address this gap in knowledge for how to attract, support, and retain students from diverse backgrounds in CES doctoral programs. The purpose of our study was to explore: (a) strategies doctoral programs use to recruit, retain, and support underrepresented doctoral students from diverse backgrounds, and (b) the level of success these programs have had with their implemented strategies.

Methodology

Throughout the study, we were grounded by a shared belief in constructivist philosophy that participants’ realities are socially co-constructed, and therefore, all responses are valued regardless of frequency. From this philosophical position, we chose to approach the topic using a qualitative framework (Lincoln & Guba, 2013). Grounded theory was selected because it utilizes a systematic and progressive gathering and analysis of data, followed by grounding the concepts in data that accurately describe the participants’ own voices (Charmaz, 2014; Corbin & Strauss, 2015). This approach allows the integration of both the art and science aspects of inquiry while supporting systematic development of theoretical constructs that promote richer comprehension and explanation of social phenomena (Charmaz, 2014; Corbin & Strauss, 2015). Through the grounded theory approach, we hoped to establish an emergent framework to explain practice and provide recommendations for CES programs striving to support diverse doctoral students.

This study was part of a larger comprehensive qualitative study based on the basic qualitative research design described by Merriam and Tisdell (2016) that examined a series of issues pertinent to doctoral counselor education. Preston et al. (2020) described the larger qualitative project that involved the collection and analysis of in-depth qualitative interviews with 15 doctoral-level counselor educators. This article focuses on the analysis of interview data gathered through two of the interview questions: 1) Which strategies has your program used to recruit underrepresented students from diverse backgrounds? How successful were those? and 2) Which strategies has your program used to support and retain underrepresented students from diverse backgrounds? How successful were those?

Researcher Positioning, Role, and Bias
     The last author utilized the etic position, which is through the perspective of the observer, to conduct all interviews with selected participants. Approaching the interview process around the topic of doctoral-level counselor education through the etic status was important because the author had not worked in a doctoral-level CES program previously but has been a member of the counselor education community.

The situational context was composed of the researchers’ and participants’ experiences and perceptions, the social environment, and the interaction between them (Ponterotto, 2005). Therefore, we engaged in reflexivity to increase self-awareness of biases related to this topic (Corbin & Strauss, 2015). This required continual examination of the potential influence that identified biases may have on the research process. In keeping with the standard of reflexivity, we recorded our personal experiences as they related to the research questions with the use of memoing to bracket potential biases throughout the coding and analysis process.

All members of the research team are from CACREP-accredited institutions in the Western and Eastern parts of the United States. The coding team consisted of the first four authors. The fifth author contributed to writing the manuscript, and the sixth author conducted the interviews as part of the larger study and assisted in writing sections of the methodology. All four coding team members had previously been doctoral students in a CES program, though only one of the coding team members had ever worked in a CES doctoral program as a full-time faculty member. This person thus had emic positioning, while other team members held etic positioning.

Four of the five members of the coding team were from diverse backgrounds themselves and were influenced by their personal experiences as doctoral students. Two members of the coding team identified as cisgender, heterosexual African American females. One member identified as a cisgender, heterosexual Asian American female and another as a cisgender, heterosexual Euro-American female. The coding team members were aware of potential biases around expectations toward the programs discussed in the transcripts and recognized the need to closely examine personal perceptions and understanding of the interview data.

Two coding team members observed the lack of racial/ethnic diversity at the counseling programs where they currently work. They experienced Eurocentric, non–culturally responsive methods of support and development that led them to recognize the potential bias of shared experience with multicultural participants. One coding team member was Euro-American and was a part of an all Euro-American doctoral cohort. The program they attended had an all Euro-American faculty and she wondered whether the predominantly Euro-American participants in this study had an understanding of the challenges of diverse students. Having taught in doctoral programs, this researcher was aware of potential biases around types of universities that might be successful in recruiting but less so in retaining diverse students.

Participants
     Participants were selected based on the following study design criteria: 1) current full-time core faculty members in CES, and 2) currently working in a doctoral-level CES program that is accredited by CACREP. At the time of writing, there were 85 CACREP-accredited doctoral CES programs in the United States (CACREP, 2019). Purposeful sampling was used to identify and recruit participants who had experiences working in doctoral-level counselor education (Merriam & Tisdell, 2016). Information-rich cases were sought to understand the phenomenon of interest.

Maximum variation sampling was also employed for the purposes of understanding the perspectives of counselor educators from diverse backgrounds with regard to demographic characteristics and program characteristics and to avoid premature saturation (Merriam & Tisdell, 2016). Based on the belief that counselor educator perspectives may differ by background, the research team used the following criteria to select participants: (a) racial and ethnic self-identification; (b) gender self-identification; (c) length of time working in doctoral-level CES programs; (d) Carnegie classification of the university where the participant was currently working (The Carnegie Classification of Institutions of Higher Education, 2019); (e) region of the counselor education program where the participant was currently working, using regions commonly defined by national counselor education associations and organizations; and (f) delivery mode of the counselor education program where the participant was currently working (e.g., in-person, online; Preston et al., 2020).

The 15 study participants belonged to separate doctoral-level CES programs, with no more than one participant representing each program. The sample was composed of 11 participants (73.3%) who self-identified as White, with multiracial/multiethnic (n = 1, 6.7%), African American (n = 1, 6.7%), Asian (n = 1, 6.7%), and Latinx ethnic backgrounds (n = 1, 6.7%) also represented. Seven participants self-identified as female (46.7%), eight participants as male (53.3%), and none identified as non-binary or transgender. The majority of participants identified as heterosexual (n = 14, 93.3%), with one participant (6.7%) identifying as bisexual.

Participants’ experience as faculty members averaged full-time work for 19.7 years (SD = 9.0 years) and a median of 17 years, with a range from 4 to 34 years. For most of those years, participants worked in doctoral-level CES programs (M = 17.3 years, SD = 9.2 years, Mdn = 16 years), ranging from 3 to 33 years. More than half of participants (n = 9, 60%) spent their entire careers working in doctoral-level CES programs. Geographic distribution of the programs where participants worked were as follows: eight belonged to the Southern region (53.3%); two each (13.3%) belonged to the North Atlantic, North Central, and Western regions; and one program (6.7%) belonged to the Rocky Mountain region. Twelve participants (80%) were working in brick-and-mortar programs, and three participants (20%) were working in online or hybrid programs. With regard to Carnegie classification representation, nine (60%) were working at Doctoral Universities – Very High Research Activity (i.e., R1) institutions, two (13.3%) were working at Doctoral Universities – High Research Activity (i.e., R2) institutions, and four (26.7%) were working at universities with the Master’s Colleges and Universities: Larger Programs designation (The Carnegie Classification of Institutions of Higher Education, 2019; Preston et al., 2020).

Procedure
     After receiving approval from the last author’s IRB, the last author used the CACREP (2018) website directory to identify and recruit doctoral-level counselor educators who worked at the CACREP-accredited CES programs. Recruitment emails were sent to one faculty member at each of the 85 accredited programs. Fifteen of the 34 faculty (40% response rate) who responded were selected to participate on the basis of maximal variation.

Interview Protocol
     Each interview began with demographic questions that addressed self-identified characteristics such as race, ethnicity, gender, sexual/affectional orientation, years as a faculty member, years working in doctoral-level CES programs, number of doctoral programs the participant had worked in, and regions of the programs in which the counselor educator had worked. A series of eight in-depth interviews followed to address the research questions of the larger qualitative study. Interview questions developed in accordance with Patton’s (2014) guidelines were open-ended, as neutral as possible, avoided “why” questions, and were asked one at a time in a semi-structured interview protocol, with sparse follow-up questions salient to the main questions to ensure understanding of participant responses. Adhering to the interview protocol as outlined in Appendix A helped to ensure that data was gathered for each research question to the highest extent possible. Participants received the interview questions ahead of time upon signing the informed consent agreement. A pilot of the interview protocol was conducted with a faculty member in a doctoral-level CES program prior to commencing the study.

The interviews lasted approximately 60 minutes and were recorded using the Zoom online platform. One exception was an interview that occurred in-person during a professional conference and thus was recorded via a Sony digital audio recorder. All demographic information and recordings were assigned an alphabetical identifier known only to the last author and were blinded to subsequent transcribers and coders.

Data Analysis
     Data analysis, as outlined by Corbin and Strauss (2015), employs the techniques of coding interview data to derive and develop concepts. In the initial step of open coding, the primary task is to “break data apart and delineate concepts to stand for blocks of raw data” (Corbin & Strauss, 2015, p. 197). During this step, the coding team sought to identify a list of significant participant statements about how they and their department perceive, value, and experience the responsibility of recruiting, retaining, and supporting underrepresented cultural groups. We met to code the first three of 15 transcripts together via Zoom video platform. The task of identifying codes included searching for data that was salient to the research questions and engaging in constant comparison until reaching saturation (Corbin & Strauss, 2015). We maintained a master codebook of participant statements that the team decided were relevant, then added descriptions and categories to the codes. Utilizing this same strategy, the remaining 12 transcripts were coded in dyads to make sure the coding team was not overlooking pertinent information.

When discrepancies occurred, the coding team utilized the following methods to resolve them:
(a) checking with each other for clarification and understanding of each person’s view on the code, (b) reviewing previous and subsequent lines for context, (c) slowing down the pace of coding to allow space for reflection on the team members’ thoughts and feeling about a code, (d) considering the creation of a new code if one part of the statement added new data that was not covered in the first part of the statement, and (e) referring back to the research questions to determine relevance of the statement. Discrepancies in coding were questions around statements that: (a) were vague, (b) contained multiple codes, (c) were similarly phrased, (d) reflected a wish rather than an action on the part of the program, and (e) presented interesting information about the participant’s program but did not address the research question.

The subsequent step of axial coding involved the task of relating concepts and categories to each other, from which the contexts and processes of the phenomena emerge (Corbin & Strauss, 2015). The researchers then framed emerging themes and concepts to identify higher-level concepts and lower-level properties as well as delineated relationships between categories until saturation was reached. In the step of selective coding, the researchers engaged in an ongoing process of integrating and refining the framework that emerged from categories and relationships to form one central concept (Strauss & Corbin, 1998).

Trustworthiness
     Standards of trustworthiness were achieved by incorporating procedures as outlined by Creswell et al. (2007) and Merriam and Tisdell (2016). The strategies included enhancing credibility through clarification of researcher bias to illustrate the researchers’ position as well as identifying a priori biases and assumptions that could potentially impact our inquiry. In addition, the research team members were from different counselor education programs, which contributed to moderating bias in coding and analysis. In an attempt to avoid interpreting data too early during the coding process, the researchers used emergent, in vivo, verbatim, line-by-line open coding. Furthermore, the interviewer intentionally chose not to participate in coding the data in order to minimize bias through being too close to the data. To promote consistency, the last author clearly identified and trained research teams associated with the larger study. The last author also used member checking and kept an audit trail of the process to enhance credibility. Purposive sampling and thick description were used to ensure adequate representation of perspectives and thus strengthen the transferability and dependability qualities of the study (Merriam & Tisdell, 2016).

Results

Implementing strategies that make a difference was the central concept in describing the process of CES faculty participants’ experience with recruiting and retaining diverse doctoral students. These strategies refer to programmatic steps that counselor educator interview participants had found to be effective in the recruitment, support, and retention of culturally diverse doctoral students. This central concept was composed of three progressive and interconnected categories, each with its own subcategories, properties, and accompanying dimensions. These three categories were institutional and program characteristics, recruitment strategies, and support and retention strategies. The three major categories shared the subcategory of awareness and understanding, while the recruitment strategies and support and retention strategies categories shared the subcategory of proactive and intentional efforts. The conceptual diagram of these categories and subcategories is depicted in Figure 1.

 

Figure 1  

Conceptual Diagram of Strategies That Make a Difference in Recruiting and Supporting
Culturally Diverse Doctoral Students

 

Institutional and Program Characteristics
     The category institutional and program characteristics refers to features that are a part of program identity. This category was significant, as it represents the backdrop for a unique set of conditions in which the participants experienced the limitations as well as strengths of the program environment. Institutional and program characteristics may be part of the institution’s natural setting that the faculty participant had little control over, such as geographic location, institution size, institution reputation, tuition cost, or demographic composition of the area in which the program was located. At times, these factors were helpful for recruitment purposes. One participant described how the program’s geographic location positively impacted the recruitment of prospective students, including diverse students: “We are the only doctoral program in the state, so I think that carries some clout.” Another participant added, “A lot of it is financial . . . They largely choose programs because they are geographically convenient, so they can work or be close to family. So, their choice is largely guided by economic and geographic factors.”

Institutional and program characteristics also included factors that influenced support and retention of diverse students through their doctoral journey. Characteristics mentioned as either a hindrance or a support for diverse students included: (a) presence of diverse faculty, visual representation, and student body; (b) supportive environment for diverse students; (c) faculty attitudes and dispositions which create either a welcoming or hostile sociocultural climate; (d) fellowship or scholarship monies intended for diverse students; (e) evidence of valuing of and commitment to diversity; (f) multicultural and social justice focused activities; and (g) faculty who share common research interests with their students. From this list, it was evident that doctoral students seemed best supported by program qualities and actions that communicated a valuing of and commitment to diversity.

Awareness and Understanding
     Participants indicated awareness that the context in which the institution and program exist presents as either a hindrance or a benefit to diversity. For example, geographic location and demographic composition of the locality can pose a barrier to recruitment as one participant expressed: “Our university itself is not going to attract people. It is a very White community.” This participant understands that this means the program will need to develop specific recruitment efforts to mitigate this potential barrier to “show students that this is a program that would be welcoming and take proactive steps to do that.”

Participants also indicated an awareness that students can sense whether diversity-related issues will be given priority. One participant stated, “Students are really astute about getting a sense for how committed a department is to diversity. So, having tangible evidence there is a willingness to commit to diversity at the faculty level is super important.” Another participant shared, “Our interview process is a barrier . . . There can be some privileged White males who are highly, highly confrontational, and I don’t think that’s an appropriate recruitment style for sending a welcoming message to minority candidates.”

Recruitment Strategies
     The second major category identified in the data, recruitment strategies, pertains to the process of developing and implementing plans for the primary purpose of attracting individuals from diverse backgrounds to apply and enroll in the program. The recruitment strategies category is composed of two subcategories that are shared with the support and retention strategies, namely awareness and understanding and proactive and intentional efforts.

Awareness and Understanding
Participants shared a variety of responses regarding their awareness and understanding of the importance of creating a diverse learning community. Some participants reported that their departments proactively sought to recruit underrepresented students, whereas others acknowledged that their departments made no such attempt. At times, this was due to the structure of recruiting at the university: “Our program doesn’t necessarily get involved in admissions that much . . . We have an admissions team, and they have a whole series of strategies in place.” At other times, participants reported that their program was unintentional about recruiting diverse students: “We don’t have any good strategy particularly. It’s accident, dumb luck and accident.” One participant experienced distress and confusion because of their program’s perceived misalignment with CACREP standards: “These are key standards for programs, and one that programs have struggled with, and we certainly have too.”

Proactive and Intentional Efforts
     Participants reported engaging social resources such as personal connections and networks to recruit diverse students. As one participant described, “Recruiting diverse students begins with personal networks. So, we use personal networks, professional networks, alumni network.” In addition to recruiting through alumni and professional organizations and conferences, participants found success through partnerships with community agencies as well as building relationships with HBCUs and HSIs. One participant captured the process this way: “It’s about maintaining relationships with graduates, with colleagues. We know, for us to diversify our student body, we cannot just look to the surrounding states to produce a diverse student body. We have to go beyond that.”

In addition to reaching out to master’s programs with sizable diverse student populations, one common strategic effort involved finding financial support for diverse doctoral students, from departmental, institutional, or external funding sources. One participant stated, “We also know in our program where the sources for funding underrepresented populations are; we know how to hook people into those sources of funding.” Another participant shared, “Our institutions have funding mechanisms, including some that are for historically marginalized populations or underrepresented populations. We have been successful in applying for those and getting those.”

Participants indicated a commitment to making changes to their typical mode of recruitment strategy and recognized that supporting diverse students required the implementation of strategies that differed from typical recruiting and retaining activities. Three subcategories that emerged as representing effective recruitment and support strategies were (a) connection to cultural identity, (b) providing personalized support, and (c) involvement of faculty.

Connection to Cultural Identity. Consistent with the literature, participants reported that students seemed drawn to programs that valued their cultural background and research interests associated with their identity. For example, participants reported that it was important to have faculty who are interested in promoting social justice and diversity and sharing similar research interests to their students. As one participant described: “The student picked us because we supported their research interest of racial battle fatigue.” This participant had shared with their prospective student that “I’m really excited about that [topic], and it overlaps with my own research in historical trauma with native populations.”

Personalized Support. Participants indicated personalized support was crucial to recruiting diverse students to their CES doctoral program. One participant reported that most of the diverse students who chose to attend their doctoral program typically shared the same response when asked about their choice: “Their comments are consistent. . . . They say, ‘We came and interviewed, and we met you, and we met the students, and we feel cared about.’”

Faculty Involvement. Third, faculty involvement was an essential component of proactive and intentional efforts. Faculty involvement seemed to take a variety of forms: (a) activities related to promoting multiculturalism and social justice, (b) engagement in diverse areas of the profession and representing the program well, and (c) advocating to connect potential students to external funding resources or professional opportunities. One participant explained faculty involvement this way: “An anchor person who strongly identifies not only with their own diversity, but also with a body of scholarship related to diversity.” Another participant shared, “Our faculty have had some nice engagements with organizations and research strands focused on multiculturalism and social justice issues.” These types of involvement made an impact on the impressions of prospective students from diverse backgrounds: “We have students who came to us and said, ‘I looked at the work your faculty were doing, I looked at what they said was important on the website, and it struck a chord with me.’”

Support and Retention Strategies
     The third major category of support and retention strategies was characterized as responding to awareness and understanding of diverse students’ perspectives, experiences, and needs while enrolled in the doctoral program. Participants reported that faculty engaged in proactive and intentional efforts that integrated considerations for cultural identity, personalized support, and faculty involvement.

Awareness and Understanding
As with recruitment, participants reported that successful retention and support of enrolled doctoral students integrated considerations for the students’ cultural identity as well as values, needs, and interests that are a part of that identity. One participant described exploring missing aspects of each student’s experience for the purpose of providing effective support: “It’s super important on a very regular basis to sit down with students of color specifically and talk with them about what they’re not getting . . . those conversations really are key.” Often, these personalized conversations are part of a healthy, intentional mentoring relationship in which students are purposely paired with faculty who can understand their experience, support them in navigating professional organizations, and foster success in the program and in their future career. Two participants added that an effective support strategy involves reaching out and engaging in regular conversations about student struggles and experience with microaggressions, tokenism, or other socioemotional matters.

Some participants reported that diverse students may be lacking in foundational skills and knowledge that put them at a disadvantage in the doctoral program, such as deficits in research competence. Personal conversations between mentors and protégés include being “willing to have difficult conversations about skill deficits” in a manner that encourages and empowers diverse students to succeed.

Proactive and Intentional Efforts
     Successful education of diverse doctoral students is a mission that requires thoughtful, intentional, and proactive efforts on the part of doctoral faculty. A participant whose program had a good track record in recruiting diverse students explained, “Proactive efforts take a lot of thought” and aiming for effective retention necessitates “an intentional effort, and that’s what it takes to provide comfort for a more diverse group of students.” For many participants in the study, showing intentionality started with provision of financial support in the form of scholarships, fellowships, and graduate assistantships. Doctoral faculty also advocated for students by connecting them to funding sources because financial support “is the best predictor of keeping people in the program.”

     Connection to Cultural Identity. Proactive and intentional efforts were considered to be a step beyond planning, in that doctoral faculty commit tangible and intangible resources along with taking actions toward promoting diversity in the program. In addition to inquiring about the missing aspects of their identity in the program, participants reported that ongoing conversations about cultural identity during the students’ program of study was important to support and retention. For example, some students chose a doctoral program to pursue a specific line of research connected with cultural identity and wanted their faculty members to make intentional efforts to help them further their line of inquiry related to cultural issues.

     Personalized Support. Participants reported that personalized support was a critical strategy in helping culturally diverse doctoral students to thrive in the program. Participants believed that supportive faculty–student relationships had a strong impact on retention. As articulated by one participant, “One of our strengths is the relationship that we have with our students . . . it may be making the difference in the students that we keep.” Participants also used a buddy system whereby each student applicant was paired with a current doctoral student as their go-to person for any questions or concerns, to help them transition into the program.

Faculty Involvement. Embracing diversity is a proactive and intentional business, which translated to participants purposefully and thoughtfully changing the way they interact with prospective and current students from diverse backgrounds. Participants reported that diverse students may need more availability and outreach from faculty. As one participant stated, “We try to be available to them when they’ve got concerns that they need to address. We’re always trying to reach out more and being more proactive.” This proactive responsiveness and intentional mentoring seemed particularly important with regard to helping diverse students with professional identity development. One participant reflected that “some students coming from diverse backgrounds are going to need to be socialized into the profession, to make them comfortable in that identity.” Elaborating further, this participant said that, “this requires a lot of very intentional mentoring” and included formal as well as informal activities. For example, they said, “Even having them come to conferences, to introduce them to people. Having meals with them. Modeling how you interact with colleagues. Making sure they go to luncheons . . . to dinners.”

Discussion

In this study, 15 counselor educator participants gave voice to strategies that doctoral programs use to recruit, retain, and support underrepresented doctoral students from diverse backgrounds and their perceptions of the level of success these programs have had with their implemented strategies. We examined these experiences and identified two overarching themes of awareness and understanding and proactive and intentional efforts in the way they approached the need to recruit and support diverse doctoral students.

During the process of data analysis, a substantive framework emerged to explain participant strategies that had led to success. Analysis of the participants’ narratives shed light on counselor educators’ awareness and understanding that being proactive and intentional in integrating approaches that connect to the student’s cultural identity, provide personalized support, and involve faculty appear to be successful strategies for recruiting, retaining, and supporting diverse students. These categories reflect a program’s commitment to and demonstration of diversity, with the necessity of intentional and active approaches indicated in literature (Evans & Cokley, 2008; Hipolito-Delgado et al., 2017; McCallum, 2016; Rogers & Molina, 2006). Commitment to diversity has been found to be a highly influential factor in applicants’ decisions to enter a doctoral program (Haizlip, 2012; Zeligman et al., 2015) and once enrolled, for students from URM backgrounds to feel a sense of inclusion, connection, and belonging (Henfield et al., 2013; Hollingsworth & Fassinger, 2002; Protivnak & Foss, 2009).

The literature has indicated that a program’s commitment and intentionality about increasing the diversity of both students and faculty has a direct impact on the number of applicants received by that program (Zeligman et al., 2015). Participant narratives from this study supported this strategy. Diverse students are drawn to programs that value their cultural background and the research interests that come with that identity. This might mean presence of diverse faculty and student body, being encouraged to express their uniqueness, and having faculty who share their research interests. The unique needs, values, and interests of diverse students require CES faculty to be mindful of providing personalized support during the recruitment process as well as during their enrollment in the program. These can be in the form of intentional mentoring, support in addressing possible skills deficits, having personalized conversations, and engaging in a buddy system. A third essential strategy is faculty involvement in multiculturalism and social justice issues, engagement in diverse areas of the profession, and advocating for students academically, professionally, and socioeconomically.

Implications for Counselor Education
     The findings from this study reveal the need for a change on the part of some CES doctoral programs in developing intentional and proactive efforts to recruit, support, and retain students from culturally diverse backgrounds. In this study, several participants noted that their doctoral program employed passive recruiting and retention strategies, which appeared to be inadequate and contrary to CACREP standards. Some participants also highlighted barriers to both recruiting and retaining diverse doctoral students, such as unclear standards and faculty attitudes and behaviors that include complacency, defensiveness and dismissiveness, lack of awareness, and assumptive thinking about diversity. Other CES departments seem to be partially implementing a comprehensive and systematic plan for recruiting and retaining diverse students. For example, they may utilize alumni networks to help with recruiting diverse students but lack a plan to support and retain enrolled students.

An important potential barrier for supporting diverse students in CES doctoral programs is the time required for faculty mentorship. Some participants in the study reported that some diverse students needed more close mentoring, and this time commitment would likely reduce available time for other faculty activities such as conducting research and writing for publication. For faculty on the tenure-track system in research institutions, losing time to research endeavors poses a potential threat to career advancement. One participant shared that while “by and large, most faculty want to mentor diverse students and put the time in,” this time commitment stood in opposition to their own tenure and promotion process. This participant elaborated that the pressure to “publish or perish” can “somewhat alter career trajectory for the faculty, if they spend too much time in mentoring.” This participant believed that this issue was “one of the real tensions here in academia” and explained that “either you want diversity, and you’re willing to reward people who are willing to invest themselves in the diversity . . . or you’re not. But you can’t have it both ways.” It appears that the current structure within universities, such as the criteria for tenure and promotion, can present a significant barrier to supporting diverse students. Prior authors have noted that established university and program culture can create a sense of marginalization for diverse students, making it difficult to both recruit and retain URM doctoral students (Holcomb-McCoy & Bradley, 2003; Zeligman et al., 2015). Faculty may need to advocate for structural changes within their universities to ensure that their students are adequately supported. Some participants in the study indicated that low teaching loads were another avenue of freeing up time for mentoring.

The CACREP standards (2015) contain a mandate for systematic and continuous efforts to retain a diversified student body in counselor education programs. Some participants noted in this study that the actual appraisal by CACREP site visit teams of how this standard was being met was unclear. Confusion about this standard may result in not having a strategy for ensuring that the standard was being met. Clarification and accountability are necessary to ensure that programs are meeting this standard.

It is crucial that counselor education programs continue to develop specific strategies to both recruit and retain underrepresented doctoral students. It is no longer acceptable to rest on the institutional name or location. Intentionality that addresses the needs of underrepresented students should include connection to students’ cultural identity, personalized support, and faculty involvement, as these will ensure that students feel wanted and valued throughout the entire process (recruitment to completion).

Limitations

Although grounded theory provides a richness and depth to understanding questions for research, it comes with potential limitations. Clarke (2005) discussed limitations typical in qualitative research and grounded theory. Researchers are faced with an overwhelming amount of information to code, categorize, and analyze. Qualitative researchers can quite easily get bogged down with the complexity and amount of data, which can lead to a diluting of results (Clarke, 2005). The research team addressed this challenge by engaging in a two-step coding process: engaging in group coding of the first three transcripts and then dyadic coding of the remaining transcripts. Through saturation, the research team was able to establish categories that captured the main themes and ideas of the participant statements and check their own biases and values as potentially impacting the interpretation of the codes.

The research team was composed of members who themselves are from diverse backgrounds and who had experiences as doctoral students in CES programs. In addition, all members of the research team currently work in counselor training programs and wrestle with the same questions under review—namely, how to recruit, support, and retain diverse students. The research team attempted to address limitations through developing a priori codes potentially rooted in their own experiences and through recording memos during each group and individual coding session to capture the presence of personal values, biases, or experiences, as well as checking other team members’ codes. Although it is impossible to fully account for all potential biases present in a qualitative analysis, these efforts of diligently checking experiences aimed to mitigate this impact on the overall results and conclusions of the study.

Although the coding team believed that data reached saturation at 15 interviews, the sample was small (N = 15) for the method of inquiry according to Creswell and Poth (2018). Although we believe that limiting the number of respondents to no more than one faculty member per program was helpful in reducing the potential for bias due to group effect, it is possible that the faculty members surveyed were not the sole representations of their counselor education program. As with many qualitative studies, generalizability to the larger population is limited. However, it is noteworthy that the demographics of the participants in the current study do align with typical cultural representation of counselor education programs (CACREP, 2018).

Future quantitative studies are needed to evaluate the size of the effect of these strategies on recruitment and retention rates of diverse students in CES doctoral programs. For example, future studies could evaluate the relationship between student perceptions of proactive and intentional efforts toward connecting with cultural identity, personalized support, and faculty involvement with actual retention rates of diverse students in CES programs and their overall student satisfaction. Such information would be helpful to decipher which of these factors has the greatest impact on recruiting, retaining, and supporting diverse students in CES doctoral programs, which would be useful information for current CES doctoral programs.

Conclusion

This study highlights that although more efforts to recruit and retain students from diverse backgrounds are needed, when counselor education programs are intentional and proactive, it has a meaningful impact. What seems to be effective in recruiting, retaining, and supporting diverse students is developing a connection to cultural identity, support that is personalized, and faculty involvement. When students from diverse backgrounds feel some connection to their specific cultural identity and receive personalized support, they are more likely to enter a program and persist. Finally, the involvement of faculty at all levels of the recruitment and retention process is monumental. Students from diverse backgrounds perceive counselor education programs as inviting and able to meet their cultural needs when programming is intentional and proactive.

 

Conflict of Interest and Funding Disclosure
The authors reported no conflict of interest
or funding contributions for the development
of this manuscript.

 

References

Baker, C. A., & Moore, J. L., III. (2015). Experiences of underrepresented doctoral students in counselor education. Journal for Multicultural Education, 9(2), 68–84. https://doi.org/10.1108/JME-11-2014-0036

Barker, M. J. (2016). The doctorate in black and white: Exploring the engagement of Black doctoral students in cross race advising relationships with White faculty. Western Journal of Black Studies, 40(2), 126–140.

Behl, M., Laux, J. M., Roseman, C. P., Tiamiyu, M., & Spann, S. (2017). Needs and acculturative stress of international students in CACREP programs. Counselor Education and Supervision, 56(4), 305–318.
https://doi.org/10.1002/ceas.12087

Blackwell, J. E. (1987). Mainstreaming outsiders: The production of Black professionals (2nd ed.). Rowman & Littlefield.

Blockett, R. A., Felder, P. P., Parrish, W., III, & Collier, J. N. (2016). Pathways to the professoriate: Exploring Black doctoral student socialization and the pipeline to the academic profession. The Western Journal of Black Studies, 40(2), 95–110.

Brown, E. M., & Grothaus, T. (2019). Experiences of cross-racial trust in mentoring relationships between Black doctoral counseling students and White counselor educators and supervisors. The Professional Counselor, 9(3), 211–225. https://doi.org/10.15241/emb.9.3.211

The Carnegie Classification of Institutions of Higher Education. (2019). Basic classification description. http://carn
egieclassifications.iu.edu/classification_descriptions/basic.php

Castellanos, J., Gloria, A. M., & Kamimura, M. (Eds.). (2006). The Latina/o pathways to the Ph.D.: Abriendo caminos. Stylus.

Chan, A. W., Yeh, C. J., & Krumboltz, J. D. (2015). Mentoring ethnic minority counseling and clinical psychology students: A multicultural, ecological, and relational model. Journal of Counseling Psychology, 62(4), 592–607. https://doi.org/10.1037/cou0000079

Charmaz, K. (2014). Constructing grounded theory (2nd ed.). SAGE.

Chen, S. Y., Basma, D., Ju, J., & Ng, K.-M. (2020). Opportunities and challenges of multicultural and international online education. The Professional Counselor, 10(1), 120–132. https://doi.org/10.15241/syc.10.1.120

Clarke, A. E. (2005). Situational analysis: Grounded theory after the postmodern turn. SAGE.

Corbin, J., & Strauss, A. (2015). Basics of qualitative research: Techniques and procedures for developing grounded theory (4th ed.). SAGE.

Council for Accreditation of Counseling and Related Educational Programs. (2014). CACREP vital statistics 2013: Results from a national survey of accredited programs. http://www.cacrep.org/wp-content/uploads/20
19/05/2013-CACREP-Vital-Statistics-Report.pdf

Council for Accreditation of Counseling and Related Educational Programs. (2015). CACREP standards 2016. https://www.cacrep.org/for-programs/2016-cacrep-standards

Council for Accreditation of Counseling and Related Educational Programs. (2016). CACREP vital statistics 2015: Results from a national survey of accredited programs. http://www.cacrep.org/wp-content/uploads/20
19/05/2015-CACREP-Vital-Statistics-Report.pdf

Council for Accreditation of Counseling and Related Educational Programs. (2018). CACREP vital statistics 2017: Results from a national survey of accredited programs. http://www.cacrep.org/wp-content/uploads/20
19/05/2017-CACREP-Vital-Statistics-Report.pdf

Council for Accreditation of Counseling and Related Educational Programs. (2019). Annual report 2018. https://www.cacrep.org/wp-content/uploads/2019/05/CACREP-2018-Annual-Report.pdf

Creswell, J. W., Hanson, W. E., Plano, V. L. C., & Morales, A. (2007). Qualitative research designs: Selection and implementation. The Counseling Psychologist, 35(2), 236–264. https://doi.org/10.1177/0011000006287390

Creswell, J. W., & Poth, C. N. (2018). Qualitative inquiry and research design: Choosing among five approaches (4th ed.). SAGE.

Definitions, 20 U.S.C. 20 § 1067k (2020). November 2, 2019. https://uscode.house.gov/view.xhtml?req=granuleid
:USC-prelim-title20-section1067k&num=0&edition=prelim

Dieker, L., Wienke, W., Straub, C., & Finnegan, L. (2013). Reflections on recruiting, supporting, retaining, graduating, and obtaining employment for doctoral students from diverse backgrounds. Teacher Education and Special Education, 37(2), 147–160. https://doi.org/10.1177/0888406413505874

Evans, G. L., & Cokley, K. O. (2008). African American women and the academy: Using career mentoring to increase research productivity. Training and Education in Professional Psychology, 2(1), 50–57.
https://doi.org/10.1037/1931-3918.2.1.50

Foxx, S. P., Kennedy, S. D., Dameron, M. L., & Bryant, A. (2018). A phenomenological exploration of diversity in counselor education. Journal of Professional Counseling: Practice, Theory & Research, 45(1), 17–32.
https://doi.org/10.1080/15566382.2019.1569320

González, J. C. (2006). Academic socialization experiences of Latina doctoral students: A qualitative understanding of support systems that aid and challenges that hinder the process. Journal of Hispanic Higher Education, 5(4), 347–365. https://doi.org/10.1177/1538192706291141

Goodman, R. D., Williams, J. M., Chung, R. C.-Y., Talleyrand, R. M., Douglass, A. M., McMahon, H. G., & Bemak, F. (2015). Decolonizing traditional pedagogies and practices in counseling and psychology education: A move towards social justice and action. In R. D. Goodman & P. C. Gorski (Eds.), Decolonizing “multicultural” counseling through social justice (pp. 147–164). Springer.

Grapin, S. L., Bocanegra, J. O., Green, T. D., Lee, E. T., & Jaafar, D. (2016). Increasing diversity in school psychology: Uniting the efforts of institutions, faculty, students, and practitioners. Contemporary School Psychology, 20(4), 345–355. https://doi.org/10.1007/s40688-016-0092-z

Guillory, R. M. (2009). American Indian/Alaska Native college student retention strategies. Journal of Developmental Education, 33(2), 14–16, 18, 20, 22–23, 40. https://files.eric.ed.gov/fulltext/EJ897631.pdf

Haizlip, B. N. (2012). Addressing the underrepresentation of African-Americans in counseling and psychology programs. College Student Journal, 46(1), 214–222.

Henfield, M. S., Owens, D., & Witherspoon, S. (2011). African American students in counselor education programs: Perceptions of their experiences. Counselor Education and Supervision, 50(4), 226–242.
https://doi.org/10.1002/j.1556-6978.2011.tb00121.x

Henfield, M. S., Woo, H., & Washington, A. (2013). A phenomenological investigation of African American counselor education students’ challenging experiences. Counselor Education and Supervision, 52(2), 122–136. https://doi.org/10.1002/j.1556-6978.2013.00033.x

Hinojosa, T. J., & Carney, J. V. (2016). Mexican American women pursuing counselor education doctorates: A narrative inquiry. Counselor Education and Supervision, 55(3), 198–215. https://doi.org/10.1002/ceas.12045

Hipolito-Delgado, C. P., Estrada, D., & Garcia, M. (2017). Counselor education in technicolor: Recruiting graduate students of color. Interamerican Journal of Psychology, 51(1), 73–85.
https://doi.org/10.30849/RIP/IJP.V51I1.293

Holcomb-McCoy, C., & Bradley, C. (2003). Recruitment and retention of ethnic minority counselor educators: An exploratory study of CACREP-accredited counseling programs. Counselor Education and Supervision, 42(3), 231–243. https://doi.org/10.1002/j.1556-6978.2003.tb01814.x

Hollingsworth, M. A., & Fassinger, R. E. (2002). The role of faculty mentors in the research training of counseling psychology doctoral students. Journal of Counseling Psychology, 49(3), 324–330.
https://doi.org/10.1037/0022-0167.49.3.324

Interiano, C. G., & Lim, J. H. (2018). A “chameleonic” identity: Foreign-born doctoral students in U.S. counselor education. International Journal for the Advancement of Counselling, 40, 310–325.
https://doi.org/10.1007/s10447-018-9328-0

Lerma, E., Zamarripa, M. X., Oliver, M., & Vela, J. C. (2015). Making our way through: Voices of Hispanic counselor educators. Counselor Education and Supervision, 54(3), 162–175. https://doi.org/10.1002/ceas.12011

Lewis, C. W., Ginsberg, R., Davies, T., & Smith, K. (2004). The experiences of African American Ph.D. students at a predominately White Carnegie I-research institution. College Student Journal, 38(2), 231–245.

Lincoln, Y. S., & Guba, E. G. (2013). The constructivist credo. Left Coast Press, Inc.

Luedke, C. L., Collom, G. D., McCoy, D. L., Lee-Johnson, J., & Winkle-Wagner, R. (2019). Connecting identity with research: Socializing students of color towards seeing themselves as scholars. The Review of Higher Education, 42(4), 1527–1547. https://doi.org/10.1353/rhe.2019.0074

Marsella, A. J., & Pedersen, P. (2004). Internationalizing the counseling psychology curriculum: Toward new values, competencies, and directions. Counselling Psychology Quarterly, 17(4), 413–423.
https://doi.org/10.1080/09515070412331331246

McCallum, C. M. (2015). Turning graduate school aspirations into enrollment: How student affairs professionals can help African American students. New York Journal of Student Affairs, 15(1), 1–18. https://journals.canisius.edu/index.php/CSPANY/article/view/448/717

McCallum, C. M. (2016). “Mom made me do it”: The role of family in African Americans’ decisions to enroll in doctoral education. Journal of Diversity in Higher Education, 9(1), 50–63. https://doi.org/10.1037/a0039158

Merriam, S. B., & Tisdell, E. J. (2016). Qualitative research: A guide to design and implementation (4th ed.). Wiley.

Ng, K.-M. (2006). Counselor educators’ perceptions of and experiences with international students. International Journal for the Advancement of Counseling, 28(1), 1–19. https://doi.org/10.1007/s10447-005-8492-1

Ng, K.-M., & Smith, S. D. (2009). Perceptions and experiences of international trainees in counseling and related programs. International Journal for the Advancement of Counselling, 31, 57–70.
https://doi.org/10.1007/s10447-008-9068-7

Patton, M. Q. (2014). Qualitative research and evaluation methods: Integrating theory and practice (4th ed.). SAGE.

Ponjuan, L. (2011). Recruiting and retaining Latino faculty members: The missing piece to Latino student success. Thought & Action, 99–110. https://vtechworks.lib.vt.edu/bitstream/handle/10919/84034/Recruit
ingLatinoFacultyMembers.pdf?sequence=1&isAllowed=y

Ponterotto, J. G. (2005). Qualitative research in counseling psychology: A primer on research paradigms and philosophy of science. Journal of Counseling Psychology, 52(2), 126–136. https://doi.org/10.1037/0022-0167.52.2.126

Preston, J., Trepal, T., Morgan, A., Jacques, J., Smith, J., & Field, T. (2020). Components of a high-quality doctoral program in counselor education and supervision. The Professional Counselor, 10(4), 453–471. https://doi.org/10.15241/jp.10.4.453

Proctor, S. L., & Romano, M. (2016). School psychology recruitment research characteristics and

implications for increasing racial and ethnic diversity. School Psychology Quarterly, 31(3), 311–326. https://doi.org/10.1037/spq0000154

Protivnak, J. J., & Foss, L. L. (2009). An exploration of themes that influence the counselor education doctoral student experience. Counselor Education and Supervision, 48(4), 239–256.
https://doi.org/10.1002/j.1556-6978.2009.tb00078.x

Rogers, M. R., & Molina, L. E. (2006). Exemplary efforts in psychology to recruit and retain graduate students of color. American Psychologist, 61(2), 143–156. https://doi.org/10.1037/0003-066X.61.2.143

Strauss, A., & Corbin, J. (1998). Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.). SAGE.

Woo, H., Jang, Y. J., & Henfield, M. (2015). International doctoral students in counselor education: Coping strategies in supervision training. Journal of Multicultural Counseling and Development, 43(4), 288–304. https://doi.org/10.1002/jmcd.12022

Zeligman, M., Prescod, D. J., & Greene, J. H. (2015). Journey toward becoming a counselor education doctoral student: Perspectives of women of color. The Journal of Negro Education, 84(1), 66–79.
https://doi.org/10.7709/jnegroeducation.84.1.0066

 

The authors present this article in memory of Dr. Rose Merrell-James, who shared her knowledge, experience, strength, and wisdom with all of us through this scholarly work.

Jennie Ju, PhD, LPC, is an assistant professor at Palo Alto University. Rose Merrell-James was an assistant professor at Shippensburg University. J. Kelly Coker, PhD, MBA, NCC, BC-TMH, LCMHC, is a professor and program director at Palo Alto University. Michelle Ghoston, PhD, ACS, LPC(VA), LCMHC, is an assistant professor at Wake Forest University. Javier F. Casado Pérez, PhD, NCC, LPC, CCTP, is an assistant professor at Portland State University. Thomas A. Field, PhD, NCC, CCMHC, ACS, LPC, LMHC, is an assistant professor at the Boston University School of Medicine. Correspondence may be addressed to Jennie Ju, 1791 Arastradero Road, Palo Alto, CA 94304, jju@paloaltou.edu.

 

Appendix A

Interview Protocol

For context, please briefly describe how you self-identify and your background. This information will be aggregated; individual participant responses will not be associated with any quotes in subsequent manuscripts.
Gender:
Sexual/Affective Orientation:
Race and Ethnicity:
Years as a Faculty Member in a Counselor Education Program:
Years as a Faculty Member in a Doctoral Counselor Education Program:
                  Number of Doctoral Counselor Education Programs You Have Worked In:
Regions of Doctoral Counselor Education Programs You’ve Worked In (using regions
commonly defined by national counselor education associations and organizations):

How might you define a “high-quality” doctoral program?

What do you believe to be the most important components? The least important?

How have you helped students to successfully navigate the dissertation process?

Which strategies has your program used to recruit underrepresented students from diverse
backgrounds? How successful were those?

Which strategies has your program used to support and retain underrepresented students from diverse
backgrounds? How successful were those?

What guidance might you provide to faculty who want to start a new doctoral program in counseling
with regards to working with administrators and gaining buy-in?

What guidance might you provide to faculty who want to sustain an existing doctoral program in
counseling with regards to working with administrators and gaining ongoing support?

Last question. What other pieces of information would you like to share about running a successful,
high-quality doctoral program?

Training Counselors to Work With the Families of Incarcerated Persons: A National Survey

Jessica Burkholder, David Burkholder, Stephanie Hall, Victoria Porter

The national epidemic of increasing imprisonment rates in the United States, also known as mass incarceration, disproportionally impacts communities of color. Additionally, the needs of children of incarcerated parents have been neglected. This study examined whether topics pertinent to mass incarceration and the impact on families are being addressed in counselor education programs. Of the 95 counselor educators who participated in the study, results indicated that the majority did not have training to work with families of the incarcerated and did not include information about working with families of the incarcerated in their courses. In addition to exposing students to discussions of implicit bias and data on mass incarceration, specific treatment modalities and protocols need to be developed and validated.

Keywords: mass incarceration, children, counselor education, communities of color, incarcerated parents

The rise of mass incarceration is dramatically affecting families and communities across the nation, with a disproportional impact on communities of color (Glaze & Maruschak, 2008; Graham & Harris, 2013; A. Lopez & Burt, 2013; C. Lopez & Bhat, 2007; Mignon & Ransford, 2012; Western & Smith, 2018). With the increase of persons involved in the criminal justice and legal systems, their families have been found to be more at risk for facing long-lasting life challenges within both the family system and society (Glaze & Maruschak, 2008; Luther, 2016; Mignon & Ransford, 2012; Phillips & Gates, 2011). Client advocacy is one of the most critical roles of the professional counselor (Hipolito-Delgado et al., 2016). The counseling profession is characterized by working with diverse individuals from heterogeneous communities. Counselors are needed to function as advocates, especially when families and communities are facing a sociocultural crisis (American Counseling Association [ACA], 2014; Hipolito-Delgado et al., 2016).

Both ACA and the Council for Accreditation of Counseling and Related Education Programs (CACREP) have identified advocacy, multicultural competence, and social justice as priorities in training and practice (ACA, 2014; CACREP, 2015). The ACA Code of Ethics instructs that “when appropriate, counselors advocate at individual, group, institution, and societal levels to address potential barriers and obstacles that inhibit access and/or the growth and development of clients” (ACA, 2014, Section A.7.a., p. 5). It also directs counselors to gain “knowledge, personal awareness, sensitivity, dispositions, and skills pertinent to being a culturally competent counselor in working with a diverse client population” (ACA, 2014, Section C.2.a., p. 8).

Counselor educators are directed to “infuse material related to multiculturalism/diversity into all courses and workshops” (ACA, 2014, Section F.7.c., p. 14). When describing professional and ethical practice, the CACREP standards require programs to instruct students on “the advocacy processes needed to address institutional and society barriers that impede access, equity, and success for clients” (CACREP, 2015, Standard F.1.e., p. 10). Further, the curriculum guidelines for social and cultural diversity emphasize counselor advocacy when instructing counselor educators to cover “strategies for identifying and eliminating barriers, prejudices and processes of intentional and unintentional oppression and discrimination” (CACREP, 2015, Standard F.2.h., p. 11). Although mass incarceration and its effects are not specifically mentioned in the ACA Code of Ethics or CACREP standards, these broad directives provide support for the specific argument that the scope of this crisis and its impact on families require attention in counselor training. Consequently, the purpose of this research study is to describe the current state of how counselor educators are providing training to counselor trainees to support families of the incarcerated.

The Rise of Mass Incarceration
The national epidemic of increasing imprisonment rates, commonly referred to as mass incarceration, has been a topic of alarm for nearly five decades (Garland, 2001; Glaze & Maruschak, 2008; Graham & Harris, 2013; A. Lopez & Burt, 2013; C. Lopez & Bhat, 2007; National Research Council [NRC], 2014; Sykes & Pettit, 2014). Although the United States accounts for 4.4% of the world’s population, nearly one quarter (22%) of the world’s prisoners are in the United States (American Psychological Association [APA], 2014; NRC, 2014). According to The Sentencing Project (2012), the United States continues to have the highest incarceration rate in the world, consistently increasing since the mid-1970s. The most recent statistics indicate that the United States has an incarcerated population of 2.2 million individuals (APA, 2014; Kaeble & Cowhig, 2018; NRC, 2014). This represents a 500% increase over the last 40 years (The Sentencing Project, 2012). More than 20% of those released return to incarceration within one year (Durose et al., 2014; Western & Smith, 2018). Researchers have found a correlation between imprisonment and individuals belonging to underserved (e.g., lower levels of education, low income, psychiatric treatment and substance abuse histories) and minority populations (Alexander, 2012; Cnaan et al., 2008; NRC, 2014).

Despite the race gap narrowing since 2007, Blacks are imprisoned at a rate 6 times that of Whites and at double the rate for Hispanics (Bronson & Carson, 2019). Because incarceration disproportionately affects minority group members, families of the incarcerated are more likely to be concentrated in minority communities (Graham & Harris, 2013). Consequently, even those children in the community whose parents are not facing incarceration are likely to be impacted by mass incarceration (Wakefield & Wildeman, 2011), as their communities may experience lower incomes, lopsided gender ratios, disrupted social integration and roles, high levels of joblessness, and increased crime (Crutchfield & Weeks, 2015).

An Invisible Group
Results from the National Survey of Children’s Health (U.S. Department of Health and Human Services, 2018) found that more than 7% or 5 million children in the United States have experienced a parent being incarcerated. Gathering current statistics is difficult for researchers. The majority of data on children of incarcerated parents has measured the number of parents in prison, leaving unknown data about the number of parents spending time in jail (Cramer et al., 2017). Because of this, there is reason to believe that the current number of children of incarcerated parents exceeds previous findings of 2.7 million children.

Children of incarcerated parents have frequently been described as an invisible group (Bernstein, 2005; Bouchet, 2008) that bears the collateral consequences of mass incarceration. There are many reasons for the invisibility. Although the children have not committed any crimes, their parent’s incarceration impacts much of what is important to them—family bonds, housing stability, safety, self-image, and social relationships. The criminal justice system does little to support family relationships and there is frequently poor communication between social service organizations and families that may be beneficial for the children (Bernstein, 2005). Those caring for the children often experience high levels of stress (Poehlmann et al., 2010), and families fear stigmatization and may keep secrets or refrain from disclosing an incarceration (Phillips & Gates, 2011).

When a parent is incarcerated, one of the first losses is physical separation between parent and child. Most parents report no physical contact with their children following incarceration (Bocknek et al., 2009). Visitation with parents has been found to be beneficial to the attachment relationship and the child’s overall well-being (Poehlmann et al., 2010) but is often infrequent and not child friendly. Visits can be costly, and relationships may be strained with the child’s caregiver. Children frequently have to travel long distances, endure long wait times, and meet with parents in environments that can feel intimidating and stressful. Mignon and Ransford (2012) found that almost half of the mothers they surveyed never had a visit from their children, and visits became less frequent for those with longer sentences. Yet prisons that implemented child-friendly visitation interventions and allowed for physical interaction demonstrated greater visitation benefits to those children (Poehlmann et al., 2010). Some benefits included improved maternal perceptions of the relationship and improved self-esteem in the children.

This loss associated with the physical separation of parent and child has been discussed in the literature and is commonly referred to as ambiguous loss because children experience the loss without closure. The ambiguity of their parent’s abrupt removal can disrupt children of incarcerated parents from finding meaning in the loss and disrupt the development of coping strategies (Bocknek et al., 2009). Children also experience stigmatization associated with ambiguous loss. In contrast to children who are separated from their caregivers by death, deployment, or divorce, it is often not socially acceptable for children of incarcerated parents to grieve the loss of parents because such parents are viewed as criminals (Phillips & Gates, 2011).

Children of incarcerated parents experience the loss of both fathers and mothers, and there are substantially more fathers in prison than mothers. But since the late 1970s, the growth rate for women in prison is more than double the growth rate for men (Sawyer, 2018). When mothers are incarcerated, the disruptions the child experiences are magnified, as children are more likely to lose their home and their primary support. Children with incarcerated mothers have been found to experience more stress and more risks than those with incarcerated fathers (Poehlmann et al., 2010). Maternal incarceration is often more closely associated with factors such as poverty, substance abuse, and mental health issues (Turney & Goodsell, 2018).

Experiencing the incarceration of a parent has been found to impact the long-term well-being of children (Turney & Goodsell, 2018). Children of incarcerated parents have increased risk for health issues, stigmatization, poverty, negative social interactions, behavior problems, school truancy and failure, and substance abuse (Poehlmann et al., 2010; Turney & Goodsell, 2018). Turney (2018) found that children with incarcerated parents are more than 5 times more likely to face adverse childhood experiences than those without an incarcerated parent. Often these children were already at risk, and the incarceration compounds these inequities. It is important to note that the research on children of incarcerated parents is fraught with selection bias and focus on negative outcomes. Very little research exists that examines protective factors and environments beyond urban, lower-income communities of color. Graham and Harris (2013) cautioned that this narrow research focus can decrease potential positive outcomes. A review of the current literature on children of incarcerated parents revealed that this narrow research trend continues.

Stigmatization and Families of the Incarcerated
Many experts consider stigmatization to be one of the most significant negative consequences of parental incarceration. Families are not stigmatized based on a specific trait they possess, but rather based on being associated with the incarcerated person (Phillips & Gates, 2011). This phenomenon is known as courtesy stigma and results in a spoiled identity for family members (Luther, 2016). The stigmatization may come from other family members, peers, teachers, social service agencies, and mental health providers. Children may be seen as “guilty by association” or perceived as being “deviant” like the parent that is incarcerated (Luther, 2016, p. 1265). In order to avoid stigmatization, families often keep the incarceration a secret, but children tend to fare better when they know the truth. Stigmatization can increase feelings of shame and impact the child’s willingness to reunite with parents (Harris et al., 2010). Foster and Hagan (2015) found parental incarceration leads to social exclusion for children into their 30s, and as a result can contribute to intergenerational socioeconomic inequality.

Purpose of the Research
The longstanding need for increased support in communities impacted by mass incarceration is clear (Harris et al., 2010). Increased awareness of the United States’ imprisonment crisis has prompted research initiatives to better understand community needs. Recent data on adverse childhood experiences suggested that children with incarcerated parents are even more vulnerable than previously thought (Turney, 2018). The developmental needs of families and children of the incarcerated are not being appropriately attended to in the literature (Holmes et al., 2010; Turney, 2018). Although research is clear that children of incarcerated parents and the family system face disequilibrium when parental incarceration occurs (Harris et. al., 2010; Luther, 2016; Phillips & Gates, 2011; Wachter Morris & Barrio Minton, 2012), 58% of new professional counselors reported having either minimal training or no training at all in individual or family-level trauma and crisis preparation (Wachter Morris & Barrio Minton, 2012). Brown and Barrio Minton (2018) found that school counselors wanted more training and resources to work with children of incarcerated parents and their families. This lack of training created barriers and ethical dilemmas in attempting to support children with incarcerated parents. Brown and Barrio Minton recommended counselors learn about families of the incarcerated through reading and participating in professional development opportunities, but the curricular experience of professional counselors working with populations affected by incarceration appears predominantly absent from the literature.

The incongruence between the urgency of mass incarceration affecting communities and the lack of literature exploring how to support families of the incarcerated demands further research. Two key research questions organized our exploration: (1) Are topics pertinent to mass incarceration and its impact on families being addressed in the classroom? (2) If so, how are these topics being included?

Method

Participants
The sample included full-time counseling professors in CACREP-accredited counseling programs in the United States. The researchers compiled an email list of 356 CACREP liaisons from the list of accredited programs on the CACREP website. Upon receiving IRB approval, CACREP liaisons were contacted and asked to forward the email invitation to full-time faculty in their departments. The request for participants was also posted to the Counselor Education and Supervision Network Listserv. The email served as an invitation to participate, contained a synopsis of the purpose of this research, and included an online Survey Monkey link. Informed consent was collected using an electronic consent form. Demographic information was gathered after consent had been obtained.

Ninety-five counselor educators began and completed the survey. Sixty-nine female and 26 male individuals participated, ranging in age from 29 to 78 years. A majority of the participants identified as White or of European descent (n = 61, 64%); 18 (19%) identified as African American/Afro-Caribbean or of African descent; five (5%) identified as Hispanic/Latinx, five (5%) identified as Asian/Polynesian or of Pacific Island descent, and five (5%) identified as multiracial. One person (1%) did not identify a race or ethnicity.

Of the participants, 20 (21%) were full professors, 22 (23%) were associate professors, 43 (45%) were assistant professors, nine (10%) were non–tenure track full-time instructors, and one (1%) was a clinical coordinator. Sixty-five (68%) came from master’s-only programs, and 30 (32%) came from combined master’s and doctoral programs. All CACREP regions were represented with 33 (35%) from the Southern region, 27 (28%) from the North Atlantic region, 21 (22%) from the North Central region, nine (10%) from the Western region, and five (5%) from the Rocky Mountain region.

Survey
The researchers created a brief survey that could lead to a description of the current state of counselor training on issues of mass incarceration and families of the incarcerated. Using broad survey research was necessary because there is currently nothing on this topic in the counseling literature. Eight questions were included in the survey: 1) Do you include the topic of mass incarceration in any of your courses? 2) If yes, what courses? 3) If yes, how do you cover this topic? 4) Do you include working with families of incarcerated persons in any of your courses? 5) If yes, what courses? 6) If yes, how do you cover this topic? 7) Have you received any training on these topics? and 8) If yes, describe.

Results

When asked whether they included the topic of mass incarceration in their courses, only 35 (36.8%) of the counselor educators surveyed answered yes. The most frequently noted course was Multicultural Counseling, under many different titles such as “Social and Cultural Diversity Issues in Counseling” or “Cultural Diversity.” Other courses noted were Foundations of Clinical Mental Health, Career Counseling, Addictions, Diagnosis, Trauma, Practicum, and Internship. Only one participant responded, “every class I teach.” When surveyed whether they included working with families of the incarcerated in their courses, 27 (28.4%) of the counselor educators answered yes. This too was most frequently covered in a multicultural counseling course but also was included in school counseling, child and adolescent counseling, and crisis counseling courses.

Using an open-ended question, participants were asked to describe how they covered the topics. The vast majority of the responses were “discussion.” These discussions were prompted by topics or readings on issues such as “systematic oppression,” “the intersection of race and social class,” “mandated clients,” and “vicarious trauma.” Two participants described developing a special topics course on incarceration and one participant invited a guest speaker related to families of the incarcerated.

When counselor educators were asked whether they had received training on these topics, only 30 (31.58%) reported that they had. But, when the participants described the training that they had received, it is notable that 19 (63.3%) of those reporting training described experiences with incarcerated persons, not specifically the families. Seven (23.3%) of those who responded had attended conference presentations on the topics of incarceration and families of the incarcerated. Two participants (6.7%) had completed research on incarcerated persons. Only one counselor educator (3.3%) described an extended training experience specific to families of the incarcerated. Finally, one (3.3%) participant described the topics being integrated into their doctoral program that was combined with rehabilitation counseling.

Discussion

The purpose of this research was for counselor educators to articulate whether topics relevant to mass incarceration and the effect on families were addressed in their classrooms, and if so, how they were addressed. Because no similar research has been reported, this study was singular in seeking to investigate how or if counseling faculty prepare their students to work with families affected by incarceration. This study did not aim to produce generalizations that apply beyond the research sample.

Nevertheless, it is essential to compare what was discovered in this study with what is documented in the literature. This study found that the majority of counselor educators were not covering mass incarceration or families of the incarcerated in their coursework, nor had they received training to do so. The findings of this study also provide the beginnings of a blueprint for what counseling programs and faculty can do to prepare students to work with children and families affected by incarceration.

For this study, comparing our findings with a body of literature is difficult because such literature does not exist, excepting the study by Wachter Morris and Barrio Minton (2012). Wachter Morris and Barrio Minton reported that 57.51% of professional counselors reported having minimal to no training in working with individual or family-level trauma and crisis preparation. Although Wachter Morris and Barrio Minton’s research did not target families of the incarcerated, this population does fall under the umbrella of individual and family trauma. Like that study, the present study demonstrated that a majority of counseling students are likely not receiving intentional, purposeful training on working with the trauma associated with incarceration. Although close to 30% of our participants did include mass incarceration and families of the incarcerated in their courses, the majority of how the topics were addressed was based on whether it arose out of discussion of broader multicultural topics. It also is reasonable to conclude that because a counseling literature search focused on training students to work with children of incarcerated parents only resulted in one webinar (Brown, 2016), a large majority of professional counselors are not adequately prepared to work with this population.

The findings of the present study may generate discussion of future recommendations and directions that counselor educators and supervisors may explore and implement. The majority of faculty in this research were not trained in the topics of mass incarceration and counseling children and families of the incarcerated, and unsurprisingly the majority did not include any training for their students. As with any topic under the umbrella of multiculturalism, counseling faculty should incorporate mass incarceration and working with children of incarcerated parents when addressing implicit bias with students (Boysen, 2010). In light of the massive numbers impacted by mass incarceration, we recommend this topic be included as required content in counselor education training. One way to ensure its inclusion would be to include persons who are incarcerated and their families in accreditation standards. At a minimum, the topic should be included in textbooks and used in case examples throughout training programs.

Counselor educators should highlight the stigma and spoiled identity that children of incarcerated parents experience and describe stigma management techniques (Luther, 2016) counselors can teach when working with these children. In addition to exposing students to data on mass incarceration and discussions of implicit bias (e.g., Alexander, 2012; Kaeble & Cowhig, 2018; Phillips & Gates, 2011), specific treatment modalities and protocols need to be developed and validated that fulfill the education and ethical expectations (ACA, 2014; CACREP, 2015) to address systemic barriers, advocacy, and cultural competence (Hipolito-Delgado et al., 2016).

Continuing education trainings could provide an opportunity for counseling associations and programs to address important content that may not receive adequate or consistent attention in required coursework. Counseling associations could choose conference themes that would encourage training and research on the needs of families of the incarcerated. Counseling programs could consider continuing education trainings as a method of communicating the program’s values and priorities, such as attention to social justice. Additional benefits may include strengthening their reputation, improving retention, maintaining relationships with alumni, and building relationships with the local clinical community.

Limitations and Future Research
The researchers recognize that the small, purposive, and heterogenous sample limits generalizability of the findings. Additionally, issues with data that rely on self-report have been well documented (Coughlin et al., 2009). Although these limitations make the present study narrow in scope and generalizability, these limitations are features of the positivist tradition aimed at finding “facts” and “truth.” This nascent study sought to establish a beginning understanding of how counselor educators are addressing mass incarceration in the classroom.

There are many directions for future research. It would be valuable to use qualitative research methods to learn from counselor educators who are effectively integrating and instructing on families of the incarcerated to provide a template for pedagogical inclusion. Research focusing on counseling students can serve to further the understanding of curricular experiences with mass incarceration and children of incarcerated parents. Research with practicing counselors can provide insight into the current landscape in the profession, including how families and children of incarcerated parents are affected and how professionals address these concerns. In that vein, outcome research with these children would be useful, as would the development of an instrument that can identify key clinical treatment areas.

Conclusion
Mass incarceration is a national crisis impacting more than 5 million U.S. children and their families (U.S. Department of Health and Human Services, 2018). This study was an attempt to provide a foundational understanding of the preparedness of counseling faculty and how they train students on this issue. The magnitude of the crisis, alongside the absence of counselor training, should cause counselors to consider our responsibility to ensure adequate counselor preparation in this area. By doing so and providing recommendations for programs to consider, it is hoped that more research will be undertaken to further underscore the importance of the topic and illuminate new understandings.

Conflict of Interest and Funding Disclosure
The authors reported no conflict of interest
or funding contributions for the development
of this manuscript.

References

Alexander, M. (2012). The new Jim Crow: Mass incarceration in the age of colorblindness. The New Press.
American Counseling Association. (2014). ACA code of ethics.
American Psychological Association. (2014). Incarceration nation. Monitor on Psychology, 45(9), 56. https://www.apa.org/monitor/2014/10/incarceration
Bernstein, N. (2005). All alone in the world: Children of the incarcerated. The New Press.
Bocknek, E. L., Sanderson, J., & Britner, P. A., IV. (2009). Ambiguous loss and posttraumatic stress in school-age children of prisoners. Journal of Child and Family Studies, 18(3), 323–333.
https://doi.org/10.1007/s10826-008-9233-y
Bouchet, S. M. (2008). Children and families with incarcerated parents: Exploring development in the field and opportunities for growth. The Annie E. Casey Foundation. https://www.aecf.org/resources/children-and-families-with-incarcerated-parents
Boysen, G. A. (2010). Integrating implicit bias into counselor education. Counselor Education and Supervision, 49(4), 210–227. https://doi.org/10.1002/j.1556-6978.2010.tb00099.x
Bronson, J., & Carson, E. A. (2019). Prisoners in 2017. Report prepared for U.S. Department of Justice. Office of Justice Programs. Bureau of Justice Statistics. https://www.bjs.gov/content/pub/pdf/p17.pdf
Brown, E. C. (2016). Help children of incarcerated parents [Webinar]. American School Counselor Association. https://videos.schoolcounselor.org/help-children-of-incarcerated-parents
Brown, E. C., & Barrio Minton, C. A. (2018). Serving children of incarcerated parents. Professional School Counseling, 21(1), 1–11. https://doi.org/10.1177/2156759X18778811
Cnaan, R. A., Draine, J., Frazier, B., & Sinha, J. W. (2008). Ex-prisoners’ re-entry: An emerging frontier and a social work challenge. Journal of Policy Practice, 7(2–3), 178–198.
https://doi.org/10.1080/15588740801938035
Coughlin, M., Cronin, P., & Ryan, F. (2009). Survey research: Process and limitations. International Journal of Therapy and Rehabilitation, 16(1), 9–15. https://doi.org/10.12968/ijtr.2009.16.1.37935
Council for Accreditation of Counseling and Related Educational Programs. (2015). 2016 CACREP standards. http://www.cacrep.org/wp-content/uploads/2018/03/2016-Standards-with-Glossary-3.2018.pdf
Cramer, L., Goff, M., Peterson, B., & Sandstrom, H. (2017). Parent-child visiting practices in prisons and jails: A synthesis of research and practice. Urban Institute. https://www.urban.org/sites/
default/files/publication/89601/parent-child_visiting_practices_in_prisons_and_jails.pdf
Crutchfield, R. D., & Weeks, G. A. (2015). The effects of mass incarceration on communities of color. Issues in Science and Technology, 32(1), 109–119.
Durose, M. R., Cooper, A. D., & Snyder, H. N. (2014). Recidivism of prisoners released in 30 states in 2005: Patterns from 2005 to 2010. Bureau of Justice Statistics Special Report (NCJ 244205), 1–30. https://www.bjs.gov/content/pub/pdf/rprts05p0510.pdf
Foster, H., & Hagan, J. (2015). Maternal and paternal imprisonment and children’s social exclusion in young adulthood. Journal of Criminal Law and Criminology, 105(2), 387–429.
Garland, D. (2001). Introduction: The meaning of mass imprisonment. Punishment & Society, 3(1), 5–7.
https://doi.org/10.1177/14624740122228203
Glaze, L. E., & Maruschak, L. M. (2008). Parents in prison and their minor children. Bureau of Justice Statistics Special Report (NCJ 222984), 1–25. https://www.bjs.gov/content/pub/pdf/pptmc.pdf
Graham, J. A., & Harris, Y. R. (2013). Children of color and parental incarceration: Implications for research, theory, and practice. Journal of Multicultural Counseling and Development, 41(2), 66–81. https://doi.org/10.1002/j.2161-1912.2013.00028.x
Harris, Y. R., Harris, V. A., Graham, J. A., & Oliver Carpenter, G. J. (2010). The challenges of family reunification. In Y. R. Harris, J. A. Graham, & G. J. Oliver Carpenter (Eds.), Children of incarcerated parents: Theoretical, developmental, and clinical issues (pp. 255–275). Springer.
Hipolito-Delgado, C. P., Pharaoh, T., & Hermosillo, J. (2016). Empathy and advocacy: Successfully serving communities of color. The Journal of Humanistic Counseling, 55(1), 37–54.
https://doi.org/10.1002/johc.12023
Holmes, T. R., Belmonte, K., Wentworth, M., & Tillman, K. (2010). Parents “in the system”: An ecological systems approach to the development of children with incarcerated parents. In Y. R. Harris., J. A. Graham, & G. J. Oliver Carpenter (Eds.), Children of incarcerated parents: Theoretical, developmental, and clinical issues (pp. 21–43). Springer.
Kaeble, D., & Cowhig, M. (2018). Correctional populations in the United States, 2016. Bureau of Justice Statistics Special Report (NCJ 251211), 1–13. https://www.bjs.gov/content/pub/pdf/cpus16.pdf
Lopez, A., & Burt, I. (2013). Counseling groups: A creative strategy increasing children of incarcerated parents’ sociorelational interactions. Journal of Creativity in Mental Health, 8(4), 395–415.
https://doi.org/10.1080/15401383.2013.844660
Lopez, C., & Bhat, C. S. (2007). Supporting students with incarcerated parents in schools: A group intervention. The Journal for Specialists in Group Work, 32(2), 139–153. https://doi.org/10.1080/01933920701227125
Luther, K. (2016). Stigma management among children of incarcerated parents. Deviant Behavior, 37(11), 1264–1275. https://doi.org/10.1080/01639625.2016.1170551
Mignon, S. I., & Ransford, P. (2012). Mothers in prison: Maintaining connections with children. Social Work in Public Health, 27(1–2), 69–88. https://doi.org/10.1080/19371918.2012.630965
National Research Council. (2014). The growth of incarceration in the United States: Exploring causes and consequences. The National Academies Press. https://doi.org/10.17226/18613
Phillips, S. D., & Gates, T. (2011). A conceptual framework for understanding the stigmatization of children of incarcerated parents. Journal of Child and Family Studies, 20(3), 286–294.
https://doi.org/10.1007/s10826-010-9391-6
Poehlmann, J., Dallaire, D., Loper, A. B., & Shear, L. D. (2010). Children’s contact with their incarcerated parents: Research findings and recommendations. American Psychologist, 65(6), 575–598.
Sawyer, W. (2018). The gender divide: Tracking women’s state prison growth. https://www.prisonpolicy.org/reports/women_overtime.html
The Sentencing Project. (2009). Incarcerated parents and their children: Trends 1991–2007. https://www.sentencingproject.org/wp-content/uploads/2016/01/Incarcerated-Parents-and-Their-Children-Trends-1991-2007.pdf
The Sentencing Project. (2012). Criminal Justice Facts https://www.sentencingproject.org/criminal-justice-facts
Sykes, B. L., & Pettit, B. (2014). Mass incarceration, family complexity, and the reproduction of childhood disadvantage. The ANNALS of the American Academy of Political and Social Science, 654(1), 127–149. https://doi.org/10.1177/0002716214526345
Turney, K. (2018). Adverse childhood experiences among children of incarcerated parents. Children and Youth Services Review, 89, 218–225. https://doi.org/10.1016/j.childyouth.2018.04.033
Turney, K., & Goodsell, R. (2018). Parental incarceration and children’s wellbeing. The Future of Children, 28(1), 147–164.
U.S. Department of Health and Human Services, Health Resources and Services Administration’s Maternal and Child Health Bureau. (2018). National Survey of Children’s Health (2016–present). https://www.childhealthdata.org/browse/survey
Wachter Morris, C. A., & Barrio Minton, C. A. (2012). Crisis in the curriculum? New counselors’ crisis preparation, experiences, and self-efficacy. Counselor Education and Supervision, 51(4), 256–269. https://doi.org/10.1002/j.1556-6978.2012.00019.x
Wakefield, S., & Wildeman, C. (2011). Mass imprisonment and racial disparities in childhood behavioral problems. Criminology & Public Policy, 10(3), 793–817.
https://doi.org/10.1111/j.1745-9133.2011.00740.x
Western, B., & Smith, N. (2018). Formerly incarcerated parents and their children. Demography, 55(3), 823–847. https://doi.org/10.1007/s13524-018-0677-4

Jessica Burkholder, PhD, NCC, ACS, LPC, is an associate professor at Monmouth University. David Burkholder, PhD, ACS, LPC, is an associate professor and department chair at Monmouth University. Stephanie Hall, PhD, NCC, ACS, LPC, is an associate professor and founding department chair at Emory & Henry College. Victoria Porter is a master’s student at Monmouth University. Correspondence may be addressed to Jessica Burkholder, 400 Cedar Ave, West Long Branch, NJ 07764, jburkhol@monmouth.edu.

Assessment of Dispositions in Program Admissions: The Professional Disposition Competence Assessment—Revised Admission (PDCA-RA)

Curtis Garner, Brenda Freeman, Roger Stewart, Ken Coll

 

Tools to assess the dispositions of counselor education applicants at the point of program admission are important as mechanisms to screen entrance into the profession. The authors developed the Professional Disposition Competence Assessment—Revised Admission (PDCA-RA) as a screening tool for dispositional assessment in admissions interviews. In this study, 70 participants engaged in a video-based training protocol designed to increase the interrater reliability of the PDCA-RA. An intraclass correlations coefficient was calculated as an index of interrater reliability. Cronbach’s alpha coefficients were calculated for internal consistency, and Fleiss’ kappa, free-marginal kappa, and percent of agreement were calculated for absolute agreement. Calculations were made for pretest and posttest scores. Results of the study suggest that the PDCA-RA demonstrates “good” reliability in terms of interrater reliability and “excellent” reliability in terms of internal consistency. The video-based training improved interrater reliability.

Keywords: dispositions, counselor education, interrater reliability, counseling admissions, PDCA-RA

 

Beyond ethical codes and standardized education requirements, one criterion understood to be a demarcation of a profession is that it controls entry into its occupation (Miller, 2006). The stature of any profession is heavily influenced by the collective quality, preparation, and professional fit of those who are allowed to enter the profession. In the profession of counseling, counselor preparation programs, practicing counselors, field site supervisors, and state licensure boards share the overarching charge to screen for the profession (Freeman et al., 2016), but counselor educators alone bear the responsibility of initial screening of potential new entrants into the profession. The funnel of individuals seeking entrance into the profession begins with admission to graduate programs. This responsibility is a solemn one because post-admission gatekeeping can lead to high-stakes legal disputes (Dugger & Francis, 2014; Hutchens et al., 2013; McAdams et al., 2007).

Similar to other graduate programs, criteria for entrance into counselor preparation programs generally incorporate academic and career factors, but unlike many other graduate programs, the dispositions (traits and characteristics) of applicants are also critical factors for identifying appropriate candidates for the profession (Hernández et al., 2010). The use of admissions interviews is a common method for observing dispositions (Swank & Smith-Adcock, 2014). Characteristics such as interpersonal skills, warmth, emotional stability, and self-awareness are examples of traits deemed important to many counseling academic programs (Crawford & Gilroy, 2013; McCaughan & Hill, 2015), though counselor educators lack agreement about which dispositions should be screened at admission (Bryant et al., 2013).

Once applicants have been accepted into a counselor education program, if problematic dispositional issues arise the American Counseling Association (ACA) ethical codes require remediation (ACA, 2014), which is sometimes followed by suspension or dismissal. Therefore, gatekeeping, defined as the process of deterring program graduation of those lacking sufficient knowledge or skills (Koerin & Miller, 1995), begins at the point of program screening and admission (Kerl & Eichler, 2005). Bryant et al. (2013) emphasized that effective screening of applicants prior to formal admission into the academic program may greatly reduce the need to address problematic student behaviors after admission.

In addition to conducting admissions screening as a form of gatekeeping, the courts are more likely to support universities in admissions-related legal disputes if screening policies, standards for admission, and admission procedures are clear and fair (Cole, 1991). Legal research also underscores the importance of programs communicating clearly with students about the expected dispositions and other criteria from admission through exit (McCaughan & Hill, 2015). Reliable admissions tools designed to assess dispositions represent one method of showing fidelity in implementing policies (Hutchens et al., 2013). Despite the research support for sound structures to scaffold the admissions process, assessments with published psychometric properties measuring dispositions in admissions interviews are scarce (Hernández et al., 2010).

Jonsson and Svingby (2007) noted that a number of forms of reliability and validity are important in establishing the psychometric properties of admissions tools, but when multiple raters are involved, such as in the admissions process, interrater reliability for rubrics is particularly essential. Specific training in the tool is critical to improving interrater reliability (Jonsson & Svingby, 2007). Video training protocols to increase interrater reliability are becoming more important in professional dispositional research (Kopenhaver Haidet et al., 2009; Rosen et al., 2008). The use of video technology to train raters to capture behavioral observations has two advantages: the opportunity for admissions personnel to practice admissions interview ratings prior to real-time observations, and the relative ease of using modern, sophisticated recording equipment (Kopenhaver Haidet et al., 2009).

Admissions Processes and Criteria
     Overwhelmingly, admission criteria and procedures for counselor education programs have focused upon undergraduate grade point average (GPA); standardized test scores, such as the Graduate Record Examination (GRE) or the Miller Analogies Test (MAT); a personal interview; and some form of personal statement (Bryant et al., 2013). Such procedures have been shown to be reasonably predictive of academic success, but less so for counselor development (Smaby et al., 2005). Some programs have utilized Carkhuff’s Rating Scale (Carkhuff, 1969) or Truax’s Relationship Questionnaire (Truax & Carkhuff, 1967) to measure applicants’ ability to communicate the conditions of empathy, genuineness, and respect effectively (Hernández et al., 2010; Swank & Smith-Adcock, 2014). Carkhuff’s Rating Scale and Truax’s Relationship Questionnaire have been found to exhibit good interrater reliability and, when correlated with one another, have been found to exhibit considerable overlap (Engram & Vandergoot, 1978).

Dispositional Assessment
Following the gatekeeping dispute in Ward v. Wilbanks (2010), in which a graduate student in counselor education refused to work with a gay client, and the ensuing litigation upon that student’s dismissal from their program, the need for a reliable method for evaluating counseling student dispositions has become increasingly apparent. This high-profile legal case also highlighted the need to monitor and document student dispositions (Dugger & Francis, 2014; McAdams et al., 2007). Correspondingly, in 2009 the Council for Accreditation of Counseling and Related Educational Programs (CACREP) released standards that made monitoring student dispositions a mandatory aspect of program evaluation. In the 2016 CACREP standards the expectation for the assessment of counselor-in-training dispositions was expanded to include the monitoring of dispositions at multiple points over the duration of time students are enrolled in a counselor education program. The accreditation expectations for screening at the point of admission are found in Section I.L., where the standards delineate the expectation that counseling programs consider dispositions (CACREP, 2015). Dispositions for consideration include relationship skills and cultural sensitivity.

As the need for dispositional appraisal has become increasingly imperative in the counselor education profession, there have been various efforts to design specific approaches to assess student dispositions (Frame & Stevens-Smith, 1995; Kerl et al., 2002; Lumadue & Duffey, 1999; McAdams et al., 2007; Redekop & Wlazelek, 2012; Williams et al., 2014). One early approach was the utilization of standardized personality tests (Demos & Zuwaylif, 1966; Utley Buensuceso, 2008). However, the use of personality tests fell into disfavor because of the potential for conflicts with the Americans with Disabilities Act (U.S. Department of Justice, 2010) as well as for their inherent deficit orientation. Consequently, the use of standardized tests has been generally replaced by rating scales and rubrics (Panadero & Jonsson, 2013).

One reason that rubrics were considered superior to rating scales was their transparency (Panadero & Jonsson, 2013). Transparency empowers students by equipping them with an understanding of expectations for performance prior to their creating a product or performing a skill. Rubrics also have greater potential to align with learning outcomes and they provide useful direct feedback to students (Alexander & Praeger, 2009; Panadero & Jonsson, 2013).

Examples of dispositional assessments for counselors include the Counselor Characteristics Inventory (Pope, 1996), an inventory that assesses personality characteristics of effective counselors. Also, Spurgeon et al. (2012) described a process that includes a Likert-style assessment of dispositional traits. In addition, Swank et al. (2012) developed the Counseling Competencies Scale (CCS), a tool for measuring counselor competence. Frame and Stevens-Smith (1995) developed a 5-point Personal Characteristics Evaluation Form, and finally, Lumadue and Duffey (1999) published a Professional Performance Fitness Evaluation to evaluate specific behaviors of pre-professional counselors. Few studies of the reliability and validity of the tools were found in published research, especially related to admissions. However, some do have limited published psychometric research and in some cases norms (Flynn & Hays, 2015; Pope, 1996; Swank et al., 2012; Taub et al., 2011).

One example of a dispositional tool for counselor education with published psychometrics is the Counselor Personality Assessment (CPA) developed by Halinski (2010). The CPA is a 28-item scale reporting a Cronbach’s alpha reliability score of .82. Another tool, the CCS (Swank et al. 2012), is a 32-item rubric for measuring counseling skills, professional conduct, and professional dispositions in practicum. Cronbach’s alpha for the CCS was reported at .93, and interrater reliability was reported at .57. Criterion validity was established by correlating the CCS score with the semester grade and was reported as moderate. The available psychometric data for the CPA and CCS represent exceptions. In general, lack of psychometric information may result in limited confidence in available assessment tools for appraising counselor student dispositions.

Interrater Reliability
     Interrater reliability, essentially the extent to which the raters assign the same scores when observing the same behaviors (McHugh, 2012), is critical for fairness to applicants in counseling admissions interviews. Gwet (2014) stated, “If the inter-rater reliability is high, then raters can be used interchangeably without the researcher having to worry about the categorization being affected by a significant rater factor. Interchangeability of raters is what justifies the importance of inter-rater reliability” (p. 4). Consistency ensures that the data collected are realistic for practical use. When interrater reliability is poor, interviews conducted by overly critical raters (hawks) naturally lead to negative bias against applicants when compared within the same applicant pool with the scores from interviews rated by less critical raters (doves). Epstein and Synhorst (2008) discussed interrater reliability as an approximation in which different people rate the same behavior in the same way. Thus, interrater reliability can also be understood as rater consensus.

Purpose of the Present Study
     Effectively screening and selecting new entrants is one of the hallmarks that distinguishes a profession. Unfortunately, there is a dearth of available literature on assessment tools for rating admissions interviews. Further, lack of information on the reliability of the tools that exist represents a significant deficiency in professional literature (Johnson & Campbell, 2002). The Professional Disposition Competence Assessment—Revised Admission (PDCA-RA; Freeman & Garner, 2017; Garner et al., 2016) is a global rubric designed to assess applicant dispositions in brief graduate program interviews. The PDCA-RA includes a video training protocol developed to facilitate consistency across raters in scoring admissions interviews on dispositional domains.

The purpose of the study was to examine the internal stability and the interrater reliability of the PDCA-RA. The rationale for the study was that no similar rubrics assessing dispositions at admissions using training videos were found in published research, suggesting a gap in the literature. Interrater reliability was the key focus of this study because of the importance of interrater reliability for rubrics utilized in situations with multiple raters, a typical scenario for counselor education admissions processes.

Method 

Sample
     Raters for the study included 70 counselor educators, counseling doctoral students, adjunct faculty, and site supervisors. Counselor educators, doctoral students, and adjunct faculty at two universities were asked to participate in trainings on the new admissions screening tool. Site supervisors providing supervision for practicum and internship students at the two universities were offered training in the PDCA-RA as a component of continued professional development to maintain their supervision status. Training in both instances was free and included professional development credits. Informed consent for participation was obtained from all participants in accordance with ACA ethical codes (ACA, 2014) and IRB oversight at both universities. All participants in the study fully completed the PDCA-RA video-based training. The mean age of the raters was 43.9 (SD = 11.4, range 24–72). Sixty-four percent identified as female and 36% identified as male. Mean average years of experience indicated as a faculty or field supervisor was 12.2 (SD = 9.7, range 1–50). Ninety-three percent identified as White/Caucasian, 6% as Latino/a, and 1% as other ethnicity.

The counselor educators (27% of the sample) were primarily from two CACREP-accredited counseling programs in the Western United States. Participating universities included one private university and a state research university, both with CACREP-accredited programs. Counselor education doctoral students and adjunct faculty participants comprised 7% of the sample. The doctoral students participated in the training because they were involved as raters of master’s-level counselor education applicants in the admissions process at one institution. The remaining 66% of the participants were field site supervisors. Because field site supervisors were involved in gatekeeping, attending training in dispositional assessment was natural to their role as internship site supervisors. 

Measure: PDCA-RA
     The PDCA-RA was developed on the basis of the Professional Disposition Competence Assessment (PDCA; Garner et al., 2016). The PDCA, a dispositional gatekeeping tool, was revised to the Professional Disposition Competence Assessment-Revised (PDCA-R) after several rounds of use and with feedback from expert panels (Freeman & Garner, 2017). Advice from legal counsel was also reflected in the revision of the PDCA to the PDCA-R. The PDCA-R was originally used for both gatekeeping and admissions purposes, but it was determined that the PDCA-R was best used for gatekeeping, not for admissions screening, because the tool implied that the rater had prior knowledge of the student. Because this is often not the case in admissions screening, the PDCA-RA was developed.

The PDCA, PDCA-R, and PDCA-RA were conceptualized and developed through a comprehensive review of the literature, several rounds of field testing, and adjustments from expert faculty panels at two institutions. In addition to counseling literature on impairment and expert panel feedback, the Five-Factor Model, often referred to as the “Big Five” (Costa & McCrae, 1992), influenced three of the nine dispositional items. The Five-Factor Model consists of five personality traits consistently associated with positive mental health, academic success, and healthy habits and attitudes across the life span: Extraversion, Agreeableness, Conscientiousness, Emotional Stability, and Openness. The PDCA-RA dispositions are identical to the PDCA-R, with the exception of the disposition of Ethics. Ethics was removed from the PDCA-RA because the description assumed knowledge of professional ethical standards, a doubtful expectation for program applicants with no prior training in counseling. The behavioral descriptions in the PDCA-RA were narrowed so they described only those behaviors that can be observed in admissions interviews with no prior knowledge of the applicants. In addition, the rubric item descriptions were shortened to align with the practical context of brief (20- to 30-minute) admissions interviews in which there may be limited time for in-depth assessment.

If dispositions are thought of as traits, as per the definition of dispositions in the CACREP glossary (CACREP, 2015), the PDCA-RA is not technically directly measuring dispositions. Based upon advice from legal counsel, as well as the practicality of assessing applicants during short admissions interviews, the PDCA-RA assessed behaviors associated with dispositions and not the actual dispositions. Behaviors identified for each disposition can be observed during a short admissions interview, whereas personality traits would require a more in-depth assessment approach, one that counselor educators fear might be found legally problematic (Freeman et al., 2019; Schuermann et al., 2018).

The nine dispositions assessed in terms of observable behaviors via the rubric are Conscientiousness, Coping and Self-Care, Openness, Cooperativeness, Moral Reasoning, Interpersonal Skills, Cultural Sensitivity, Self-Awareness, and Emotional Stability. Each disposition in the PDCA-RA is rated on a scale of three levels—developing, meets expectation, and above expectation. The PDCA-RA is described in more detail in a manual that includes the tools as well as three suggested admissions questions for each of the nine dispositions (Freeman & Garner, 2017). The measure of internal consistency for faculty ratings of the original PDCA rubric was a Cronbach’s alpha estimated at .94 (Garner et al., 2016). Cronbach’s alpha for self-ratings was .82, and Cronbach’s alpha for peer ratings was .89. The straightforward modifications from the original PDCA to the PDCA-RA were minimal and unlikely to significantly affect these measures of internal consistency.

Procedure
     A video-based training protocol was developed for the purpose of training faculty in counselor education programs, doctoral students, site supervisors, and other admissions raters to use the PDCA-RA to assess the dispositions of graduate program applicants (Freeman & Garner, 2017; Garner et al., 2016). The video was presented to participants by a trainer. The trainer also greeted participants, obtained informed consent, passed out PDCA-RA forms when prompted by the training video, and collected completed PDCA-RA forms for later analysis. Training in the use of the PDCA-RA was important not only as a mechanism to establish interrater reliability but also as a means of informing adjustments to the tool during its initial iterative development process. Development of the video-based training protocol progressed through several stages. At first, the original 90-minute training consisted of a faculty team of seven working together as a group to read and discuss each disposition, followed by each faculty viewing an admissions interview video and rating the applicant independently. Faculty then discussed their ratings, leading to subtle adjustments in the rubric item descriptions. Additional benefits to the training were an increase in faculty self-awareness of dove and hawk tendencies when rating admissions applicants and self-awareness associated with interview bias. With continued training and feedback, the original training protocol was significantly improved.

To complete the next step in the creation of the video-based training protocol, counseling student volunteers were offered a minimal incentive to come to the film studio, and after signing waivers to allow the film clips to be used, the student volunteers were asked to respond to various admissions interview questions. The faculty filming the students instructed them to “give a strong answer” or “give a weak answer.” The researchers treated all responses as unscripted role plays. The questions asked by the interviewer for each disposition were those found in the PDCA-RA materials (Freeman & Garner, 2017). Finally, the authors and developers of the training video reviewed over 100 film clips, removed those in which the acting interfered with the purpose of the video, and rated the remaining clips using the PDCA-RA, resulting in ratings of 1, 3, or 5. These numerical ratings corresponded to descriptive ratings of developing, meets expectation, and above expectation, respectively. Clips in which the researchers found the rating to be difficult were removed from consideration. In selecting the final 18 clips (two for each of nine dispositions), the researchers considered diversity in age, ethnicity, gender, and disability of the student volunteers. The goal was to create video clips of student volunteers with diverse characteristics.

The result was a video-based training protocol that could still be completed by trainees in 90 to 120 minutes. The video training protocol began with an introduction to the PDCA-RA, followed by prompts to rate the video-recorded vignettes using the PDCA-RA prior to receiving training. This initial rating of the vignettes was considered the pretest condition. Training on the application of the PDCA-RA to the vignettes was next. Training included revealing ideal scores as determined by the authors, the reasoning behind the scoring, and opportunities to discuss scoring among participants. Following the training on the PDCA-RA, participants were, once again, given the PDCA-RA rubric along with a new set of video-recorded vignettes. This was considered the posttest condition. Participants were asked to rate the new vignettes using the PDCA-RA.

The video-based training protocol, designed for use in small groups, allowed for group discussion of ratings after each participant completed the PDCA-RA independently. This was indicated by a written message on the video reading, “Pause video for discussion.” The training tape ended with a narrator discussion of how to use the PDCA-RA in actual admissions interviews, including comments on cultural sensitivity in admissions interviews.

The video-based training protocol was used as the means of training participants in dispositional assessment. The purpose of the trainings was to increase consistency of admissions raters in evaluating the admissions interviews of applicants to a master’s-level counselor education program. Typically, participants completed the video training in small groups consisting of approximately six to 10 people. In addition to viewing the training video, participants also took part in group discussion and established a consensus of opinion on group ratings of video clips. Coming to a consensus on ratings, which also included feedback on rubric items and video clips, was an important aspect of the training.

Statistical Analysis
     The PDCA-RA scores from the counselor education faculty, adjunct faculty, doctoral students, and site supervisors’ ratings of the vignettes before training were used as the pretest or baseline interrater reliability. The PDCA-RA scores after participants were trained in the tool were used as the posttest. The intraclass correlation coefficient (ICC) was calculated as a measure of interrater reliability. Interrater reliability correlations quantify rater subjectivity (Herman et al., 1992). The ICC was calculated for pretest and posttest scores. Cronbach’s alpha coefficients were calculated for internal consistency, and Fleiss’ kappa (κ) was calculated for absolute agreement. In addition, Fleiss’ free-marginal kappa (κfree) and percent overall agreement were calculated. Calculations were made for both the pretest and posttest ratings, and a t-test was conducted, using SPSS, to determine whether training improved interrater reliability.

Results

The ICC estimates and associated 95% confidence intervals were calculated using SPSS statistical package version 23 and based on an individual rating, absolute agreement, 2-way random-effects model. ICC single measures for absolute agreement were calculated for the pretest administration of the PDCA-RA at .53 (95% CI [0.333–0.807]). The ICC single measures for absolute agreement were calculated for the posttest administration of the PDCA-RA at .76 (95% CI [0.582–0.920]). Cronbach’s alpha was calculated at .99 for both pretest and posttest scores. Pretest and posttest ICCs were compared using a t-test with an a priori significance level set at .05. The test was significant (p < .05), suggesting that there was a difference between the pretest and posttest reliability, with reliability improving from the “moderate” range to the “good” range (Koo & Li, 2016) with training.

Using Excel, kappa (κ) was calculated as a measure of overall agreement for pretest and posttest scores. This particular kappa was extended by Fleiss (1971) and accommodates multiple raters like those rating the PDCA-RA. Assumptions underpinning Fleiss’ kappa include categorical data (i.e., nominal or ordinal) with mutually exclusive categories, symmetrical cross-tabulations, and independence of raters. Data in this study met all assumptions. Data was ordinal with three mutually exclusive response categories for each dispositional area assessed, which resulted in all cross-tabulations being symmetrical. Although raters were trained in a collaborative setting where discussions about ratings were fostered, when the actual ratings of study participants occurred, raters did not discuss their ratings with others and were thus independent of one another. Pretest scores for the nine rubric items reflected a κ of .33, fair agreement according to Landis and Koch (1977). After training, posttest scores on the nine items reflected a κ of .55, moderate agreement according to Landis and Koch.

As an additional analysis, percent overall agreement and κfree was calculated. κfree is appropriate when raters do not know how many cases should be distributed into each category. In addition, κfree is resistant to influence by prevalence and bias (Randolph, 2005). The percent of overall agreement is the measure of agreement between raters and historically has also been used to calculate interrater reliability (McHugh, 2012). Table 1 illustrates that the κfree for the pretest was .36 while the percent of overall agreement was 57.6%. The posttest for the κfree was .56 and the percent of overall agreement was 70.4%. After examining the change in pretest to posttest calculations from both the κfree and the percent of overall agreement, both offer additional support for and provide evidence that training improved the agreement of dispositional ratings on the PDCA-RA.

Table 1

Pre and Post Statistics: Percent Overall Agreement and Free-Marginal Fleiss’ Kappa

Time of Rating Percent Overall Agreement Free-Marginal Kappa 95% CI for Free- Marginal Kappa
Before Training: Pre 57.6 .36 [.23, .49]
After Training: Post 70.4 .56 [.31, .80]

 

The overall κ, κfree and percent of agreement results were promising, but a comparison of the percent of correct responses (the response intended by the research team) by disposition showed that the ratings of correct responses decreased by more than 2% from pre- to posttesting for three dispositions (Openness, Cooperativeness, and Moral Reasoning). Because this was an unexpected finding, the research team analyzed the ratings for incorrect responses and learned that the raters appeared to be better able to discern the difference between a rating of 1 (developing) and 3 (meets expectation) than between 3 and 5 (above expectation). As a post-hoc analysis, we calculated the percent of agreement with the correct score, collapsing the 3 and 5 ratings. The percent of correct responses with dichotomous categories of 1 and a collapsed category for 3 and 5 are shown in Table 2. As is evident in Table 2, using the collapsed category, the percent of correct responses for eight of the nine dispositions improved from pretest to posttest. The percent of correct responses for one disposition, Cooperativeness, decreased by more than 2% from pretest to posttest.

Table 2

Pre and Post Percent of Correct Responses by Disposition

Disposition Pre Percent
Overall Agreement
1, 3, 5
Ratings
Post Percent Overall Agreement

1, 3, 5
Ratings

Pre Percent
Overall Agreement
1, 3 & 5
Collapsed
Post Percent Overall Agreement

1, 3 & 5

Collapsed

1. Conscientiousness 62.0 97.1              77.1               98.6
2. Coping & Self-Care 59.9 94.4              22.9               97.1
3. Openness 51.0 49.4              94.3             100.0
4. Cooperativeness 47.3 39.0              94.3               87.1
5. Moral Reasoning 84.1 68.8              91.4               98.6
6. Interpersonal Skills 48.0 94.4              98.6               97.1
7. Cultural Sensitivity 69.3 94.4            100.0             100.0
8. Self-Awareness 40.7 40.0              54.3               64.3
9. Emotional Stability 56.3 56.5              67.1               95.7

 

Discussion

The results of the study suggest that the PDCA-RA has potential as a reliable instrument for assessing counseling applicants at the point of program admission. The PDCA-RA demonstrated strong reliability from the standpoint of internal consistency. The interrater reliability, as measured by the ICC, moved from the “moderate” to the “good” range with the application of the standardized training protocol.

The results of the study also provide evidence that counselor educators, supervisors, and doctoral students can improve their agreement on ratings of student dispositions with adequate and appropriate training. Multiple statistical techniques for measuring agreement, including the ICC, κ, κfree, and percent agreement measured under pre-training and post-training conditions demonstrated overall improvement in rater agreement with training. The observed post-training improvement in interrater reliability corroborates the literature, underscoring the necessity of training protocols as the pathway to improved interrater reliability (Jonsson & Svingby, 2007).

The results from the second analysis conducted through collapsing the meets expectation and above expectation categories suggest that the PDCA-RA has higher reliability as a tool to screen out inappropriate candidates than to distinguish excellence within the pool of acceptable candidates. For programs seeking to eliminate problematic applicants, the PDCA-RA could prove reliable. However, for academic programs with large numbers of applicants with an objective to accept a small group of students from a large group of acceptable candidates, the PDCA-RA may be less reliable from an interrater reliability perspective. The PDCA-RA item descriptions for above expectation need further consideration.

The percent of correct responses after training with collapsed categories was over 87% for seven of the nine dispositions. The results suggest that the PDCA-RA or the PDCA-RA training protocol needs revision on two dispositions, Cooperativeness and Self-Awareness. The decrease in correct responses to Cooperativeness may be due to a posttest interview with a higher level of difficulty than the pretest interview. The posttest percent was 87%, suggesting that overall the rubric descriptions functioned as acceptable with this sample of raters, though not excellent. The percent of correct ratings for Self-Awareness increased from pre- to posttesting, but only to 64% agreement. One explanation could be that the Self-Awareness rubric descriptions are behavioral (as recommended by legal counsel), yet Self-Awareness as a trait is difficult to describe in behavioral terms. This could leave raters confused about the difference between their intuitive sense of the self-awareness of the applicant and the narrow behavioral descriptions on the rubric. An alternative explanation is that there is a lack of agreement in the profession on the extent of self-awareness expected from students entering the academic program, leading some raters to find the applicant’s level of self-awareness acceptable, while others found the level unacceptable. In either case, the training protocol for the PDCA-RA and perhaps the rubric description need improvement. The 100% posttest agreement on the dichotomous categories for Openness and Cultural Awareness were encouraging, given the critical importance of these two dispositions (Freeman et al., 2019).

Interrater reliability is of paramount importance for the responsible use of rubrics. To improve the interrater reliability of the PDCA-RA, three issues may need to be addressed. First, the training protocol may need to be lengthened to encompass three rather than two opportunities to rate video clips. Second, structuring the discussion between raters with questions focusing attention on the gaps in ratings could be beneficial. Third, because alternate forms of the videos are being used in the training (different actors with different responses to the same question), a comparison of the complexity of the video clips should be conducted. It may be desirable to revise the training protocol to utilize less complex responses for Part 1 training, followed by equivalent complex interviews for Part 2 training, and more complex interview responses for Part 3. More complex responses, meaning the responses are partially descriptive of two categories on the rubric, are realistic to actual admissions interviews in the field.

In conducting trainings for the PDCA-RA, a potentially interesting observation was that raters appeared predisposed to using their own subjective experience to rate the video interviews instead of applying the item descriptions in the rubric. Often the trainers observed that the disposition title, such as Self-Awareness, triggered an automatic response of high rater confidence in their ability to rate self-awareness without carefully reading the rubric descriptions. The tendency of raters to believe they are “right” rather than applying a rubric description is a potential barrier for any dispositional measure.

Implications of the Study
     The implications of this study relate primarily to counselor education programs. As evident from the review of literature, careful admissions processes are critical to prevent or diminish the number of gatekeeping and remediation situations that occur in academic programs after admission. In addition to the importance of fair admissions procedures from a legal perspective, the effort required of applicants to engage in the application process justifies the importance of developing fair processes in which acceptance or denial decisions are not based solely upon the subjectivity of faculty.

For those academic programs utilizing admissions interviews, one important implication of the study is that the results suggest that without training, raters will have high variability in their ratings of admissions applicants, as illustrated by the variability of the pretest scores in this study. Structuring the rating of admissions interviews by using an assessment is one method of mitigating the variability of faculty ratings of applicants. A holistic (global) rubric such as the PDCA-RA is unlikely to ever garner the almost perfect interrater reliability associated with analytic rubrics, but the PDCA-RA is available as one practical, field-tested tool with promising reliability to help facilitate transparent and fair admissions interview rating processes.

Limitations and Future Research
     In light of the lack of an established list of professional dispositions, the PDCA-RA’s utility may be limited, as the selected dispositions may not align with the values of all counselor education programs. A second limiting factor is that the sample included both field site supervisors and faculty, and all participants were from the rural Western United States. The reliability of the tool is limited by the demographics of the sample. Another limitation was that the study’s pretest and posttest video clips, although similar, were different from one another. The initial decision to use different pretest and posttest video clips was based on an attempt to reduce the influence of testing as a threat to internal validity. However, this also introduced the possibility that either of the sets of video clips was inherently easier or more difficult to rate than the other. Further research would include randomly juxtaposing pretest and posttest video clips, or perhaps using the same video clips pre- and posttest to eliminate the possibility that differences in pretest and posttest video clips were responsible for the improvements in score reliability rather than the intended independent variable, the training. Another potential limitation to the results is that it is possible that some of the graduate students who were filmed in the vignettes may have been known by six of the faculty members from one of the institutions. The impact of this possibility was reduced by the use of multiple student actors, but prior knowledge of the student could have influenced raters’ scores.

A final issue for consideration is the decision to use site supervisors as raters for the research. Site supervisors more commonly utilize the PDCA-R rather than the PDCA-RA, the version specific to admissions screening. The PDCA-R is used by supervisors to monitor and to communicate with counselor educators and counseling program clinical personnel. Further, at least one of the counselor education programs utilizes site supervisors for the admissions process. The training protocol for both versions of the PDCA is the same, and with site supervisors routinely participating in the training, the decision was made to include site supervisors as raters. It is possible, however, that site supervisors may differ in their abilities to respond to the training protocol when compared to counselor educators, adjunct faculty, and doctoral students.

A possibility for future research is to measure the extent to which the improvement in reliability can be maintained over time. At this point, little is known about whether and how often educators and site supervisors would need training updates to function optimally as raters of student dispositions. Accordingly, rating reliability could be observed at intervals of 3 months, 6 months, or 1 year after training to monitor decay.

Future research is also needed to determine the extent to which the length of the training protocol influences interrater reliability. In addition, cultural and gender bias in the use of the PDCA-RA should be studied, as one criticism of rubrics is the potential for cultural bias.

As a tool for consistently rating counselor education program applicants, the PDCA-RA demonstrates potential, though more research needs to be conducted to increase the interrater reliability. Training improved the interrater reliability results but not to the extent that excellent interrater reliability was achieved. Adjusting the training protocol may be fruitful as a mechanism to improve interrater reliability.

Conclusion

There is a need for reliable admissions tools to assess dispositional behaviors of counseling program applicants. Interrater reliability is an important form of reliability in situations such as admissions interviews in which there are often multiple raters involved in the process. The importance of interrater reliability is founded in the critical premises of fairness and transparency to applicants, though legal protection of counselor education programs is also enhanced by using clear, standardized processes. Dispositional assessment is in its infancy, especially when applied to counselor education in general and to program admissions in particular. How exactly to define dispositions as well as how exactly the role of the counselor will serve as a means of selection and gatekeeping for the profession is yet to be determined. Yet counselor educators perceive both an ethical and professional responsibility for monitoring counseling student dispositions as a means for safeguarding the integrity of the profession (Freeman et al., 2019; Schuermann et al., 2018). The continued development of the PDCA-R and the PDCA-RA, as well as the associated training materials, represents initial steps toward standardizing and improving dispositional appraisal. The video-based training and the exploration of the training as a means of improving rater consistency will potentially increase the ability of counselor educators to consistently assess and monitor developing counseling students. Consistent dispositional ratings can also contribute to the development of a common language for discussing student progress. The current research represents a promising effort to continually improve the dispositions assessment process for counselor educators, counseling programs, and the counseling profession.

 

Conflict of Interest and Funding Disclosure
The authors reported no conflict of interest
or funding contributions for the development
of this manuscript.

 

References

Alexander, C. R., & Praeger, S. (2009, June). Smoke gets in your eyes: Using rubrics as a tool for building justice into assessment practices. Paper presented at the Annual Conference of the Australian Teacher Education Association (ATEA). Australian Teacher Education Association. http://files.eric.ed.gov/fulltext/ED524704.pdf

American Counseling Association. (2014). ACA code of ethics.

Bryant, J. K., Druyos, M., & Strabavy, D. (2013). Gatekeeping in counselor education programs: An examination of current trends. In Ideas and research you can use: VISTAS 2013. American Counseling Association. https://www.counseling.org/docs/default-source/vistas/gatekeeping-in-counselor-education-programs.pdf
?sfvrsn=7f6e77b5_13

Carkhuff, R. R. (1969). Critical variables in effective counselor training. Journal of Counseling Psychology, 16(3), 238–245. https://doi.org/10.1037/h0027223

Cole, B. S. (1991). Legal issues related to social work program admissions. Journal of Social Work Education, 27(1), 18–24. https://doi.org/10.1080/10437797.1991.10672165

Costa, P. T., Jr., & McCrae, R. R. (1992). NEO PI-R professional manual. Psychological Assessment Resources, Inc.

Council for Accreditation of Counseling and Related Educational Programs. (2009). CACREP 2009 standards. http://www.cacrep.org/wp-content/uploads/2017/07/2009-Standards.pdf

Council for Accreditation of Counseling and Related Educational Programs. (2015). CACREP 2016 standards. http://www.cacrep.org/forprograms/2016-cacrep-standards

Crawford, M., & Gilroy, P. (2013). Professional impairment and gatekeeping: A survey of master’s level training programs. The Journal of Counselor Preparation and Supervision, 5(1). https://doi.org/10.7729/51.0030

Demos, G. D., & Zuwaylif, F. H. (1966). Characteristics of effective counselors. Counselor Education and Supervision, 5(3), 163–165. https://doi.org/10.1002/j.1556-6978.1966.tb02062.x

Dugger, S. M., & Francis, P. C. (2014). Surviving a lawsuit against a counseling program: Lessons learned from Ward v. Wilbanks. Journal of Counseling & Development, 92(2), 135–141.
https://doi.org/10.1002/j.1556-6676.2014.00139.x

Engram, B. E., & Vandergoot, D. (1978). Correlation between the Truax and Carkhuff scales for measurement of empathy. Journal of Counseling Psychology, 25(4), 349–351. https://doi.org/10.1037/0022-0167.25.4.349

Epstein, M. H., & Synhorst, L. (2008). Preschool behavioral and emotional rating scale (PreBERS): Test–retest reliability and inter-rater reliability. Journal of Child and Family Studies17(6), 853–862.
https://doi.org/10.1007/s10826-008-9194-1

Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological Bulletin, 76(5), 378–382. https://doi.org/10.1037/h0031619

Flynn, S. V., & Hays, D. G. (2015). The development and validation of the Comprehensive Counseling Skills Rubric. Counseling Outcome Research and Evaluation, 6(2), 87–99. https://doi.org/10.1177/2150137815592216

Frame, M. W., & Stevens-Smith, P. (1995). Out of harm’s way: Enhancing monitoring and dismissal processes in counselor education programs. Counselor Education and Supervision, 35(2), 118–129.
https://doi.org/10.1002/j.1556-6978.1995.tb00216.x

Freeman, B. J., & Garner, C. M. (2017). Professional Dispositions Competency Assessment, Revised. Unpublished instrument, ScholarWorks.

Freeman, B. J., Garner, C. M., Fairgrieve, L. A., & Pitts, M. E. (2016). Gatekeeping in the field: Strategies and practices. Journal of Professional Counseling: Practice, Theory & Research, 43(2), 28–41.
https://doi.org/10.1080/15566382.2016.12033954

Freeman, B. J., Garner, C. M., Scherer, R., & Trachok, K. (2019). Discovering expert perspectives on dispositions and remediation: A qualitative study. Counselor Education and Supervision, 58(3), 209–224.
https://doi.org/10.1002/ceas.12151

Garner, C. M., Freeman, B. J., & Lee, L. (2016). Assessment of student dispositions: The development and psychometric properties of the professional disposition competence assessment (PDCA). In Ideas and research you can use: VISTAS 2016. American Counseling Association. https://www.counseling.org/knowledge-center/vistas/by-year2/vistas-2016/docs/default-source/vistas/article_5235f227f16116603abcacff0000bee5e7

Gwet, K. L. (2014). Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among raters (4th ed.). Advanced Analytics.

Halinski, K. H. (2010). Predicting beginning master’s level counselor effectiveness from personal characteristics and admissions data: An exploratory study [Doctoral dissertation, University of North Texas]. https://digital.library.unt.edu/ark:/67531/metadc11038

Herman, J. L., Aschbacher, P. R., & Winters, L. (1992). A practical guide to alternative assessment. Association for Supervision and Curriculum Development.

Hernández, T. J., Seem, S. R., & Shakoor, M. A. (2010). Counselor education admissions: A selection process that highlights candidate self-awareness and personal characteristics. Journal of Counselor Preparation and Supervision, 2(1), 74–87. https://doi.org/10.7729/21.2010

Hutchens, N., Block, J., & Young, M. (2013). Counselor educators’ gatekeeping responsibilities and students’ first amendment rights. Counselor Education and Supervision, 52(2), 82–95.
https://doi.org/10.1002/j.1556-6978.2013.00030.x

Johnson, W. B., & Campbell, C. D. (2002). Character and fitness requirements for professional psychologists: Are there any? Professional Psychology: Research and Practice, 33(1), 46–53. https://doi.org/10.1037/0735-7028.33.1.46

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. https://doi.org/10.1016/j.edurev.2007.05.002

Kerl, S., & Eichler, M. (2005). The loss of innocence: Emotional costs to serving as gatekeepers to the counseling profession. Journal of Creativity in Mental Health, 1(3–4), 71–88. https://doi.org/10.1300/J456v01n03_05

Kerl, S. B., Garcia, J. L., McCullough, C. S., & Maxwell, M. E. (2002). Systematic evaluation of professional performance: Legally supported procedure and process. Counselor Education and Supervision, 41(4), 321–334. https://doi.org/10.1002/j.1556-6978.2002.tb01294.x

Koerin, B., & Miller, J. (1995). Gatekeeping policies: Terminating students for nonacademic reasons. Journal of Social Work Education, 31(2), 247–260. https://doi.org/10.1080/10437797.1995.10672261

Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

Kopenhaver Haidet, K., Tate, J., Divirgilio Thomas, D., Kolanowski, A., & Happ, M. B. (2009). Methods to improve reliability of video-recorded behavioral data. Research in Nursing & Health, 32(4), 465–474. http://doi.org/10.1002/nur.20334

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310

Lumadue, C. A., & Duffey, T. H. (1999). The role of graduate programs as gatekeepers: A model for evaluating student counselor competence. Counselor Education and Supervision, 39(2), 101–109.
https://doi.org/10.1002/j.1556-6978.1999.tb01221.x

McAdams, C. R., III, Foster, V. A., & Ward, T. J. (2007). Remediation and dismissal policies in counselor education: Lessons learned from a challenge in federal court. Counselor Education and Supervision, 46(3), 212–229. https://doi.org/10.1002/j.1556-6978.2007.tb00026.x

McCaughan, A. M., & Hill, N. R. (2015). The gatekeeping imperative in counselor education admission protocols: The criticality of personal qualities. International Journal for the Advancement of Counseling, 37, 28–40. https://doi.org/10.1007/s10447-014-9223-2

McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282.
https://doi.org/10.11613/BM.2012.031

Miller, S. (2006). Professionalisation, ethics and integrity systems: The promotion of professional ethical standards, and the protection of clients and consumers. A report for the Professional Standards Councils, Centre for Applied Philosophy and Public Ethics, Australia.

Panadero, E., & Jonsson, A. (2013). The use of scoring rubrics for formative assessment purposes revisited: A review. Educational Research Review, 9, 129–144. https://doi.org/10.1016/j.edurev.2013.01.002

Pope, V. T. (1996). Stable personality characteristics of effective counselors: The Counselor Characteristic Inventory (Doctoral dissertation). Retrieved from ProQuest Dissertations & Theses Global (Order No. 9625345).

Randolph, J. J. (2005). Free-marginal multirater kappa (multirater κfree): An alternative to Fleiss’ fixed-marginal multirater kappa. Department of Computer Science, 1, 1–20. http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.59
.8776&rep=rep1&type=pdf

Redekop, F., & Wlazelek, B. (2012). Counselor dispositions: An added dimension for admission decisions. In Ideas and research you can use: VISTAS 2012. American Counseling Association. https://www.counseling.org/knowledge-center/vistas/by-year2/vistas-2012/docs/default-source/vistas/vistas_2012_article_17

Rosen, J., Mulsant, B. H., Marino, P., Groening, C., Young, R. C., & Fox, D. (2008). Web-based training and interrater reliability testing for scoring the Hamilton Depression Rating Scale. Psychiatry Research, 161(1), 126–130. https://doi.org/10.1016/j.psychres.2008.03.001

Schuermann, H., Avent Harris, J. R., & Lloyd-Hazlett, J. (2018). Academic role and perceptions of gatekeeping in counselor education. Counselor Education and Supervision, 57(1), 51–65. https://doi.org/10.1002/ceas.12093

Smaby, M. H., Maddux, C. D., Richmond, A. S., Lepkowski, W. J., & Packman, J. (2005). Academic admission requirements as predictors of counseling knowledge, personal development, and counseling skills. Counselor Education and Supervision, 45(1), 43–57. https://doi.org/10.1002/j.1556-6978.2005.tb00129.x

Spurgeon, S. L., Gibbons, M. M., & Cochran, J. L. (2012). Creating personal dispositions for a professional counseling program. Counseling and Values, 57(1), 96–108. https://doi.org/10.1002/j.2161-007X.2012.00011.x

Swank, J. M., Lambie, G. W., & Witta, E. L. (2012). An exploratory investigation of the counseling competencies scale: A measure of counseling skills, dispositions, and behaviors. Counselor Education and Supervision, 51(3), 189–206. https://doi.org/10.1002/j.1556-6978.2012.00014.x

Swank, J. M., & Smith-Adcock, S. (2014). Gatekeeping during admissions: A survey of counselor education programs. Counselor Education and Supervision, 53(1), 47–61. https://doi.org/10.1002/j.1556-6978.2014.00048.x

Taub, D. J., Servaty-Seib, H. L., Wachter Morris, C. A., Prieto-Welch, S. L., & Werden, D. (2011). Developing skills in providing outreach programs: Construction and use of the POSE (Performance of Outreach Skills Evaluation) rubric. Counseling Outcome Research and Evaluation, 2(1), 59–72. https://doi.org/10.1177/2150137811401019

Truax, C. B., & Carkhuff, R. (1967). Toward effective counseling and psychotherapy: Training and practice. Aldine.

U.S. Department of Justice, Civil Rights Division. (2010). Americans with Disabilities Act Title III Regulations: Part 36 Nondiscrimination on the Basis of Disability in Public Accommodations and Commercial Facilities (CRT Docket No. 106). https://www.ada.gov/regs2010/titleIII_2010/titleIII_2010_regulations.htm

Utley Buensuceso, J. M. (2008). The Sixteen Personality Factor Questionnaire and ratings of counselor effectiveness (Order No. 3341140) [Doctoral dissertation, Azusa Pacific University]. ProQuest Dissertations and Theses Global.

Ward v. Wilbanks. (2010). No. 09-CV-112 37, 2010 U.S. Dist. WL 3026428 (E.D. Michigan, July 26, 2010).

Williams, J. L., Williams, D. D., Kautzman-East, M., Stanley, A. L., Evans, W. J., & Miller, K. L. (2014). Assessing student dispositions in counselor training programs: Implications for supervision, program policy, and legal risk management [PowerPoint slides]. DocPlayer. https://docplayer.net/2862339-Assessing-student-dispositions-in-counselor-training-programs-implications-for-supervision-program-policy-and-legal-risk-management.html

 

Curtis Garner, EdD, NCC, NCSC, LCPC, is a professor and department chair at Gonzaga University. Brenda Freeman, PhD, is a professor at the University of Nevada, Reno. Roger Stewart, PhD, is a professor at Boise State University. Ken Coll, PhD, is the Dean of the School of Education at the University of Nevada, Reno. Correspondence may be addressed to Curtis Garner, 502 East Boone Ave., Spokane, WA 99258-0102, garnerc@gonzaga.edu.

Infusing Service Learning Into the Counselor Education Curriculum

Kristen Arla Langellier, Randall L. Astramovich, Elizabeth A. Doughty Horn

 

Counselors are frequently called upon to be advocates for their clients and, more broadly, to advocate for the counseling profession. However, many new counselors struggle with integrating advocacy work in their counseling practice. This article provides an overview of service learning and identifies ways counselor educators may foster advocacy skills among counselors-in-training through the use of planned service learning experiences in the counselor education curriculum. The authors then provide examples of service learning activities for use within the Council for Accreditation of Counseling and Related Educational Programs (CACREP) 2016 core curricular areas, including professional orientation and ethical practice, social and cultural diversity, career development, helping relationships, and group work. 

Keywords: advocacy, service learning, counselor education, ACA, CACREP

 

University faculty members frequently include service learning experiences in the undergraduate curriculum as a means for helping prepare students to develop as community members through meaningful civic engagement experiences that are augmented with classroom education (Servaty-Seib & Tedrick Parikh, 2014; Stanton & Wagner, 2006). Unfortunately, service learning assignments tend to diminish significantly as students make the transition from undergraduate to graduate education (Jett & Delgado-Romero, 2009; Servaty-Seib & Tedrick Parikh, 2014; Stanton & Wagner, 2006). Much of the existing scholarly literature centers around the impact of service learning on students who are at a traditional undergraduate age (Jett & Delgado-Romero, 2009; Servaty-Seib & Tedrick Parikh, 2014). The lack of service learning opportunities in the graduate curriculum is surprising, given that service learning may help students develop a deeper sense of community, appreciate others’ perspectives, and identify avenues for contributing to social change (Cipolle, 2010).

Within graduate counselor training programs, counselor educators could more frequently utilize service learning projects (SLPs) in order to enhance knowledge of diverse community cultures among counselors-in-training (CITs) as well as provide CITs with opportunities to assess community needs and implement advocacy efforts. The counseling profession’s Multicultural and Social Justice Counseling Competencies (MSJCC), revised in 2016, states the importance of “integrating social justice advocacy into the various modalities of counseling” (Ratts et al., 2016, p. 31). In addition, the MSJCC posits that counselors and counselor educators conceptualize clients through a socioecological lens so as to understand the social structures affecting their world. Service learning curricula often include a social justice focus, which has been demonstrated to help students understand the structures in place that oppress others (Tinkler et al., 2015). With these guidelines in mind, the purpose of this article is to provide practical suggestions to help counselor educators infuse service learning into their curriculum, thus offering CITs more opportunities for personal and professional development.

Service Learning

Service learning was first introduced in the early 1900s as a method for fostering academic and social learning and advancements for students via community involvement (Barbee et al., 2003). Bringle and Hatcher (1995) defined service learning as

a credit-bearing, educational experience in which students a) participate in an organized service activity that meets identified community needs, and b) reflect on the service activity in such a way as to gain further understanding of course content, a broader appreciation of the discipline, and an enhanced sense of civic responsibility. (p. 112)

Since its inception, many disciplines have found service learning useful as a method of merging the academic with the practical; it has become popular with disciplines such as nursing (Backer Condon et al., 2015), teacher education (Tinkler et al., 2015), and public health (Sabo et al., 2015).

With respect to counselor education, there has been a diminutive amount of research related to the implementation and effectiveness of service learning. In 2009, Jett and Delgado-Romero described service learning as an area of developing research in counselor education, and this could still be said today. There is a paucity of literature regarding service learning in graduate education (Servaty-Seib & Tedrick Parikh, 2014) and, more specifically, within counselor education. Yet university faculty, particularly counselor educators, are tasked with the challenge of bridging academic theory and research with “real-world” experiences. Therefore, SLPs may serve as a method for students and faculty to connect with the community in which they live and beyond (Nikels et al., 2007).

After reviewing service learning literature, Dotson-Blake et al. (2010) determined successful SLPs contain five essential characteristics that contribute to the overall intention of service learning. They contended successful SLPs should be developed in concert with a community or professional partner, contain coherent and well-defined expectations, incorporate stakeholder support, consider students’ developmental levels, allow ample opportunity for reflective practices, and broaden or expand because of the impact of the project (Dotson-Blake et al., 2010). Focusing on the above underpinnings of successful SLPs could potentially assist counselor educators in the planning and implementation stages of these sorts of projects, as they can take time and considerable effort to develop.

Service Learning and Social Justice

According to Cipolle (2010), social justice and service learning are interrelated. She asserted that service learning and social justice need to be considered together so as to accomplish a larger goal of connection with the community. An additional component to service learning is the development of critical consciousness. Students engaging in service learning as a means of social justice may gain compassion and understanding from their participation (Cipolle, 2010). A by-product of service learning with a social justice focus may be the development of self-awareness through students’ opportunities to see for themselves how others live their lives; perhaps students will also see the impact of the dominant culture (Cipolle, 2010). Self-awareness is a key component of the 2016 MSJCC (Ratts et al., 2016) and is found throughout the Council for Accreditation of Counseling and Related Educational Programs (CACREP) 2016 Standards (CACREP, 2015). Additionally, the ACA Code of Ethics asserts that counselors should ascribe to self-awareness to maintain ethical practice and reflection (American Counseling Association [ACA], 2014).

Service Learning Versus Community Service

An important distinction between community service and service learning lies within the beneficiaries of each. Within community service, the beneficiaries are those receiving the service. Service learning posits a reciprocal model, with both the recipient of service and student benefitting from the project (Blankson et al., 2015). Thus, SLPs provide students with opportunities to be exposed to issues of social justice that may foster empathy and cultural self-awareness. Students can benefit from service learning as it may assist them in developing increased compassion for others (George, 2015). With the continued focus on social justice within many disciplines, SLPs may provide another avenue for counselor educators to help students more fully understand the diverse needs of their communities and advocate for the underserved.

Throughout participation in an SLP, and at the completion, students are encouraged to apply critical thinking to their efforts and reflect on progress, barriers, and benefits (Blankson et al., 2015). For successful service learning to occur, projects should be connected to specific course objectives. Such a curricular emphasis is not generally a component of community service initiatives. By combining student projects and course material, instructors are able to help students solidify course material into practical applications (McDonald & Dominguez, 2015). This experiential avenue may appeal to non-traditional learners and provide more integration of material than didactic coursework alone (Currie-Mueller & Littlefield, 2018).

Effects of Service Learning

     Cipolle (2010) reported that students participating in early service learning received numerous benefits, including having higher self-confidence, feeling empowered, gaining self-awareness, developing patience and compassion, recognizing their privilege, and developing a connection and commitment to their community. All of these outcomes are consistent with the aims and goals of standards, competencies, and codes of ethics within the counseling profession (ACA, 2014; CACREP, 2015; Ratts et al., 2016).

Scott and Graham (2015) reported an increase in empathy and community engagement for school-age children when participating in service learning. They also reported that several previous works measured similar favorable effects among high school– and college-age individuals. Because of these overlapping desired effects and the need to incorporate social justice throughout the curriculum, service learning would fit well into current models of counselor education.

Service Learning Efforts in Counselor Education

The ACA Code of Ethics (2014) calls upon professional counselors to donate their time to services for which they receive little to no financial compensation. The incorporation of SLPs could provide an opportunity to fulfill this ethical obligation while training students and connecting with the community. A dearth of literature exists as to specific counselor education service learning efforts. Of the few results, many are focused on pre-practicum level SLPs (Barbee et al., 2003; Jett & Delgado-Romero, 2009), pedagogical tools woven into the multicultural and diversity-based courses (Burnett et al., 2004; Nikels et al., 2007), and group leadership training (Bjornestad et al., 2016; Midgett et al., 2016). Alvarado and Gonzalez (2013) studied the impact of an SLP on pre-practicum–level counseling students and found that students reported an increase in their confidence in using the core counseling skills and a deeper connection with the community outside of the university setting. Havlik et al. (2016) explored the effect SLPs had on CITs and found similar themes to Alvarado and Gonzalez, particularly that of raised levels of confidence in the ability to use the core counseling skills.

In other counselor education–related studies, researchers also reported positive impacts of service learning. One such impact was that of raised student self-efficacy (Barbee et al., 2003; Jett & Delgado-Romero, 2009; Murray et al., 2006). An added and practical benefit for students has also been a greater understanding and familiarity of the roles and settings of professional counselors and a deepened understanding of counselors’ roles within professional agencies. Students were able to examine their own professional interests prior to practicum work and participate in valuable networking experiences with other professionals (Jett & Delgado-Romero, 2009).

An increased compassion for the population with whom they work has been reported (Arnold & McMurtery, 2011) as a result of service learning. Burnett et al. (2005) reported increased counselor self-awareness, which is an important component of counselor education, regardless of delivery method, program accreditation, or instructor pedagogy. They also reported a component of a successful service learning course to be peer-learning. Peer-learning involves the giving and receiving of feedback, and this provides a foundation for experiences of group supervision feedback later in counseling programs (Burnett et al., 2005). A frequent reported result of participation in service learning has been increased multicultural competence and social justice awareness on the part of the student (Burnett et al., 2004; Lee & Kelley Petersen, 2018; Lee & McAdams, 2019; Shannonhouse et al., 2018). In short, the incorporation of SLPs would benefit counselor educators in developing desired qualities in beginning counselors while giving them opportunities to network and more fully integrate material.

Integrating Service Learning Into Counselor Education

Freire (2000) espoused that education should inspire students to become active and engaged members of the classroom in order to develop a deeper critical consciousness of society. Keeping Freire’s goal in mind, counselor educators could utilize service learning to bridge the divide that exists between the “ivory tower” and communities outside of academia. Counselors are called to apply their theoretical knowledge to real-world clients and to be advocates for those whose voices are silenced because of various forms of oppression (ACA, 2014; CACREP, 2015; Ratts et al., 2016). Through participation in SLPs, students are able to see firsthand the effects of oppression and assist with creating solutions; often, the projects chosen contain an element of social justice (George, 2015). Furthermore, SLPs woven into coursework may provide the opportunity for students to begin finding their voices as advocates and activists in a supportive environment, where peers are available to assist with potential problems that may arise.

By encouraging CITs to participate in SLPs earlier and often within their graduate education, students may have more opportunities to engage with diverse populations and to experience community environments and sociopolitical influences faced by different groups. The focus of clinical work during the practicum and internship phases of counselor education typically emphasizes counselor skill development and client progress rather than community-focused perspectives (Barbee et al., 2003; Jett & Delgado-Romero, 2009). Thus, by incorporating SLPs into regular coursework, students may feel freer to engage holistically in a community system rather than focus narrowly on their own counseling skill development and individual client progress. For all SLPs, there is the potential for students to experience the project components as challenging to complete. In this situation, students may be redirected to identify and analyze barriers to the success of the project and to identify strategies for eliminating those barriers.

Gehlert et al. (2014) argued that SLPs can also serve as potential gatekeeping tools. They posited that by engaging with individuals outside of the classroom experience, especially earlier than the practicum stage, students might decide for themselves that the counseling profession is not the right choice for their career (Gehlert et al., 2014). They further contended that utilizing SLPs early in students’ programs of study will allow the opportunity for faculty to identify students who might be in need of remediation plans before they are working with clients (Gehlert et al., 2014).

Counselors are urged to be advocates for the profession and for clients (ACA, 2014). Service learning may function as a natural initiation into that identity (Manis, 2012; Toporek & Worthington, 2014) and could possibly provide a bridge between an identity as a counselor and that of a counselor advocate. Another potential benefit of service learning is that students may be able to gain knowledge as to the realities of the profession beyond specific contact hour requirements to satisfy internship and licensure requirements. This could prove helpful as a gatekeeping tool as well. Students who find themselves disliking significant aspects of the profession might choose to leave the program without requiring faculty intervention.

Experiences of SLPs can be distilled into poster presentations or conference presentations. In this context, SLPs benefit both CITs and counselor educators, as professional development can occur for both. For students, conferences can be valuable networking opportunities, and for counselor educators, conference-related activities fall under required professional development (ACA, 2014; CACREP, 2015). Experiences could also serve as the foundation for manuscripts and research projects, both of which are considered professional development.

Service Learning Opportunities Within Specific Counseling Content Areas

CACREP (2015) provides counselor educators with standards for training that can be used to facilitate course development, learning objectives, and class assignments. Several core content areas within a CACREP-aligned counseling curriculum may offer instructors and students the chance to engage in SLPs. Because little information currently exists regarding best practices for service learning within counselor education, the authors created example SLPs that are based on CACREP standards and rooted in the relevant content area literature. These are designed to facilitate the development of advocacy skills in a variety of environments. It should be noted that with any SLP, it is important for counselor educators to engage in continued monitoring of projects and student placements. Given that SLPs provide a reciprocal benefit for both students and the community, it is important to ensure everyone involved is experiencing ongoing added value. Therefore, counselor educators are encouraged to create and maintain relationships with stakeholders for feedback throughout the SLP and to make adjustments as necessary.

Professional Orientation and Ethical Practice

Licensure remains an important topic within the counseling profession (Bergman, 2013; Bobby, 2013) and professional counselors are now able to obtain licensure in all states (Bergman, 2013; Urofsky, 2013). In order to become more familiar with state licensure policies and procedures, an SLP might involve student interviews with a member of the state licensure board and reflection upon that experience through a written journal entry. Questions posed to the board member could range from the practical aspects of obtaining a license in their state to the broader implications of ethical issues the board encounters. Student findings could then be utilized to develop a project involving the entire class in which students brainstorm ideas about what assistance the board might need in terms of outreach or advocacy. Examples could include barriers to licensure because of cost or English as a second language (making the testing aspect of obtaining licensure difficult). Students and faculty could use class time deciding what action to take and then implement and assess their plan.

Another example of an SLP that falls under this core content area is for students to volunteer time (e.g., 6 hours or more over a semester) assisting their state branch of ACA. An important aspect of the profession of counseling is involvement with relevant policy and legislation (Bergman, 2013). Students interested in getting involved in this area could spend time working with the lobbyist for their state’s ACA branch (provided the state has retained a lobbyist) in order to assist them in advocating for the profession. Simple tasks such as assisting with office work can be of significant help to one working in a high-stress position and can prepare students for the realities of clinical work. State and federal government have a significant role in shaping the profession (Bergman, 2013), and because of this, counselor educators can utilize service learning in order to inspire students to become involved early in their careers.

Should the state ACA branch not have retained a lobbyist, students can work with branch leadership in order to determine barriers. Perhaps costs are prohibitive, in which case students could help with fundraising efforts and outreach. Encouraging master’s students to take interest in policy and legislation pertaining to the profession will give them the foundation for making meaningful change and assisting with social justice efforts (Cipolle, 2010; Bergman, 2013).

Social and Cultural Diversity

Much of the existing literature regarding service learning and counselor education focuses on social and cultural diversity with regards to SLPs (Burnett et al., 2004). Philosophically, SLPs align with the aims and scope of the MSJCC (Ratts et al., 2016). Frequently, course assignments contain a cultural immersion project in order for counselors to encounter experiences in which their personal values might cause a conflict when working with clients (Burnett et al., 2004; Canfield et al., 2009). Service learning experiences could easily augment the student learning process within multicultural or diversity courses by helping students experience cultural immersion, which may foster greater compassion, empathy, and cultural sensitivity (Cipolle, 2010; Burnett et al., 2004).

One possibility for a social and cultural diversity–focused SLP would involve students working at a shelter for homeless populations or a center for refugees. Students could also find an organization that serves a minority or oppressed population and partner with them to help fill a need they are experiencing. Students would therefore gain experience working with people from groups with whom they may have limited prior experience. This can assist with students identifying their own privileges prior to working in the counseling setting. Ideally, students would contact the shelter or center at the start of the semester in order to ascertain the exact needs of the agency.

An additional SLP could focus on assisting an organization that advocates for minority or oppressed populations. This also emphasizes gaining experience with diverse populations; however, students would have more freedom in choosing the specific population and could gain more experience in understanding the systems involved in advocacy work. Ideally, the instructor would encourage students to choose organizations in which the student is challenged by their privileges (e.g., not being identified as a member of the population served). Through this project, students have the opportunity to work with a wider variety of individuals and help to bring about social change via their specific project goals. For instance, students could choose a women’s health center that has experienced a decline in attendance. The students might investigate and discover a particular city bus route was discontinued, making transportation to the health center difficult for residents. Students might then partner with various organizations with van access (such as churches) and raise money for weekly transportation in and out of the area.

Career Development

Within the career development area of the CACREP core curriculum, students have the possibility of learning about their own careers and the impact careers have on the lives of clients. Examples of SLPs can include opportunities for students to immerse themselves within various aspects of career development. Several SLPs could come from partnering with a local employment agency. Students could discover barriers to employment for members of the local community and implement a project to alleviate some of those barriers. For example, students might discover a lack of late-night childcare in their community, which affects those working during the evening and night. They might implement a project in which university students provide childcare for a reasonable cost to the parents, making finding employment easier. If liability issues make this too difficult, students could focus their attention on fundraising to hire more qualified individuals to provide the childcare.

As mental health and wellness are primary foci of professional counselors (ACA, 2014; CACREP, 2015), a second potential SLP assignment related to career development could be for students to partner with a local business and provide mental health and wellness screenings, and education via seminars or workshops. Ideally, students would familiarize themselves with the company insurance (or lack thereof) and prepare referrals and resources accordingly. Workshops and seminars could be an avenue for educating employees and the community at large about wellness, prevention, and good mental health. These could be delivered via “brown bag lunches” or more formal trainings for employees.

Helping Relationships

As CITs progress though counselor education programs, it might be helpful for them to discover new ways to employ their skills in helping relationships outside of counseling sessions. Much of the aforementioned scholarship exploring service learning within counselor education discovered an increase in self-efficacy with respect to core counseling skills as a result of participating in SLPs (Alvarado & Gonzalez, 2013; Havlik et al., 2016). An SLP suitable for this core curriculum could be to partner with a suicide prevention agency and provide assistance where needed. For example, students might work on a suicide hotline or provide referrals for people in distress, utilizing their relationship-building skills and reflective listening while learning about suicide assessment or prevention efforts within the community. Of course, it is important to consider students’ level of development and readiness to work with individuals who are suicidal. Counselor educators should ensure there are appropriate supports and supervision for students in these settings. A related project could be for school counseling students to partner with such an organization to create a developmentally appropriate suicide education presentation for high school–age children and deliver it to area schools.

Another SLP focused on the helping relationship might involve students seeking non-counseling placements at local counseling agencies or private practice settings. Ideally, students would have the opportunity to immerse themselves in many elements of practice without having a focus on accruing direct client contact hours. Spending time at an agency before practice might provide students with opportunities to learn many aspects of the profession and the operations of the agency, which in turn could help students decide within which settings they would like to work. This project might also help inform students about potential barriers clients might face in accessing services. They could develop a plan for removing the barriers, which might include identifying potential sources of funding for the project (e.g., grants, scholarships, community donations) and providing an outline of how to access this funding. Another potential benefit to this project is that it could provide students with the opportunity to network within the local counseling community and connect agencies with potential interns.

Group Work

SLPs that correspond to group work can be similar to those under the helping relationships core curriculum. For example, students could partner with a local counseling agency that provides group counseling services. Students could determine if clients encounter any barriers to receiving group counseling and implement a plan for eliminating the barrier(s). A further example is perhaps if the agency has a group in which they would like to see more culturally relevant topics used in order to attract a more diverse group of clients. Students partnering with this agency could perform outreach to discover what clients would like to see at the group and any barriers, such as transportation, to attending this group. Another possibility for an SLP is for students to facilitate a group counseling experience for an agency or shelter for no cost to those participating in the group.

Conclusion

SLPs have the potential to enhance the learning experiences of students within graduate counselor education programs. Although not previously emphasized within counselor training, SLPs may be developed and implemented within a variety of core counseling content areas as suggested by CACREP (2015). From an advocacy and social justice perspective, SLPs also may provide students with multiple opportunities to experience the needs of clients and identify barriers to providing counseling services with diverse client populations. Ultimately, by utilizing SLPs, counselor educators can help foster CITs’ advocacy and social justice identities, preparing them for work as responsible citizens and effective counselors.

 

Conflict of Interest and Funding Disclosure
The authors reported no conflict of interest
or funding contributions for the development
of this manuscript.

 

References

Alvarado, M., & Gonzalez, P. A. (2013). Experiences in service learning among counselor education students. VISTAS Online. https://www.counseling.org/docs/default-source/vistas/experiences-in-service-learning-among-counselor-education-students.pdf?sfvrsn=6

American Counseling Association. (2014). ACA code of ethics.

Arnold, R., & McMurtery, R. F. (2011). Integrating service learning into counselor education: Applications and implications. The Researcher: An Interdisciplinary Journal, 24(1), 59–74.

Backer Condon, B., Grimsley, C., Knaack, L., Pitz, J., & Stehr, H. J. (2015). The art of service learning. Nursing Science Quarterly, 28(3), 195–200. https://doi.org/10.1177/0894318415585624

Barbee, P. W., Scherer, D., & Combs, D. C. (2003). Prepracticum service-learning: Examining the relationship with counselor self-efficacy and anxiety. Counselor Education and Supervision, 43(2), 108–119. https://doi.org/10.1002/j.1556-6978.2003.tb01835.x

Bergman, D. M. (2013). The role of government and lobbying in the creation of a health profession: The legal foundations of counseling. Journal of Counseling & Development, 91(1), 61–67. https://doi.org/10.1002/j.1556-6676.2013.00072.x

Bjornestad, A., Mims, G. A., & Mims, M. (2016). Service learning in schools: Training counselors for group work. Journal for Specialists in Group Work, 41(3), 190–208. https://doi.org/10.1080/01933922.2016.1186764

Blankson, A. N., Rochester, S. E., & Watkins, A. F. (2015). Service-learning and civic responsibility in a sample of African American college students. Journal of College Student Development, 56(7), 723–734. https://doi.org/10.1353/csd.2015.0078

Bobby, C. L. (2013). The evolution of specialties in the CACREP standards: CACREP’s role in unifying the profession. Journal of Counseling & Development, 91(1), 35–43. https://doi.org/10.1002/j.1556-6676.2013.00068.x

Bringle, R. G., & Hatcher, J. A. (1995). A service-learning curriculum for faculty. Michigan Journal of Community Service Learning, 2(1), 112–122. http://hdl.handle.net/2027/spo.3239521.0002.111

Burnett, J. A., Hamel, D., & Long, L. L. (2004). Service learning in graduate counselor education: Developing multicultural counseling competency. Journal of Multicultural Counseling and Development, 32(3), 180–191. https://doi.org/10.1002/j.2161-1912.2004.tb00370.x

Burnett, J. A., Long, L. L., & Horne, H. L. (2005). Service learning for counselors: Integrating education, training, and the community. Journal of Humanistic Counseling, Education and Development, 44(2), 158–167. https://doi.org/10.1002/j.2164-490X.2005.tb00028.x

Canfield, B. S., Low, L., & Hovestadt, A. (2009). Cultural immersion as a learning method for expanding intercultural competencies. The Family Journal, 17(4), 318–322. https://doi.org/10.1177/1066480709347359

Cipolle, S. B. (2010). Service-learning and social justice: Engaging students in social change. Rowman & Littlefield.

Council for Accreditation of Counseling and Related Educational Programs. (2015). 2016 CACREP standards.

Currie-Mueller, J. L., & Littlefield, R. S. (2018). Embracing service learning opportunities: Student perceptions of service learning as an aid to effectively learn course material. Journal of the Scholarship of Teaching and Learning, 18(1), 25–42. https://doi.org/10.14434/josotl.v18i1.21356

Dotson-Blake, K. P., Dotson, L. K., Glass, J. S., & Lilley, B. D. (2010). Accountability in action: Service-learning partnerships in practice. Journal of School Counseling, 8(29), 1–41.

Freire, P. (2000). Pedagogy of the oppressed (30th anniversary ed.). Bloomsbury.

Gehlert, N. C., Graf, A. D., & Rose, L. A. (2014). Benefits and best practices: Service-learning in counselor education. Currents in Teaching & Learning, 7(1), 37–49.

George, T. P. (2015). Making an impact with service learning. Nursing, 45(12), 21–24. https://doi.org/10.1097/01.NURSE.0000473146.91433.84

Havlik, S. A., Bialka, C., & Schneider, K. (2016). Theory to practice: Integrating service-learning into a pre-practicum Introduction to School Counseling course. The Journal of Counselor Preparation and Supervision, 8(2). https://doi.org/10.7729/82.1168

Jett, S. T., & Delgado-Romero, E. A. (2009). Prepracticum service-learning in counselor education: A qualitative case study. Counselor Education and Supervision, 49(2), 106–121.

Lee, K. A., & Kelley-Petersen, D. J. (2018). Service learning in human development: Promoting social justice perspectives in counseling. The Professional Counselor, 8(2), 146–158. https://doi.org/10.15241/kal.8.2.146

Lee, K. A., & McAdams, C. R. (2019). Using service-learning to promote social justice advocacy and cognitive development during internship. The Journal of Counselor Preparation and Supervision, 12(1). https://repository.wcsu.edu/jcps/vol12/iss1/8

Manis, A. A. (2012). A review of the literature on promoting cultural competence and social justice agency among students and counselor trainees: Piecing the evidence together to advance pedagogy and research. The Professional Counselor, 2(1), 48–57. https://doi.org/10.15241/aam.2.1.48

McDonald, J., & Dominguez, L. A. (2015). Developing university and community partnerships: A critical piece of successful service learning. Journal of College Science Teaching, 44(3), 52–56.

Midgett, A., Hausheer, R., & Doumas, D. M. (2016). Training counseling students to develop group leadership self-efficacy and multicultural competence through service learning. The Journal for Specialists in Group Work, 41(3), 262–282. https://doi.org/10.1080/01933922.2016.1186765

Murray, C. E., Lampinen, A., & Kelley-Soderholm, E. L. (2006). Teaching family systems theory through service-learning. Counselor Education and Supervision, 46(1), 46–58. https://doi.org/10.1002/j.1556-6978.2006.tb00011.x

Nikels, H. J., Mims, G. A., & Mims, M. J. (2007). Allies against hate: A school-based diversity sensitivity training experience. The Journal for Specialists in Group Work, 32(2), 126–138. https://doi.org/10.1080/01933920701227117

Ratts, M. J., Singh, A. A., Nasar-McMillan, S., Butler, S. K., & McCullough, J. R. (2016). Multicultural and Social Justice Counseling Competencies: Guidelines for the counseling profession. Journal of Multicultural Counseling and Development, 44(1), 28–48. https://doi.org/10.1002/jmcd.12035

Sabo, S., de Zapien, J., Teufel-Shone, N., Rosales, C., Bergsma, L., & Taren, D. (2015). Service learning: A vehicle for building health equity and eliminating health disparities. American Journal of Public Health, 105, S38–S43. https://doi.org/10.2105/AJPH.2014.302364

Scott, K. E., & Graham, J. A. (2015). Service-learning: Implications for empathy and community engagement in elementary school children. Journal of Experiential Education, 38(4), 354–372. https://doi.org/10.1177/1053825915592889

Servaty-Seib, H. L., & Tedrick Parikh, S. J. (2014). Using service learning to integrate death education into counselor preparation. Death Studies, 38(3), 194–202. https://doi.org/10.1080/07481187.2012.738774

Shannonhouse, L. R., Myers, J. E., & Barrio Minton, C. A. (2018). Cultural immersion in counselor education: Trends, prevalence, and common components. Journal of Multicultural Counseling and Development, 46(4), 283–296. https://doi.org/10.1002/jmcd.12115

Stanton, T. K., & Wagner, J. (2010). Educating for democratic citizenship: Antecedents, prospects, and models for renewing the civic mission of graduate education at research universities. In H. E. Fitzgerald, C. Burack, & S. Seifer (Eds.), Handbook of engaged scholarship: Contemporary landscapes, future directions. Vol. 1: Institutional change (pp. 411–436). Michigan State University Press.

Tinkler, B., hannah, c. l., Tinkler, A., & Miller, E. (2015). The impact of a social justice service-learning field experience in a social foundations course. Critical Questions in Education, 6(1), 16–29.

Toporek, R. L., & Worthington, R. L. (2014). Integrating service learning and difficult dialogues pedagogy to advance social justice training. The Counseling Psychologist, 42(7), 919–945. https://doi.org/10.1177/0011000014545090

Urofsky, R. I. (2013). The Council for Accreditation of Counseling and Related Educational Programs: Promoting quality in counselor education. Journal of Counseling & Development, 91(1), 6–14. https://doi.org/10.1002/j.1556-6676.2013.00065.x

 

Kristen Arla Langellier, PhD, NCC, is an assistant professor at the University of South Dakota. Randall L. Astramovich, PhD, LCPC, is an associate professor at Idaho State University. Elizabeth A. Doughty Horn, PhD, LCPC, is a professor at Idaho State University. Correspondence may be addressed to Kristen Langellier, Division of Counseling and Psychology in Education, University of South Dakota, 414 E. Clark St., Vermillion, SD 57069, kristen.langellier@usd.edu.