Preparing Counseling Students to Work with Refugees: A Descriptive Analysis

Shadin Atiyeh

This study explored the challenges and strategies employed by counselor educators in training students to work effectively with refugee populations. Utilizing a qualitative descriptive analysis, a qualitative open-ended survey was conducted with 11 counselor educators and a focus group meeting with four counselor educators from various CACREP-accredited master’s programs across the United States. The analysis revealed several barriers to effective training, including the perceived limited relevance of the topic, time constraints within courses, and the complexity of addressing refugee issues. Participants emphasized the pressing need for comprehensive curricula that integrate refugee concerns and enhance multicultural competence. Findings suggest that diverse teaching strategies, such as case studies and experiential learning, are essential for preparing students to meet the unique mental health needs of refugees. This study underscores the importance of equipping future counselors with the skills and knowledge required to support this underserved population effectively and to advocate for the integration of refugee topics across counseling courses to promote social justice.

Keywords: refugees, barriers, multicultural competence, curricula, counselor educators

According to the American Counseling Association (ACA; 2014) Code of Ethics, counselors must gain multicultural competence to work with diverse populations and to advocate for equitable access to mental health care among underserved populations. Refugee populations represent a diverse group who face barriers to accessing mental health care in many societies (Satinsky et al., 2019). The UN Refugee Agency (formerly the United Nations High Commissioner for Refugees; 2025) defined a refugee as a person who flees their home country because of persecution based on race, religion, nationality, political opinion, or membership in a social group. The number of forcibly displaced people globally was 123.2 million people at the end of 2024, including 42.7 million refugees (The UN Refugee Agency, 2025). Despite the growing global need for counseling services among refugees, counselor training programs often do not include orientation to refugee issues in their counseling courses. The Council for the Accreditation of Counseling and Related Educational Programs (CACREP; 2023) addresses migration in its standards within the definitions of cultural identity, diversity, and marginalized populations. However, the topic of migration is included explicitly within the standards when relevant to the impact of migration on family functioning for the marriage, couple, and family counseling specialization (CACREP, 2023). Counselors are currently facing a global humanitarian call to support refugee populations (Snow et al., 2021). The goal of this study was to explore approaches to counselor education that teach counseling students about refugee concerns and the barriers counselor educators face in training counseling students to develop this competence. The findings offer diverse strategies to facilitate multicultural competence among counseling students and illuminate the barriers to access, which the profession must address in order to respond to the current mental health crisis among the growing number of refugees globally.

Refugee Resettlement in the United States
The United States has admitted more than 3.1 million refugees since the passage of the Refugee Act in 1980 (U.S. Department of State, 2018). To address the unprecedented global refugee crisis, the United States raised its admissions ceiling to 125,000 for fiscal years 2023 and 2024. In the fiscal year 2023, the United States also launched a private sponsorship pathway for refugee arrivals called Welcome Corps. This allowed groups of citizens to sponsor and resettle refugees in their communities. The United States also established a pathway for migration to those fleeing the Ukrainian and Afghan crises and allowed eligibility for refugee services for those individuals in addition to a streamlined application process for Cubans, Haitians, Nicaraguans, and Venezuelans to seek refuge. These actions yielded more opportunities for migrants to seek refuge and more communities across the country welcoming refugees outside of the traditional refugee resettlement structure. Traditionally, refugees are resettled in 48 states, with Washington, California, Texas, Ohio, and New York being the top resettlement areas (U.S. Department of State, 2018). The top 10 native languages that refugees living in the United States speak include Arabic, Nepali, Somali, Karen, Spanish, Swahili, Chaldean, Burmese, Armenian, and Farsi (U.S. Department of State, 2018). In fiscal year 2024, 100,034 refugees were admitted, with the top five countries of origin being the Democratic Republic of Congo, Afghanistan, Venezuela, Syria, and Burma. Although this was a record number for the traditional refugee resettlement program in the 21st century, it did fall short of the 125,000 ceiling set by the federal administration (Refugee Council USA, 2024). In January 2025, the federal administration closed both the traditional pathway for refugee resettlement and the parole application processes, as well as removing legal status for previously approved groups (Church World Service, 2025).

Mental Health Needs
     Refugees are ethnically diverse and have varied experiences and backgrounds; however, they all share an increased risk for trauma-related distress and underuse of services (Bemak & Chung, 2021). One distinction between refugees and other migrants is that while immigrants tend to arrive in the United States healthier than the native-born population and then develop illnesses over time, refugees tend to enter the country less healthy than the native-born population (Pampati et al., 2018). Refugees have higher prevalence rates of post-traumatic stress disorder and depressive disorders (Bartholomew et al., 2021), and compared to other immigrants, refugees have the additional difficulties of pre-migratory traumatic experiences, grief, and loss of self-determination (Rometsch et al., 2020). Immigrants who choose to migrate and prepare for that transition face barriers such as culture shock and acculturation difficulties. However, refugees flee for their safety, without a choice and often without time to prepare, often leaving behind valuables and important documents. This loss of self-determination compounds in migration, as host countries often do not offer refugees the right to work, establish a lawful presence, or study. Much of the current literature related to the resettlement of refugees focuses on traumatic experiences before migration and leaves out the stressors involved after resettlement to a third country (Interiano-Shiverdecker et al., 2020). However, the daily stressors post-migration can be more distressing than war-related trauma and necessitate a social justice perspective to counseling (Kondili et al., 2022). These daily stressors may include acclimating to a new culture, language, and socioeconomic status, as well as navigating new social systems to access public benefits and health care. The focus of refugee services toward self-sufficiency as quickly as possible contrasts the policy of referring the most vulnerable refugees to resettlement, and the refugees’ years of experience having to depend on others for survival. Discrimination and prejudice are risks to overall well-being, affecting self-esteem, belonging, and self-determination (Interiano-Shiverdecker et al., 2020). The need for counseling services among refugee populations, particularly in resettlement to the United States, is well established.

Barriers to Counseling for Refugee Populations
     Despite the need, refugees face various barriers to access for counseling services. Regardless of cultural background, refugees commonly experience barriers related to transportation, language, loss of social networks, financial difficulties, and limited access to resources (Tribe et al., 2019). Cultural barriers to seeking mental health counseling include shame about sharing personal or family concerns with those outside the family, a need to maintain a positive reputation within the community, and disbelief that talking about an issue could make it better (Hosseini et al., 2023). Refugees, who often have experienced oppression that breeds mistrust of people in power, may have concerns related to privacy and safety in counseling (Duden & Martins-Borges, 2021). With varying educational levels and interrupted education due to conflict, refugees may also lack knowledge about the availability and utility of counseling services (Duden & Martins-Borges, 2021).

Systemic issues also play a role, such as a misalignment between the mental health care system’s offerings and the specific needs of refugee communities (Bartholomew et al., 2021). Individualized Western conceptualizations of mental illness and its treatment are limited in being able to address the mental health needs of refugee groups (Bartholomew et al., 2021). Psychosocial distress presents itself with somatic symptoms such as headaches, backaches, and stomach pains among refugee groups, complicating identification and treatment of psychosocial disorders (O’Brien & Charura, 2023). Effective support requires a holistic and culturally sensitive approach that addresses not only specific psychiatric conditions but also the practical, social, and cultural contexts of their lives (Salami et al., 2019). In summary, refugees face a complex web of interconnected barriers to accessing mental health care. These include practical issues like cost and language, cultural factors such as stigma and differing illness beliefs, and systemic problems where the services offered do not match clients’ perceived needs. Overcoming these barriers requires a multifaceted approach that includes providing practical support, fostering cultural humility among clinicians, and adapting therapeutic models to be more responsive to the unique circumstances of refugee populations.

Multicultural Competence in Counseling Refugees
     Ratts et al. (2016) created a multicultural counseling model that includes attitudes and beliefs, knowledge, skills, and action across the domains of interventions, relationships, client worldviews, and counselor self-awareness. Ratts et al. (2016) approached multicultural competence with an awareness of the need to include a broader concept of diversity, intersectionality of identities, and the role of counselors as social justice advocates. Cultural competence requires flexibility in accepting individual conceptualizations and needs rather than knowledge of a set of generalized facts about a cultural group (Cabell et al., 2024). To work with refugees effectively, counselors must have a range of skills, including navigating boundaries, advocating, responding to trauma, facilitating acculturation, and working with interpreters (Atiyeh & Gray, 2022). Training and preparation of counselors in their master’s-level courses are key to laying the foundation for multicultural competence development to work with refugee clients. This training also extends toward multicultural competence with other populations (Atiyeh & Gray, 2022). Although it is understood that counselors need to be culturally competent social justice advocates, knowing how to support trainees in learning and demonstrating those skills in real-world contexts is less understood (Kuo et al.,2020). Professional development training on specific cultures is important to further develop multicultural competence beyond master’s-level training (Cabell et al., 2024). Much of the training provided in master’s counseling programs relies on a traditional model of counseling utilizing Western-based theories, and promoting refugee mental health requires incorporating a collaborative and social justice approach (Kondili et al., 2022). Counseling programs may be deficient in preparing counselors who are knowledgeable about their clients’ worldviews (Damra & Qa’aymeh, 2024). The intersection of the high need for counseling services, the systemic barriers preventing effective and culturally responsive counseling, and the limited competence among counselors poses a serious health equity issue that the profession must address.

Method

The purpose of the study was to explore the ways that counselor educators address refugee concerns in counseling courses in order to highlight barriers and resources for counselor education. The research question was: What are the experiences of counselor educators who address refugee concerns in master’s-level counseling courses? I conducted a qualitative descriptive analysis study utilizing an open-ended qualitative online survey and a focus group session. This approach is appropriate when exploring participants’ experiences and perceptions from a naturalistic orientation (Sandelowski, 2010). As the current literature demonstrates a need for competent mental health counseling for refugee populations, further investigation into the barriers that counselor educators experience in training students to work with this population and how they navigate these barriers is important. Qualitative description offers a starting point to explore how counselor educators incorporate refugee concerns in the classroom at the master’s level. The survey included questions related to which courses cover refugee concerns, what strategies they use, what barriers they face in doing so, and the training they have had related to refugee concerns. The study design followed a descriptive content analysis with the intent of describing how counselor educators may be teaching students in the classroom how to work with refugee clients, the resources they utilize, and the challenges they face in doing so. This qualitative approach can be useful in identifying and sharing data in a way that is relevant to a specific audience (Sandelowski, 2000).

Study Design
     I shared an online survey with open-ended questions utilizing Qualtrics on listservs and social media groups for counselor educators. These outlets for recruitment were appropriate to seek out counselor educators who self-identified as incorporating refugee concerns into their master’s-level counseling courses. After an initial analysis of the survey data, I posted a focus group meeting opportunity on the same listservs. In the focus group meeting, initial themes were shared, and participants were asked to react to and expand on the results. The transcript for the focus group meeting was coded using in-vivo coding. Individual codes were grouped into categories and those were grouped under major themes.

Participants
     Participant inclusion criteria included counselor educators who teach master’s-level counseling courses and address refugee concerns in those courses. I recruited participants online through emails to a listserv of counselor educators and social media groups of counselor educators. These included CESNET and social media groups for the NBCC Foundation Minority Fellowship Program recipients and alumni. An invitation to participate in the focus group meeting was sent to the same groups. Eleven participants completed the open-ended survey and four counselor educators participated in the focus group meeting. Demographic data were not collected as part of the survey or focus group questions in order to preserve anonymity, as the community of counselor educators with experience incorporating refugee topics in their courses may be quite small, and demographic data may reduce their openness to provide in-depth responses.

Procedure
     This study received ethical approval from the host institution’s IRB. The emailed recruitment message included a research information sheet explaining the research and participation expectations. It also included a link to complete the survey using Qualtrics. There were no planned follow-up procedures after the survey. Eleven participants completed the open-ended survey, which included the following questions:

  1. In what classes and during which topic areas do you include refugee concerns in your counseling courses?
  2. What activities or resources do you use to teach counseling students about refugee concerns?
  3. What barriers or challenges do you face when teaching counseling students about refugee concerns?
  4. How have you received training or education regarding refugee concerns, if any?

These questions were developed to respond to the research question of: What are the experiences of counselor educators who address refugee concerns in master’s-level counseling courses? The questions were also framed to lead to practical resources and techniques for counselor educators to utilize within their courses. I grouped responses to these questions into descriptive categories. I submitted and obtained approval for an amendment to the initial IRB approval to obtain focus group data to expand on emerging themes from the survey. I emailed a recruitment message with an edited research information sheet detailing focus group procedures and an invitation to a virtual meeting on Microsoft Teams, which four participants attended. Participants had the choice to be off-camera during the meeting. The meeting was recorded for transcription, and the recording was deleted after the transcription was created. I presented these to the focus group participants for elaboration and description of the emerging themes. I shared the initial results from the survey data and asked participants to share what stood out to them about these findings. I also asked the focus group participants the same questions from the survey. The focus group meeting was semi-structured with an in-depth discussion following the participants’ responses to allow for a deeper discussion of the research question that the open-ended questionnaire could not offer (Bengtsson, 2016). The transcript of the focus group meeting was analyzed and coded in vivo. Those codes were grouped into categories and then organized into themes.

Data Analysis
     I downloaded Qualtrics responses in an Excel spreadsheet and reviewed them several times following a content analysis approach (Sandelowski, 2000). I then read through the data two times before conducting in-vivo coding. A code was written next to the relevant data on the Excel spreadsheet. Similar codes were then grouped together in Microsoft Word. While staying close to the data, it was organized into categories (Prasad, 2019). I organized the data into categories so that the description could lead to meaningful implications to which the focus group participants could react. After the focus group, the meeting was transcribed automatically using Microsoft Teams and analyzed separately from the survey data. This analysis included the same process of reading through the transcript twice initially, then a round of initial in-vivo coding within an Excel spreadsheet, then grouping similar codes into a table on Microsoft Word, and finally grouping those categories into larger themes.

Researcher Positionality and Reflexivity
     A key element of rigor in qualitative research is researcher reflexivity (Olmos-Vega et al., 2023). While inherent biases, subjectivities, and power imbalance inevitably inform data analysis and influence the research process, sharing the positionalities of the researcher is an important first step in trustworthiness (Olmos-Vega et al., 2023). Olmos-Vega et al. (2023) defined reflexivity as a dynamic and collaborative process that involves self-critique and context evaluation by first making positionality explicit. I am an assistant professor in the counselor education department at a public urban university offering CACREP-accredited master’s-level programs in clinical mental health, school counseling, and clinical rehabilitation counseling. I also have over 10 years of experience providing counseling and employment services with refugee populations and supervising such programming. I approach my clinical and academic work from a constructivist and existential perspective in which knowledge and experiences are co-constructed through meaning-making and perspective-taking. I have not personally experienced migration, forced or otherwise, but have grown up around immigrant communities as the child of an immigrant. I conducted this study to bring attention to the need for counseling services for refugee communities and the struggles faced and strategies employed by educators when training counseling students to do so. This is the perspective with which I approached study design and data interpretation. I also developed reflexivity throughout the process by checking initial interpretations from survey data with the focus group participants and connecting themes with the quotes from the data.

Results

The initial survey results are outlined in Table 1. Focus group participants discussed their reactions to these responses and expanded on them in their own answers to the same questions. The analysis of the transcript yielded 89 codes that were grouped into 11 categories and three themes.

Table 1

Survey Results

Courses Strategies Barriers Training for Educators
Diversity Guest Speakers Lack of student interest Conferences
Ethics Videos Not relevant Articles
Family Articles Limited time Lived experience
Trauma Poems Not covered in textbooks Consultation
Group Case Studies Political reasons Workshops
Career Student Presentations Too complex None
School Textbook
Internship
Advocacy

 

Description of Courses
     The survey results indicated that refugee concerns may be addressed in courses throughout the master’s program, not just in a singular course focused on multicultural diversity. These courses included an introductory course on diversity topics in addition to ethical practice, family counseling, treating trauma, groupwork, career counseling, school counseling, clinical courses, and a course on advocacy strategies. This is in line with guidance within the counseling literature on facilitating multicultural competence across the curriculum. Multicultural competence is too complex and important to be limited to only one class. Doing so may allow students to grasp some of the complexity involved in working with refugees and develop their counseling skills to work with intersectional identities. However, focus group participants were struck by the lack of standardization to how counselor educators address refugee concerns in their courses, highlighting the variability in responses to which courses include the topic. This variability also comes up in the ways that counselor educators approach training students to work with refugee clients.

Description of Strategies
     Counselor educators also broach the topic in various ways: allowing students to bring it up, inviting a guest speaker, or having a discussion led by the educator. Participants shared that it comes up in courses because students bring up the topic through their papers, presentations, or case presentations, if they happen to be working with a refugee client. Participants might bring refugee concerns into the classroom as they discuss current news stories or events.

The content presented by counselor educators included peer-reviewed articles, student presentations, case studies, and textbooks. Participants also utilize creative approaches that highlight the lived experiences of refugees, such as poetry or film. Guest speakers share their own clinical experiences working with refugees in the field. Focus group participants shared specific examples, such as incorporating case studies in various classes. One focus group participant described a paper assignment given to students in which they needed to analyze an ethical issue relevant to a population facing racism or oppression; some students selected a concern facing refugees. Another participant led an internship experience at a local shelter for migrants and trained students to work specifically with this population through experiential training and weekly supervision. Although this participant described requiring students to have a traditional counseling experience before participating in this internship and the importance of having balance in skills for both conventional in-office counseling and nontraditional counseling conducted in shelters, they stated, “It can be very, very difficult to get them to understand that counseling does not have to happen in an office in 50 minutes.” This participant identified that in practice, “These are not the skills that they are taught in the classes . . . there’s a lot of retraining . . . unteaching and untraining can be a barrier and a challenge.” This discussion of strategies utilizing experiential learning quickly turned into a discussion of challenges and barriers in attempting to fit work with refugee clients into the current paradigm of training counselors, which often relies on Western theories of counseling. Another participant in the focus group reflected on how difficult it was to adapt to working with refugee clients after graduating from a master’s program, even while sharing a language and cultural background with clients. They stated, “When I graduated as a master’s student, I went into an agency to work with refugees, and at first, just implementing everything we learned was sometimes damaging.” Allowing for supportive opportunities to practice throughout the master’s curriculum allows students to have safe opportunities to practice before graduation. One participant offered that they “do a lot of shadowing” throughout their practicum experience. Another participant agreed: “I think that that’s where that immersion experience is going to be critical, and immersion doesn’t have to be going to a refugee camp. It could be through different means.”

Description of Barriers
     Participants also identified challenges they may face while trying to educate counseling students in the classroom on how to work with refugee clients. These challenges included a perception of the lack of relevance of refugee concerns, limited opportunities to teach students how to work with refugee clients, and the complexity involved in refugee concerns. Some of the quotes from participants illuminated the challenges in teaching counseling students to work with refugees. The direct quotes that support these themes are listed in Table 2.

Table 2

Challenges to Incorporating Refugee Concerns

Theme Quotes
Lack of Relevance “Some students don’t seem interested or think that they don’t want to work with that population.”

“Students don’t see the need to learn about it.”

“I think opportunities to work with refugees are limited in our area and so it isn’t a ‘pressing’ concern. Doesn’t mean it isn’t important, but we focus on the concerns that our students will likely face in their service provision at higher rates.”

Limited Opportunity “Large amount of topics in learning objectives to cover over a semester.”

“I don’t have a lot of time dedicated to the topic.”

“It doesn’t appear in many of the counseling texts as an area to address.”

Complexity

 

“Many students lack knowledge about the refugee experience and [have a] misunderstanding of the difference between refugees and immigrants.”

“Students think it’s too hard.”

“My state doesn’t want educators discussing ‘diversity’ topics.”

“Their previous political beliefs can be an obstacle.”

“Addressing this topic as it relates to intersectional identity, and culturally responsive treatment knowledge and resources.”

 

Focus group participants elaborated on these themes. The second point from the survey results that stood out to them, after noticing the variability with which counselor educators were discussing refugees, was the sense that competence to work with refugee clients was not important or relevant to students. They made sense of this as being from a place of experiencing the privilege of not having to be aware of the level of forced displacement in the world. One focus group participant highlighted that this ignorance has consequences: “The privilege of not needing to be competent is harmful to communities.” Participants also explored this lack of interest and/or relevance further, stating: “It takes work to gain the competence, and if it’s not something that is of interest, folks are not seeking it out.” The underutilization of mental health services for refugees is further exacerbated by the lack of culturally competent counselors. This lack of interest may also be fueled by stereotypes about the population. Focus group participants shared their perceptions that “a lot of people are afraid of getting into it because of whether it’s like the competence piece or fear of vicarious traumatization or . . . I guess just like lack of interest” and “working with refugees, there is this . . . view of this population as broken. So there is a fear that either I’m going to do harm or not be helpful enough.” Another potential source for this ambivalence is also economic. Focus group participants discussed that there “isn’t a lot of money in it” when referring to working with refugee clients and that it is often grant-funded work in community agencies. They all discussed how counseling students are often entering the profession seeking to work in private practice, providing services reimbursed by medical insurance rather than counseling work in community settings.

Counselor educators are also affected by the limited time, resources, and applicability of current counseling theories to be able to incorporate the complexity needed when addressing refugee concerns in counseling courses. Focus group participants shared that counselor educators themselves “lack the competence to talk about this population” or “don’t feel comfortable enough as educators.” The textbooks used in counseling courses also do not provide enough information on the topic to help guide the discussion in class. One participant mentioned, and others reiterated it multiple times during the focus group, that “we don’t have more than a chapter.” Educators then must seek out additional resources or adapt existing approaches, with one participant sharing that “our counseling theories are not really applying to this population, so we have to spend a lot of time either adapting them or unlearning them.”

Despite these barriers, focus group participants shared multiple reasons why counselor educators and counselors need to persist in developing competence. They all highlighted the scenarios in which counselors may encounter issues related to forced migration or clients from refugee backgrounds. Participants shared that “every border university should have really solid training and education for this population,” and “if you don’t work with refugees, you might have a client that has a family member or friend from that background,” and “in the school setting, like children have to go to school, and so they’re finding themselves being faced with working with refugees.” Participants also shared that they learned a tremendous amount from their refugee clients, deepening their own skills and ability to adapt: Learning experience for me is like you learn from them probably more than they learn from you,” and “you have to really be flexible to learn from them as much as they’re learning from you to be able to be helpful.” Participants also shared how rewarding the work has been and how they have seen students benefit from “the joy and the reward of working with this population.” Another participant shared that “once they’ve experienced this work, they just love it. There is so much joy in it.”

Description of Training Opportunities
     Participants also shared opportunities they had to learn about refugee concerns as educators. These included conferences, reading journal articles, attending workshops, work experiences, and personal lived experiences. Participants shared specific workshops that were useful, such as the Trauma Systems Therapy for Refugees training, Global Mental Health training from Johns Hopkins University, and consultation with local refugee resettlement agencies. These may be a starting place for counselor educators who want to gain training before integrating refugee concerns into their courses. The study findings included several resources available to counselor educators, such as case studies and experiential learning opportunities.

Incorporating refugee concerns throughout master’s-level counseling courses may be useful in facilitating multicultural competence among counselors to work with refugees and other diverse populations. The concern about whether teaching counselors to work with refugees is relevant is striking, given the high need for mental health services among this population and the limited access to those services. Given this need for mental health services and the ethical mandate for counselors to work toward access to mental health care for underserved groups, counselor educators can and must do more to overcome the challenges and complexity involved in facilitating multicultural competence among counseling students.

Discussion

The purpose of the study was to explore the ways that counselor educators address refugee concerns in counseling courses to highlight barriers and resources for counselor education. The research question was: What are the experiences of counselor educators who address refugee concerns in master’s-level counseling courses? Counselor educators who do so incorporate refugee concerns throughout the curriculum using various methods while navigating challenges of complexity, limited time and resources, and potential disinterest. The study results demonstrate the importance of incorporating refugee representation throughout the curriculum at the master’s level. The results suggest various approaches, building on current literature that advocates for opportunities to engage in service learning or immersive experiences. In the following sections, I share resources from the extant literature. These experiential opportunities build students’ abilities to be flexible in “unlearning” traditional theories and serving diverse populations. The diversity of approaches reflects an opportunity for flexibility and creativity in classrooms as well as a threat to the standardized inclusion of multicultural competence to work with refugees across counseling. Part of the variability in how counselor educators are incorporating refugee concerns in their classes stems from the lack of intentionality with which it is addressed. For example, educators often wait for students to bring it up themselves rather than purposefully incorporating refugee concerns in the classroom. CACREP may more intentionally address forced migration and its effect on mental health to offer a framework for its inclusion in master’s-level courses and textbooks. A thorough list of competencies for working with refugee clients and ways of assessing and building these competencies could inform educational approaches. The challenges faced by counselor educators suggest future areas of advocacy needed for our profession to meet the counseling needs of refugee populations.

The Multicultural and Social Justice Counseling Competencies offered a framework advocating for counselors to understand the social context of their clients, intentionally broach concerns related to power and privilege, and advocate for systemic change (Ratts et al., 2016). For counselors to be prepared to utilize this framework with refugee clients, they must have basic knowledge of the sociopolitical context globally, an ability to confront their own biases and attitudes toward refugees, as well as skills to broach topics of power and privilege with refugee clients and to advocate for equitable access to counseling services. This study provides findings and resources counselor educators may utilize in their educational spaces, facilitating this competence for master’s-level counseling students.

Resources for Counselor Educators
     Participants discussed various methods such as utilizing film and literature, experiential learning, and case studies. They shared the importance of intentionally exposing students to migrant stories and experiences at the master’s level. Existing literature provides a few examples of assignments and useful resources. These might be adapted to different courses across the curriculum.

Incorporating literature and film in counseling courses may facilitate self-awareness and empathy. These also allow for experiential learning before the clinical courses. The United Nations (2022) published an article listing recent films on refugee stories that included Flee, Simple as Water, Encanto, Captains of Za’atari, and Three Songs for Benazir. The Penguin Book of Migration Literature presents a diverse collection of fiction and poetry from migrant perspectives throughout history. Houseknecht and Swank (2019) recommended asking students to search “interview with a refugee” on YouTube and identify a video that is at least 10 minutes long and write a reaction paper as if the interviewee was their client.

Experiential learning can encourage students to actively experiment and then bring back their learning and reflection into the classroom (Houseknecht & Swank, 2019). Service learning components within courses improved multicultural and social justice knowledge and skills (Midgett & Doumas, 2016). A cultural immersion and social action project may be useful in developing multicultural competence and social justice advocacy competence (Pechak et al., 2020). Service learning early in the program, while students are developing their conceptualizations of the counseling profession, may be more beneficial for students to gain social justice and multicultural competence skills (Midgett & Doumas, 2016). Students need applied experiences within the community to develop these skills (Midgett & Doumas, 2016). Houseknecht and Swank (2019) described a role-play activity to simulate counseling with an interpreter where the students who act as counselors and clients write their responses and the student acting as an interpreter reads them.

Participants shared the use of case studies, suggesting that those who have experience with refugees may build them from their experience. Case studies can provide an opportunity for students to conceptually apply skills such as diagnosis, treatment planning, case management, career counseling, and ethical decision-making. Snow et al. (2021) recommended the website iamanimmigrant.com as a source of immigrant stories. Kondili et al. (2022) presented two case studies that incorporate a community and advocacy approach. Case studies can be presented in various courses that allow for intersectional identities where immigration status is one factor that interacts with other aspects of the client’s social identities, the counselor’s social identities, and the overall context. Snow et al. (2021) also presented a useful case study and guide for counselor educators on ways to incorporate refugee concerns throughout various counseling courses.

Study Limitations
     The current study contributes to a deeper understanding of how counselor educators may attempt to incorporate refugee concerns and the challenges they face. However, it has some limitations. One main limitation was the lack of any demographic data on participants, which limits the information on context, such as the location in which the participants are teaching and their professional experience in the field. An online survey design was chosen because it may allow for more candid responses through anonymity and privacy (Blease et al., 2023). It also allowed participants to complete the study on their own time at their convenience, and it ensured complete anonymity. However, it did not allow further probes to gain further description or meaning behind the survey statements. The focus group partially filled that gap. The number of participants across both data collection methods was low, potentially because of the low number of counselor educators who incorporate refugee concerns into their courses.

Future Research
     The leaders of the counseling profession need to make it more likely that refugee clients can find counselors who can understand refugee experiences, promote mental health literacy among refugee communities, demonstrate respect, and assess clients’ understanding of mental health (Snow et al., 2021). Counselor educators have a responsibility to train counselors to become advocates with a social justice orientation (Clark et al., 2022). Further research can support counselor educators as they endeavor to train counselors and advocates addressing the refugee crisis. Theories of mental illnesses and their treatment that are indigenous to the populations served need to be identified and utilized within counseling. The need to continuously adapt Western models poses an accessibility barrier for non-Western groups. Building on the limitations of this study, future qualitative studies may further investigate the rewards and challenges related to incorporating refugee concerns into counseling classrooms. Quantitative studies could identify the effects of training counselors to work with refugees on students’ overall competence and the accessibility of counseling services to refugee populations and other underserved groups. The impact of the political environment devaluing and silencing equity approaches in education poses new barriers. This was a point that survey participants made but focus group participants did not discuss. This may be because they were not experiencing that barrier at the time. Research should explore how counselor educators navigate these challenges and their threats to our professional values. As demographic data was not collected for this study, further research could explore the connection between professional identity and context and their approaches to educating counselors on working with refugee clients.

Conclusion

Advocating for social justice and positive social change is an aspect of ethical professional identity for counselors and counselor educators (ACA, 2014). Increasing the competence of counseling professionals would make counseling more accessible to refugees, currently an underserved group. Professional counselors risk losing perspective on the societal and group dynamics of wellness when they provide mental health services in individualized settings. However, a commitment to equity, justice, and beneficence is a part of counselors’ professional ethics and identity (ACA, 2014). As health professionals, counselors must advocate for conditions that promote wellness within communities. Therefore, developing advocacy skills and a commitment to social justice is crucial to establishing cultural competence and ethical practice with refugee clients. With the rising numbers of refugees globally, there is a greater need for counselors who are trained and competent to counsel refugee populations; it may become more likely that counselors will encounter refugee clients in their careers. Counselors may need to grow their knowledge base, skills, and awareness related to refugee issues. Counselor preparation programs and supervisors play an important role in facilitating that competence. Further training and research in this area will support the multicultural and social justice competence of counselors to meet the growing need globally and in the United States.

Conflict of Interest and Funding Disclosure
The authors reported no conflict of interest
or funding contributions for the development
of this manuscript.

 

References

American Counseling Association. (2014). ACA code of ethics. https://bit.ly/acacodeofethics

Atiyeh, S., & Gray, G. (2022). Counsellors’ competency to counsel refugees: A constructivist grounded theory study. Counselling and Psychotherapy Research, 22(1), 32–42. https://doi.org/10.1002/capr.12477

Bartholomew, T. T., Gundel, B. E., Kang, E., Joy, E. E., Maldonado-Aguiñiga, S., Robbins, K. A., & Li, H. (2021). Integrating cultural beliefs about illness in counseling with refugees: A phenomenological study. Journal of Cross-Cultural Psychology, 52(8–9), 705–725.          https://doi.org/10.1177/00220221211038374

Bemak, F., & Chung, R. C.-Y. (2021). Contemporary refugees: Issues, challenges, and a culturally responsive intervention model for effective practice. The Counseling Psychologist, 49(2), 305–324. https://doi.org/10.1177/0011000020972182

Bengtsson, M. (2016). How to plan and perform a qualitative study using content analysis. NursingPlus Open, 2, 8–14. https://doi.org/10.1016/j.npls.2016.01.001

Blease, C., Torous, J., Dong, Z., Davidge, G., DesRoches, C., Kharko, A., Turner, A., Jones, R., Hägglund, M., & McMillan, B. (2023). Patient online record access in English primary care: Qualitative survey study of general practitioners’ views. Journal of Medical Internet Research, 25, e43496. https://doi.org/10.2196/43496

Cabell, A., Burgess, D., Brown, E., & Medina, C. (2024). Counseling trainees’ experiences working with Afghan refugees: Building cultural humility. Counselor Education and Supervision, 63(1), 41–57. https://doi.org/10.1002/ceas.12290

Church World Service. (2025). Daily state of play: Trump’s indefinite refugee ban and funding halt. https://cwsglobal.org/blog/daily-state-of-play-trumps-indefinite-refugee-ban-and-funding-halt

Clark, M., Moe, J., Chan, C. D., Best, M. D., & Mallow, L. M. (2022). Social justice outcomes and professional counseling: An 11-year content analysis. Journal of Counseling & Development, 100(3), 284–295. https://doi.org/10.1002/jcad.12427

Council for the Accreditation of Counseling and Related Educational Programs. (2023). 2024 CACREP standards. https://www.cacrep.org/for-programs/2024-cacrep-standards

Damra, J. K., & Qa’aymeh, S. (2024). Exploring the supervisory needs of school counselors in refugee school settings. International Journal for the Advancement of Counselling46, 703–720. https://doi.org/10.1007/s10447-024-09568-x

Duden, G. S., & Martins-Borges, L. (2021). Psychotherapy with refugees—Supportive and hindering elements. Psychotherapy Research, 31(3), 402–417. https://doi.org/10.1080/10503307.2020.1820596

Hosseini, Z., Syed, H., Raza, Z., Mansouri, M., Magan, I. M., & Awaad, R. (2023). A systematic review of evidence-based interventions for Afghan refugee mental health: A cultural adaptation analysis. Journal of Cross-Cultural Psychology, 55(1), 25–46. https://doi.org/10.1177/00220221231213884

Houseknecht, A., & Swank, J. (2019). Preparing counselors to work with refugees: Integration of experiential activities. Journal of Creativity in Mental Health, 14(1), 127–136. https://doi.org/10.1080/15401383.2019.1566039

Interiano-Shiverdecker, C. G., Kondili, E., & Parikh-Foxx, S. (2020). Refugees and the system: Social and cultural capital during U.S. resettlement. International Journal for the Advancement of Counselling, 42, 48–64. https://doi.org/10.1007/s10447-019-09383-9

Kondili, E., Interiano-Shiverdecker, C., & Hahn, C. (2022). Counseling and social justice advocacy interventions with refugees: Two case studies. Journal of Multicultural Counseling and Development, 50(4), 219–229. https://doi.org/10.1002/jmcd.12270

Kuo, B. C. H., Soucie, K., & Huang, S. (2020). Developing clinical trainees’ multicultural counseling competencies through working with refugees in a multicultural psychotherapy practicum: A mixed-methods investigation. International Journal for the Advancement of Counselling, 42, 249–268. https://doi.org/10.1007/s10447-019-09392-8

Midgett, A., & Doumas, D. M. (2016). Evaluation of service-learning-infused courses with refugee families. Journal of Multicultural Counseling and Development, 44(2), 118–134. https://doi.org/10.1002/jmcd.12041

O’Brien, C. V., & Charura, D. (2023). Refugees, asylum seekers, and practitioners’ perspectives of embodied trauma: A comprehensive scoping review. Psychological Trauma: Theory, Research, Practice, and Policy, 15(7), 1115–1127. https://doi.org/10.1037/tra0001342

Olmos-Vega, F. M., Stalmeijer, R. E., Varpio, L., & Kahlke, R. (2023). A practical guide to reflexivity in qualitative research: AMEE Guide No. 149. Medical Teacher, 45(3), 241–251. https://doi.org/10.1080/0142159X.2022.2057287

Pampati, S., Alattar, Z., Cordoba, E., Tariq, M., & Mendes de Leon, C. (2018). Mental health outcomes among Arab refugees, immigrants, and U.S.-born Arab Americans in southeast Michigan: A cross-sectional study. BMC Psychiatry, 18, Article 379. https://doi.org/10.1186/s12888-018-1948-8

Pechak, C., Howe, V., Padilla, M., & Frietze, G. A. (2020). Preparing students to serve a refugee population through a health-focused interprofessional education experience. Journal of Allied Health, 49(3), 131–138. https://www.proquest.com/scholarly-journals/preparing-students-serve-refugee-population/docview/2441573255/se-2

Prasad, B. D. (2019). Qualitative content analysis: Why is it still a path less taken? Forum: Qualitative Social Research, 20(3), 36. https://www.qualitative-research.net/index.php/fqs/article/view/3392/4502

Ratts, M. J., Singh, A. A., Nassar-McMillan, S., Butler, S. K., & McCullough, J. R. (2016). Multicultural and social justice counseling competencies: Guidelines for the counseling profession. Journal of Multicultural Counseling and Development, 44, 28–48. https://doi.org/10.1002/jmcd.12035

Refugee Council USA. (2024). 2024 fiscal year: US refugee admissions. https://rcusa.org/wp-content/uploads/2024/10/FY24-Refugee-Arrivals-Report.pdf

Rometsch, C., Denkinger, J. K., Engelhardt, M., Windthorst, P., Graf, J., Nikendei, C., Zipfel, S., & Junne, F. (2020). Care providers’ views on burden of psychosomatic symptoms of IS-traumatized female refugees participating in a humanitarian admission program in Germany: A qualitative analysis. PLoS ONE, 15(10), e0239969. https://doi.org/10.1371/journal.pone.0239969

Salami, B., Salma, J., & Hegadoren, K. (2019). Access and utilization of mental health services for immigrants and refugees: Perspectives of immigrant service providers. International Journal of Mental Health Nursing, 28(1), 152–161. https://doi.org/10.1111/inm.12512

Sandelowski, M. (2000). Whatever happened to qualitative description? Research in Nursing & Health, 23(4), 334–340. https://doi.org/fvxrh4

Sandelowski, M. (2010). What’s in a name? Qualitative description revisited. Research in Nursing & Health, 33(1), 77–84. https://doi.org/10.1002/nur.20362

Satinsky, E., Fuhr, D. C., Woodward, A., Sondorp, E., & Roberts, B. (2019). Mental health care utilisation and access among refugees and asylum seekers in Europe: A systematic review. Health Policy, 123(9), 851–863. https://doi.org/10.1016/J.HEALTHPOL.2019.02.007

Snow, K. C., Harrichand, J. J. S., & Mwendwa, J. M. (2021). Advocacy and social justice approaches with immigrants and refugees in counsellor education. Canadian Journal of Counselling and Psychotherapy, 55(1), 7–27. https://doi.org/10.47634/cjcp.v55i1.68482

Tribe, R. H., Sendt, K., & Tracy, D. K. (2019). A systematic review of psychosocial interventions for adult refugees and asylum seekers. Journal of Mental Health, 28(6), 662–676. https://doi.org/10.1080/09638237.2017.1322182

The UN Refugee Agency. (2025). Figures at a glance. https://www.unhcr.org/about-unhcr/overview/figures-glance

USA for the UN Refugee Agency. (2022). Oscars 2022: Five powerful movies about the refugee crisis. https://www.unrefugees.org/news/oscars-2022-five-powerful-movies-about-the-refugee-crisis

U.S. Department of State. (2018). Admissions & arrivals. http://www.wrapsnet.org/admissions- and-arrivals

 

Shadin Atiyeh, PhD, NCC, ACS, LPC, CCC, CRC, is an assistant professor at Wayne State University and was a 2017 Doctoral Fellow in Mental Health Counseling with the NBCCF Minority Fellowship Program. Correspondence may be addressed to Shadin Atiyeh, 5425 Gullen Mall, Detroit, MI 48202, shadin.atiyeh@wayne.edu.

Multicultural Competence and the Working Alliance as Predictors of Client Outcomes

Jessica Gonzalez, Sejal M. Barden, Julia Sharp

 Exploring client outcomes is a primary goal for counselors; however, gaps in empirical research exist related to the relationship between client outcomes, the working alliance, and counselor characteristics. Thus, the purpose of this investigation was to explore the relationship between the effects of multicultural competence and the working alliance on client outcomes from both client (n = 119) and counselor-in-training (n = 72) perspectives, while controlling for social desirability. Hierarchical regression results indicated counselors-in-training’s perceptions of multicultural competence and client outcome pretest scores were a significant predictor of client outcomes, after controlling for social desirability. Linear mixed effects modeling indicated significant differences in perceptions between both clients and counselors on the working alliance and multicultural competence. Findings highlight the importance of exploring what has already been working for clients before coming to counseling. Additionally, counselors are encouraged to self-reflect and explore how their clients view the relationship between the working alliance and multicultural competence.


Keywords:
client outcomes, multicultural competence, working alliance, social desirability, client perspective

 

The past three decades of research have identified the therapeutic relationship between client and counselor as the most important predictor of change in counseling for clients (Ardito & Rabellino, 2011; Horvath & Bedi, 2002; Norcross, 2002); however, there is limited research on the associations between the working alliance and multicultural competence. Cultivating multicultural competence for counselor trainees has been the focus of considerable empirical research (Horvath & Bedi, 2002), yet the majority of studies have focused on trainees’ self-report of multicultural competence, failing to account for clients’ perceptions of trainees’ competencies (Constantine, 2001; Fuertes et al., 2006). Specifically, more research is needed exploring the influence of multicultural competence as perceived by both clients and counselors-in-training (CITs) on client outcomes (Hays & Erford, 2017; Katz & Hoyt, 2014).

Working Alliance and Client Outcomes

The working alliance is a collaborative approach that refers to the extent of agreement between clients and counselors on the goals, tasks (how to accomplish goals), and bond (development of personal bond between client and counselor) in counseling (Horvath & Greenberg, 1989). The working alliance has been identified as a key factor in positive client outcomes, despite choice of treatment modality or counseling setting (Bachelor, 2013; Baldwin, Wampold, & Imel, 2007). Considerable research has been conducted on the working alliance in relation to clients’ and CITs’ perceptions and client outcomes. Research has shown consistent similarities and differences between clients’ and counselors’ perceptions of the working alliance (Bachelor, 2013; Fitzpatrick, Iwakabe, & Stalikas, 2005; Hatcher & Barends, 1996). For example, Huppert et al. (2014) looked at the effect of counselor characteristics and the therapeutic alliance on client outcomes for clients receiving cognitive behavioral therapy for panic disorder with agoraphobia. The working alliance was measured in Sessions 3 and 9. Multilevel modeling indicated that counselors’ involvement in the alliance predicted attrition. However, client perspective of the working alliance predicted both client outcomes and attrition in counseling.

Studies such as Huppert et al. (2014) highlight the important role that the working alliance has in client outcomes in counseling. However, Drisko (2013) acknowledged that the therapeutic relationship is not the sole predictor of client outcomes and highlighted that additional factors in counseling, combined with a strong therapeutic relationship, can influence outcomes. Other common factors can include client motivation and counselor characteristics such as multicultural competence. Collins and Arthur (2010) described the working alliance as the cornerstone in the counseling process that facilitates a transformative collaborative approach in helping clients explore and understand their cultural self-awareness.

Multicultural Competence and Client Outcomes

In 1992, Sue, Arredondo, and McDavis developed the Multicultural Counseling Competencies, and in 1996 Arredondo and colleagues presented a paper outlining the Tripartite Model of Multicultural Counseling that categorized multicultural competence into three factors: awareness, knowledge, and skills. More recently, the Association for Multicultural Counseling and Development and the American Counseling Association (ACA) have endorsed a set of updated competencies, including a social justice framework entitled the Multicultural and Social Justice Counseling Competencies (MSJCC; Ratts, Singh, Nassar-McMillan, Butler, & McCullough, 2015). Research supports positive associations between clients’ perceptions of their counselors’ multicultural competence and (a) client outcomes (Owen, Leach, Wampold, & Rodolfa, 2011); (b) the counseling relationship (Fuertes & Brobst, 2002; Fuertes et al., 2006; Li & Kim, 2004; Pope-Davis et al., 2002); and (c) satisfaction with counseling (Constantine, 2002; Fuertes & Brobst, 2002). These associations show how influential clients’ perceptions of their counselors’ multicultural competence are based on a variety of aspects of the counseling process. However, the majority of studies have focused on exploring counselors’ multicultural competence from only the counselor’s perspective (Worthington, Soth-McNett, & Moreno, 2007).

Self-report multicultural measures have been criticized for being prone to participants responding in a socially desirable manner and having a tendency to measure anticipated behaviors of multicultural competence rather than actual behaviors and attitudes of multicultural competence (Constantine & Ladany, 2000; Worthington, Mobley, Franks, & Tan, 2000). In addition, counselors’ ratings of their multicultural competence can differ from ratings from an observer (e.g., supervisor; Worthington et al., 2000) or their client (Smith & Trimble, 2016). Social desirability is a response bias in which research participants attempt to make a good impression when completing research studies by answering in an overly positive manner (Crowne & Marlowe, 1960). One way researchers can minimize the potential threat of social desirability is to input a social desirability scale (Drisko, 2013) and to control for social desirability, which can improve the accuracy of the research design (McKibben & Silvia, 2016).

In addition to the majority of studies only looking at counselors’ perspectives, there is a need for further research on how CITs’ multicultural competence associates with client outcomes (D’Andrea & Heckman, 2008). For example, Soto, Smith, Griner, Rodríguez, and Bernal (2018) conducted a meta-analysis looking at how many studies have explored how client outcomes are related to their counselors’ level of multicultural competence. Only 15 studies were found that explored client outcomes and counselors’ multicultural competence. From the 15 studies, 73% appeared since 2010, including several unpublished dissertations (40%). The fact that only 15 studies were identified that met inclusion criteria for this study and were found several decades after the multicultural competencies have emerged suggests the need for further investigation on this topic (Soto et al., 2018). Two specific studies, Owen et al. (2011) and Tao, Owen, Pace, and Imel (2015), explored the relationships between multicultural competence and the counseling process. Owen and colleagues’ findings indicated a   positive association between clients’ ratings of their counselors’ multicultural competence and client outcomes. Tao and colleagues’ meta-analysis comparing the correlations and effect sizes between quantitative studies (between the years of 2002–2014) of multicultural competence and other measures of the clinical process indicated that clients ratings of their counselors’ multicultural competence accounted for 37% of the variance in the working alliance. Owen et al.’s and Tao et al.’s findings highlight the need to further explore the dynamics between clients’ and counselors’ perceptions of multicultural competence and the working alliance.

Overall, the lack of multicultural competence outcome research may be a hindrance to counselors being able to fulfill the ACA Code of Ethics because of a lack of empirical justification (D’Andrea & Heckman, 2008). In order for multicultural competence scholarship to further advance, professional counseling organizations and scholars (ACA, 2014; Bachelor, 2013; Council for Accreditation of Counseling and Related Educational Programs, 2016; Owen et al., 2011) recommend exploring how multicultural competence may influence client outcomes. Additionally, research is needed exploring the similarities and differences between clients’ and counselors’ views on the working alliance and multicultural competence. Further, in self-report counseling investigations, researchers can minimize potential threat to the study by using a social desirability scale as a control variable (Drisko, 2013; McKibben & Silvia, 2016). Thus, the purpose of this investigation was to explore the relationship between the effects of multicultural competence and the working alliance on client outcomes from both client and CIT perspectives, while controlling for social desirability.

As such, we aimed to answer three research questions: (a) Do CITs’ multicultural competence and the working alliance (as perceived by clients) predict client outcomes, while controlling for social desirability from the client’s perspective? (b) Do CITs’ multicultural competence and the working alliance (as perceived by counselors) predict client outcomes, while controlling for social desirability from the CIT’s perspective? and (c) What differences exist between clients’ and CITs’ perceptions of CITs’ multicultural competence and the working alliance, while controlling for social desirability?

Method

Participants

This investigation was conducted at a university-based community counseling research center located in the southeastern region of the United States. The primary investigator worked in the clinic in which the research study was conducted; thus, convenience sampling was used. CITs’ criteria to participate in this study was that the student had to be enrolled in their first or second semester of practicum in a master’s-level counselor education program. In addition, client criteria to participate was that they had to be an adult (over the age of 18) receiving counseling services from the CITs at the counseling research center. A total of 146 adult clients and 85 CITs participated in this study. Missing values and clients who completed the assessments more than twice were removed, yielding a response rate of 82% for clients and 84% for CITs.

Client participants self-identified as female (n = 71, 59.7%) and male (n = 48, 40.3%). The number of clients by age range was: 18–30 (n = 56, 47.1%), 31–40 (n = 27, 47.1%), 41–50 (n = 22, 18.5%), 51–60 (n = 12, 10.1%), and 61–65 (n = 2, 1.7%). Lastly, clients identified as White (n = 64, 53.8%), African American/Black (non-Hispanic, n = 21, 17.6%), Hispanic/Latino (n = 20, 16.8%), Biracial/Multiracial (n = 7, 5.9%), American Indian (n = 2, 1.7%), Asian (n = 1, 8%), and Other (n = 4, 3.4%). CIT participants self-identified as female (n = 61, 84.7%) and as male (n = 11, 15.3%). A majority of counselors were between the ages of 21–26 (n = 54, 75%), followed by 27–37 (n = 18, 25%). CITs identified as White (n = 48, 66.7%), African American/Black (non-Hispanic, n = 7, 9.7%), Hispanic/Latino (n = 7, 9.7%), Biracial/Multiracial (n = 8, 11.1%), Asian (n = 1, 1.4%), and Other (n = 1, 1.4%).

Procedure

Approval to conduct the study was obtained from the university’s institutional review board and the clinical director of the counseling research center. First, the researcher administered the consent for research during CITs’ practicum orientation and explained the purpose and voluntary nature of the study. CITs received instructions on how to administer consent for research to clients. Counselors received small tokens (a mechanical pencil and a small piece of candy) from the researcher during the practicum orientation as an incentive to complete the surveys and provide them to clients. Clinic services where the research was conducted include free counseling. Clients were already receiving free counseling services, and if they chose not to participate in this study, they would still continue to receive free counseling.

The researcher instructed CITs to provide clients with the explanation of research at the start of their first counseling session. If clients chose to participate, the CIT administered the Outcome Questionnaire 45.2 (OQ45.2; Lambert et al., 1996) assessment at the end of their first and third sessions in the counseling room. In addition, clients and CITs were instructed to complete the demographic questionnaire, the Cross-Cultural Counseling Inventory-Revised (CCCI-R; LaFromboise, Coleman, & Hernandez, 1991), the Working Alliance Inventory-Short Form (WAI-S; Horvath & Greenberg, 1989; Tracey & Kokotovic, 1989), and the Reynolds Marlowe-Crown Social Desirability Scale-Short Form A (SDS; Reynolds, 1982) after their third session was completed. Data were collected after completion of the third counseling session based on preliminary analysis on adult client retention rates at the counseling research center indicating that after the fourth counseling session, client retention rate drops by 60%. In addition, the working alliance is generally measured between the first and fifth sessions (Horvath & Bedi, 2002; Norcross, 2002).

Data were entered and then analyzed by SPSS. Prior to beginning analysis, several preliminary analyses were conducted to explore relationships among variables. Assumptions for normality, homogeneity of variance, linearity, and multicollinearity were met. To reduce the likelihood of violating the assumption of independence, clients were used as a static variable, or a variable that only has one independent observation. Utilizing static variables was important due to the possibility for the same client to have received counseling services during the two semesters in which the researcher collected the data, increasing the potential violation for the assumption of independence. Thus, if the same client had multiple ratings on assessments, they were removed from the data set, resulting in the removal of three clients. Researchers used correlation analysis, hierarchical regression, and linear mixed-effects modeling to explore their research questions.

Measures

The CCCI-R (LaFromboise et al., 1991) was used to measure client and counselor perceptions of CIT multicultural counseling competence in this investigation. The CCCI-R was developed based on the multicultural competencies defined by the Education and Training Committee of Division 17 of the American Psychological Association (Sue et al., 1982). The CCCI-R is a 20-item assessment, rated on a 6-point Likert scale intended for observer report of a counselor’s level of cultural awareness, knowledge, and skill. LaFromboise and colleagues (1991) reported an overall internal consistency coefficient alpha of .95, with an inter-item correlation between .18 and .73. Although the CCCI-R was developed to be completed by supervisors, it has been adapted for use with counselors and clients (e.g., Client: My counselor is aware of his or her own cultural heritage; Counselor: I am aware of my own cultural heritage; Fuertes et al., 2006; Owen et al., 2011). The CCCI-R is scored utilizing total scores, with higher scores indicating more perceived multicultural competence. Cronbach’s alpha results for this study were .92 for clients and .85 for CITs (Lafromboise et al., 1991).

The WAI-S (Horvath & Greenberg, 1989; Tracey & Kokotovic, 1989) was used to measure client and CIT perceptions about the strength of the working alliance relationship in counseling. The WAI-S is a 12-item assessment rated on a 7-point Likert scale ranging from 1 to 7 (1 = never to 7 = always), intended to measure the strength of the therapeutic relationship as perceived by client and counselor (e.g., Client: I am confident in my counselor’s ability to help me; Counselor: I am confident in my ability to help my client; Bachelor, 2013; Fitzpatrick et al., 2005; Hatcher & Barends, 1996). Tracey and Kokotovic (1989) indicated strong internal consistency for both the client version (α = .98) and the counselor version (α = .95) of the WAI-S. The WAI-S total score is the summation of three subscales (task, bond, and goal), with higher scores indicating a stronger therapeutic relationship. Cronbach’s alpha results for this study were .82 for clients and .81 for CITs.

The SDS (Reynolds,1982) was used to measure social desirability in this study. The SDS is a shortened version of the original Marlow Crowne Social Desirability Scale (MCSDS; Crowne & Marlow, 1960). The SDS is an 11-item dichotomous (i.e., 0 = True, 1 = False) scale designed to assess whether participants are responding truthfully in response to assessments or answering in a biased way to put forward a more socially desirable self-image (e.g., I’m always willing to admit when I make a mistake). Scoring ranges from 0–11, with a higher score indicating participant likelihood of answering in a socially desirable manner to avoid disapproval from others. Reliability for the shortened social desirability scales has been adequate (Reynolds, 1982). Cronbach’s alpha results for this study were .68 for clients and .73 for CITs. Clients’ SDS Cronbach’s alpha levels were slightly lower than the CITs’ levels; however, some authors, such as Aiken (2000), have indicated that a Cronbach’s alpha between .60 and .70 is adequate, and Streiner (2003) has indicated that the reliability on a scale of clinical samples such as the clients in this study can be different than those measured on the general population.

The OQ 45.2 (Lambert et al., 1996) contains 45 items rated on a 5-point Likert scale ranging from 0–4 (0 = almost always to 4 = never) and intended to measure clients’ distress status (e.g., I feel blue; I feel lonely). The OQ 45.2 has been used in various settings, including community clinics in a university setting similar to the one in this investigation (e.g., Wolgast, Lambert, & Puschner, 2004). The OQ 45.2 total score consists of the sum of scores of three subscales (i.e., symptomatic distress, interpersonal relationships, and social roles) and the reverse scores of nine items, with higher scores indicating more distress among clients. The total score cut off is set at 63, indicating that scores above 63 are of clinical significance (Lambert et al., 1996). Reported overall internal consistency for OQ total score (α = 93) and three subscales (α = .70) is strong (Lambert et al., 1996). Cronbach’s alpha results for this study were .82 for the OQ 45.2 pretest and .83 for the OQ 45.2 posttest.

Results

Average total scores for clients on the OQ 45.2 pretest, completed on the first session, were M = 69.37 and SD = 25.009. Average OQ 45.2 posttest scores, completed on the third session, were M = 63.73 and SD = 27.56. Average total SDS scores for clients were M = 5.74 and SD = 2.27, and average scores for CITs were M = 5.71 and SD = 2.66. Average total score of clients’ CCCI-R ratings of their CITs’ multicultural competence after completion of the third counseling session were M = 102.81 and SD = 10.42. CITs’ ratings of their own multicultural competence were M = 96.98 and SD = 7.66. Lastly, average total WAI-S scores for clients were M = 64.63 and SD = 8.0, and CITs’ scores were M = 59.40 and SD = 7.61.

A Pearson product two-tailed correlation identified four significant relationships between the variables with effect sizes ranging from small to large (Cohen, 1992). Positive relationships were indicated between clients’ perceptions of CITs’ multicultural competence and the working alliance (r =.571, p <.05), as well as CITs’ perceptions of their multicultural competence and the working alliance (r = .623, p < .05), and between the OQ 45.2 pre- and posttest scores (r = .884, p < .05). Further, a positive relationship was found between clients’ and counselors’ perceptions of the working alliance (r = .199, p < .05) and between social desirability scores on CITs’ CCCI-R responses (r = .233, p < .05); however, the effect sizes were small. The positive relationships indicate that the direction of one construct is associated with the direction of the other. For example, how a client rates their CIT’s multicultural competence is associated with the strength (high or low) of the working alliance. Lastly, a negative relationship was found between clients’ social desirability scores with both client outcome OQ 45.2 pretest scores (r = -.233, p < .05) and OQ 45.2 posttest scores (r = -.277, p < .05). This negative relationship means that higher scores on one instrument are associated with lower scores on another.

Predictors of Client Outcomes

In order to assess whether multicultural competence or the working alliance predicted client outcomes, the third-session OQ 45.2 posttest score was the dependent variable and the pretest score of the OQ 45.2 was the control variable. A hierarchical regression is used when the researcher has a theoretical basis to specify the order in which the independent variables are entered into the model (Tabachnick & Fidell, 2013). In the following analyses, social desirability and OQ 45.2 first-session scores were used as control variables. It is common practice within social sciences to use pretest scores as a control variable and posttest scores as a dependent measure in order to reduce error variance and create more powerful tests for data analysis (Tabachnick & Fidell, 2013). Also, social desirability was used as a control variable because of the relationships indicated in the correlation analysis with SDS, OQ 45.2, and CITs’ CCCI-R responses. Further, SDS scores were used as a control variable to minimize potential threat to the study (Drisko, 2013), which can improve the accuracy of the research design (McKibben & Silvia, 2016), because self-report measures have been shown to have a strong likelihood of participants responding in a socially desirable manner (DeVellis, 2003; Gall, Gall, & Borg, 2007).

Hierarchical multiple regression analysis was used to explore whether CITs’ multicultural competence (CCCI-R) and working alliance (WAI-S; as perceived by clients) predicted client outcome (OQ 45.2 pretest), while controlling for social desirability (SDS) from clients’ perspective and clients’ outcome pretest scores (OQ 45.2 posttest). Client outcome OQ 45.2 pretest scores and SDS scores were entered in the first block, explaining 78.6% [F (2, 116) = 213.3, p < .05] of the variance in client outcome OQ 45.2 posttest scores. After entry of clients’ CCCI-R and WAI-S total scores in the second block, the total variance explained by the model as a whole was 78.9%, [F (4, 114) = 106.80 p < .05]. The introduction of clients’ CCCI-R and WAI-S scores only explained an additional variance of 0.3%, after controlling for client pretest scores and social desirability [R2 change = .003, F (2, 114) = .851, p > .05]. In the final model, only one of the four predictor variables was statistically significant, client outcome pretest score (b = .859, p < .05; see Table 1). The final model indicated a large effect size (R2 = .789; Cohen, 1992). Close to 79% of the variance in posttest scores was accounted for by OQ 45.2 first-session scores on client outcomes, after controlling for social desirability response.

 

Table 1

Hierarchical Regression Client Perspective

B SE b β

 

R2

 

ΔR2
Step 1: Control Variables

Client Outcome Pretest

Client Social Desirability

 

 

.954

-.913

 

.049

.534

 

.866*

-.076

.786

 

.786*

 

 

Step 2: Client Perspective

Client Outcome Pretest

Client Social Desirability

Client CCCI-R

Client WAI-S

 

.947

-.991

.183

-.119

 

.049

.547

.140

.152

 

.859*

-.082

.069

-.041

 

.789

 

 

.003

 

 Note. N = 119 clients; CCCI-R Counselor Multicultural Competence; WAI-S Working Alliance. *p < .05.
Dependent Variable: Client Outcome Posttest.

 

Another hierarchical multiple regression analysis was used to explore whether CITs’ multicultural competence (CCCI-R) and working alliance (WAI-S; as perceived by counselors) predicted client outcomes (OQ 45.2 pretest), while controlling for social desirability (SDS) from the CITs’ perspective (OQ 45.2 posttest). Client outcome pretest score and CITs’ SDS total scores were entered in the first block, explaining 78.1% of the variance [F (2,116) = 206.60, p < .05] in client outcome OQ 45.2 posttest scores. After entry of counselors’ CCCI-R and WAI-S total scores in the second block, the total variance explained by the model as a whole was 79.6% [F (4,114) = 111.38, p < .05]. The introduction of counselors’ CCCI-R and WAI-S scores explained an additional variance of 1.5%, after controlling for client pretest score and social desirability [R2 change = .015, F (2, 114) = 4.32, p < .05]. In the final model, two of the four predictor variables were statistically significant: client outcome pretest score (b = .894, p < .05) and counselors’ CCCI-R (b = -.157, p < .05; see Table 2). The final model indicated a large effect size (R2 =.796; Cohen, 1992). In this model, 80% of the variance in posttest scores was accounted for by OQ 45.2 first session scores on client outcomes and CITs’ multicultural competence, after controlling for social desirability response.

The final research question explored the differences that exist between clients’ and counselors’ perceptions of CITs’ multicultural competence and the working alliance, while controlling for social desirability. In order to resolve the possibility of non-independence in this data set (West, Welch, & Galecki, 2007), a linear mixed-effects model was used to compare clients and counselors (fixed effect) for the dependent variables of multicultural competence and the working alliance. Thus, accounting for client observations nested within counselors (i.e., some CITs had several clients). There was a significant difference between counselor and client perceptions of CITs’ multicultural competence while controlling for social desirability: [F (1,174.38) = 30.43, p < 0.05]. The average CCCI-R score for clients was 5.91 more than the average for CITs, after controlling for social desirability. Similarly, there was a significant difference between counselor and client perceptions of the working alliance (WAI-S): [F (1, 176.20) = 79.98, p < 0.05]. The average WAI-S score for clients was 9.85 more than the average for CITs, controlling for social desirability. Thus, clients rated CITs’ multicultural competence and the working alliance higher than CITs rated themselves.

 

Table 2

Hierarchical Regression Counselor Perspective

B SE b β

 

R2 ΔR2
Step 1: Control Variables

Client Outcome Pretest

Counselor Social Desirability

 

.974

.012

 

.048

.450

 

.884

.001

.781

 

.781*

 

 

Step 2: Counselor Perspective

Client Outcome Pretest

Counselor Social Desirability

Counselor CCCI-R

Counselor WAI-S

 

 

.985

.282
-.563

.192

 

.047

.451

.198

.167

 

.894*

.027

-.157*

.062

.796

 

 

.015*

 

Note. N = 72 clients; CCCI-R Counselor Multicultural Competence; WAI-S Working Alliance. *p <.05.
Dependent Variable: Client Outcome Posttest.

 

Discussion

The aim of this investigation was to explore the relationship between client outcomes, counselors’ multicultural competence, the working alliance, and social desirability from both clients’ and CITs’ perspectives. Hierarchical regression results indicated that clients’ perspectives of their CITs’ multicultural competence and the working alliance did not predict client outcomes, although CITs’ perceptions of their multicultural competence did, modestly, after controlling for counselors’ social desirability scores. In a related investigation, Owen et al. (2011) compared differences in perceptions of counselors’ multicultural competence between clients and CITs. Results from their intra-class correlation (ICC) analysis indicated that CITs’ perceptions accounted for 8.5% (ICC = .085) of the variance in client outcomes, although clients’ perceptions of CITs’ multicultural competence were not related to clients’ counseling outcomes, which is consistent with the findings from this investigation. In contrast, results from this investigation on the working alliance and lack of predictive ability on client outcomes are incongruent with previous research that indicates a strong association between the working alliance and client outcomes (Horvath, Del Re, Flückiger, & Symonds, 2011; Norcross, 2011). Although results from one hierarchical regression did not indicate significant predictability of the working alliance on client outcomes, a Pearson product correlation conducted before regression analysis supported the positive associations between clients’ perceptions of CITs’ multicultural competence and the working alliance, as well as CITs’ perceptions of their multicultural competence and the working alliance. Further, correlational results indicated a small association between clients’ and CITs’ perceptions of the working alliance, and between CITs’ social desirability scores and CCCI-R responses.

Potential explanations for some of the insignificant findings in this investigation include the cross-sectional research design on the constructs of multicultural competence and the working alliance. In a cross-sectional research design, the researcher looks at a snapshot of constructs at one point in time (Gall et al., 2007). In this investigation, multicultural competence and the working alliance were assessed after the third session for both clients and counselors. Thus, assessing multicultural competence and the working alliance after the third session may not have been enough time for clients to evaluate their counseling relationship or their CITs’ multicultural competence. For example, Fitzpatrick et al. (2005) explored clients’ perceptions of the working alliance utilizing the WAI-S over three phases of counseling (e.g., early: 2–4 sessions; middle: midpoint; late: fourth, third, or second to last). Fitzpatrick and colleagues (2005) conducted a MANOVA with two within-subject design factors. The two factors were phases of counseling (i.e., early, middle, late) and WAI subscales (i.e., task, bond, goal). Results indicated as a whole, client-rated alliance increased over time. Therefore, results of this analysis may have been different if multicultural competence and the working alliance were measured over time.

Linear modeling results indicated significant differences between client and CIT perceptions of the working alliance and counselors’ multicultural competence after controlling for social desirability. In addition, upon inspection of the mean scores between clients and CITs, clients rated their CITs’ multicultural competence and the working alliance higher than CITs rated their multicultural competence and the working alliance. Similar to this investigation, Depue, Lambie, Liu, and Gonzalez (2016) found significant differences on client and CIT ratings of the working alliance, with clients rating the working alliance higher than counselors. Contrastingly, Fuertes and colleagues (2006) found no significant differences between the working alliance for clients or CITs and significant differences between perceptions of counselors’ multicultural competence, with CITs’ ratings being higher than clients, highlighting mixed research findings.

A factor that may influence the perceptions of clients and CITs is the way clients and counselors would define counseling terms. First, clients and CITs may differ in their definition of what a quality therapeutic relationship or what a culturally responsive CIT looks like. For example, counselors may view the strength of the therapeutic relationship based on client progress (Bachelor & Horvath, 1999), while clients may view the quality of the relationship based on how much unconditional positive regard they sense from their counselors (Norcross, 2011). Similarly, with multicultural competence, Pope-Davis et al. (2002) suggested that clients may not perceive multicultural competence in the same way as counselors. A common theme found in Pope-Davis et al.’s (2002) qualitative investigation on client perceptions of culturally relevant components in counseling indicated that the need for integration of culture in counseling was only relevant if the client self-identified their culture as a core value in their life. On the other hand, counselors may view their level of multicultural competence based on how much knowledge they have about their clients’ cultures.

Second, counselors’ level of experience might influence the way they rate themselves. For example, novice counselors, such as the participants in this investigation, often have anxiety that can negatively influence their beliefs about their counseling performance (Rønnestad & Skovholt, 2003; Stoltenberg & McNeill, 2010). Barden and Greene (2015) explored the relationship between counselor education students’ levels of self-reported multicultural counseling competence and multicultural counseling self-efficacy, with results indicating that students who had been in graduate education longer had higher self-reported multicultural counseling competence and higher levels of multicultural knowledge, highlighting a potential explanation for lower multicultural competence ratings in the current investigation.

Implications for Counselors

In this investigation, results highlighted that clients and CITs perceive the working alliance and counselors’ multicultural competence differently. Counselors might want to give assessments such as the CCCI-R (LaFromboise et al., 1991) or the WAI-S (Tracey & Kokotovic, 1989) in session to facilitate discussions with clients. For example, if counselors see that their client strongly disagrees with the CCCI-R assessment question 20, “My counselor acknowledges and is comfortable with cultural differences,” counselors can utilize this as a discussion point to address any cultural differences that may be interfering with the counseling process. Furthermore, in this study, positive relationships were shown between clients’ and counselors’ perceptions of counselors’ multicultural competence and the working alliance. Given these associations, counselors are encouraged to self-reflect and explore how their clients view the relationship between the working alliance and multicultural competence. Slone and Owen (2015) explored the relationship between the effects of the therapeutic relationship, counselors’ level of comfort in session, and the systematic alliance on client outcomes between counselors and clients. Multilevel model analysis revealed that client outcome improved when counselors checked in with clients about how the therapeutic relationship was going, when counselors had a high comfort level in session, and when clients had perceived interpersonal networks that aligned with the goals and tasks in counseling. Thus, counselors are encouraged to check in with clients about their views at multiple times throughout the counseling process. For example, CITs can ask clients probing points early on to promote discussion on the working alliance and multicultural competence, such as, “What are you looking for in a counseling relationship?” or “Please tell me a little bit about your culture.” Moreover, counselors can check in with a client mid-session and ask, “How has our counseling relationship been going?” or “What would improve our counseling relationship?”

This study also highlighted the importance of exploring what has already been working for clients before coming to counseling. The therapeutic relationship has been shown to have the most explained variance in client outcomes (Norcross, 2011; Wampold & Imel, 2015); however, in this investigation, it was found that 80% of the variance in client outcomes after the third session was predetermined. Given that close to 80% of the variance in posttest scores were accounted for by OQ 45.2 first-session scores on client outcomes after controlling for social desirability responses, counselors are encouraged to explore what coping strategies clients are already using that have been helpful with their clients’ presenting issues during the first session. In addition, counselor educators can consider that three weeks of counseling may not be enough time to show clinically significant change in client outcomes. Furthermore, three weeks in counseling may not be enough time to show how the working alliance and CITs’ multicultural competence may influence client outcomes. Lastly, given that there was a positive relationship between CITs’ social desirability scores and their ratings of their multicultural competence, counselor educators who supervise CITs are encouraged to explore their supervisees’ expectations and comfort in discussing developing multicultural competence.

Limitations and Suggestions for Future Research

The first limitation is that the multicultural competence and working alliance assessments were collected in a cross-sectional manner, limiting the results to a singular time point. Second, the generalizability to populations other than novice counselors or clients within a university setting is low. Third, at the time data collection for this investigation was completed, there was not a validated formative assessment developed to explore the updated social justice framework based on the new MSJCC competencies, so the instrument used was based on the Multicultural Competence Tripartite Model. Despite the limitations from this investigation, the use of a social desirability scale, an emphasis on both clients’ and CITs’ perceptions, and the study’s implications contribute to the empirical research on multicultural competence and the working alliance.

There are several implications for future research that are suggested from this study. First, researchers can conduct a longitudinal design and increase data collection points for assessing client outcome (e.g., first, fifth, tenth, and fifteenth sessions) to determine if and when clinically significant change in client outcomes occurs. Second, further exploration is needed of the perceptions of counselors who have completed their training programs to see how results may differ. Third, researchers are encouraged to develop a formative assessment tool to explore the new MSJCCs (Ratts et al., 2015) and replicate a similar study. Researchers are encouraged to explore, from the clients’ perspectives, how their counselors are implementing multicultural and social justice competencies. Fourth, investigators can implement a mixed method design (e.g., qualitative and quantitative) to explore factors that influence client outcomes for brief therapy. Utilizing a qualitative component may help counselors and counselor educators gain insight into what clients perceive a culturally sensitive counselor to be or what a strong working alliance looks like. Lastly, counselor educators can continue to investigate how social desirability, if at all, influences participants’ responses on counseling assessments.

Conflict of Interest and Funding Disclosure

The authors reported no conflict of interest

or funding contributions for the development

of this manuscript.

 

References

Aiken, L. R. (2000). Psychological testing and assessment (10th ed.). Boston, MA: Allyn & Bacon.

American Counseling Association. (2014). ACA code of ethics. Alexandria, VA: Author.

Ardito, R. B., & Rabellino, D. (2011). Therapeutic alliance and outcome of psychotherapy: Historical excursus, measurements, and prospects for research. Frontiers in Psychology, 2, 270. doi:10.3389/fpsyg.2011.00270

Arredondo, P., Toporek, R., Brown, S. P., Jones, J., Locke, D. C., Sanchez, J., & Stadler, H. (1996). Operationalization of the multicultural counseling competencies. Journal of Multicultural Counseling and Development, 24, 42–78. doi:10.1002/j.2161-1912.1996.tb00288.x

Bachelor, A. (2013). Clients’ and therapists’ views of the therapeutic alliance: Similarities, differences and relationship to therapy outcome. Clinical Psychology & Psychotherapy, 20(2), 118–135. doi:10.1002/cpp.792

Bachelor, A., & Horvath, A. (1999). The therapeutic relationship. In M. A. Hubble, B. L. Duncan, & S. D. Miller (Eds.), The heart and soul of change: What works in therapy (pp. 133–178). Washington, DC: American Psychological Association.

Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance-outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75, 842–852. doi:10.1037/0022-006X.75.6.842

Barden, S. M., & Greene, J. H. (2015). An investigation of multicultural counseling competence and multicultural counseling self-efficacy for counselors-in-training. International Journal for the Advancement of Counselling, 37, 41–53. doi:10.1007/s10447-014-9224-1

Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159.

Collins, S., & Arthur, N. (2010). Culture-infused counselling: A model for developing multicultural competence. Counselling Psychology Quarterly, 23, 217–233. doi:10.1080/09515071003798212

Constantine, M. G. (2001). Predictors of observer ratings of multicultural counseling competence in Black, Latino, and White American trainees. Journal of Counseling Psychology, 48, 456–462.
doi:10.1037/0022-0167.48.4.456

Constantine, M. G. (2002). Predictors of satisfaction with counseling: Racial and ethnic minority clients’ attitudes toward counseling and ratings of their counselors’ general and multicultural counseling competence. Journal of Counseling Psychology, 49, 255–263. doi:10.1037/0022-0167.49.2.255

Constantine, M. G., & Ladany, N. (2000). Self-report multicultural counseling competence scales: Their relation to social desirability attitudes and multicultural case conceptualization ability. Journal of Counseling Psychology, 47, 155–164. doi:10.1037/0022-0167.47.2.155

Council for Accreditation of Counseling and Related Educational Programs. (2016). CACREP Standards. Retrieved from http://www.cacrep.org/for-programs/2016-cacrep-standards/

Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology.
Journal of Consulting Psychology, 24, 349–354. doi:10.1037/h0047358

D’Andrea, M., & Heckman, E. F. (2008). A 40-year review of multicultural counseling outcome research: Outlining a future research agenda for the multicultural counseling movement. Journal of Counseling & Development, 86, 356–363. doi:10.1002/j.1556-6678.2008.tb00520.x

DePue, M. K., Lambie, G. W., Liu, R., & Gonzalez, J. (2016). Investigating supervisory relationships and therapeutic alliances using structural equation modeling. Counselor Education and Supervision, 55, 263–277. doi:10.1002/ceas.12053

DeVellis, R. F. (2003). Scale development: Theory and applications (2nd ed.). Thousand Oaks, CA: Sage.

Drisko, J. (2013). The common factors model: Its place in clinical practice and research. Smith College Studies in Social Work, 83, 398–413. doi:10.1080/00377317.2013.833435

Fitzpatrick, M. R., Iwakabe, S., & Stalikas, A. (2005). Perspective divergence in the working alliance. Psychotherapy Research, 15(1–2), 69–80. doi:10.1080/10503300512331327056

Fuertes, J. N., & Brobst, K. (2002). Clients’ ratings of counselor multicultural competency. Cultural Diversity and Ethnic Minority Psychology, 8, 214–223. doi:10.1037/1099-9809.8.3.214

Fuertes, J. N., Stracuzzi, T. I., Bennett, J., Scheinholz, J., Mislowack, A., Mindy, H., & Cheng, D. (2006). Therapist multicultural competency: A study of therapy dyads. Psychotherapy: Theory, Research, Practice, Training, 43, 480–490. doi:10.1037/0033-3204.43.4.480

Gall, M. D., Gall J. P., & Borg, W. R. (2007). Educational research: An introduction (8th ed.). Boston, MA: Allyn & Bacon.

Hatcher, R. L., & Barends, A. W. (1996). Patients’ view of the alliance in psychotherapy: Exploratory factor analysis of three alliance measures. Journal of Consulting and Clinical Psychology, 64, 1326–1336. doi:10.1037/0022-006X.64.6.1326

Hays, D. G., & Erford, B. T. (2017). Developing multicultural counseling competence: A systems approach (3rd ed.). New York, NY: Pearson.

Horvath, A. O., & Bedi, R. P. (2002). The alliance. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients (pp. 37–70). New York, NY: Oxford University Press.

Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy: Theory, Research, Practice, Training, 48, 9–16. doi:10.1037/a0022186

Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36, 223–233. doi:10.1037/0022-0167.36.2.223

Huppert, J. D., Kivity, Y., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2014). Therapist effects
and the outcome–alliance correlation in cognitive behavioral therapy for panic disorder with
agoraphobia. Behaviour Research and Therapy, 52, 26–34. doi:10.1016/j.brat.2013.11.001

Katz, A. D., & Hoyt, W. T. (2014). The influence of multicultural counseling competence and anti-Black prejudice on therapists’ outcome expectancies. Journal of Counseling Psychology, 61, 299–305.
doi:10.1037/a0036134

LaFromboise, T. D., Coleman, H. L. K., & Hernandez, A. (1991). Development and factor structure of the Cross-Cultural Counseling Inventory—Revised. Professional Psychology: Research and Practice, 22, 380–388. doi:10.1037/0735-7028.22.5.380

Lambert, M. J., Burlingame, G. M., Umphress, V., Hansen, N. B., Vermeersch, D. A., Clouse, G. C., & Yanchar, S. C. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology & Psychotherapy, 3, 249–258. doi:10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S

Li, L. C., & Kim, B. S. (2004). Effects of counseling style and client adherence to Asian cultural values on counseling process with Asian American college students. Journal of Counseling Psychology, 51(2), 158-167. doi:10.1037/0022-0167.51.2.158}

McKibben, W. B., & Silvia, P. J. (2016). Inattentive and socially desirable responding: Addressing subtle threats to validity in quantitative counseling research. Counseling Outcome Research and Evaluation, 7, 53–64. doi:10.1177/2150137815613135

Norcross, J. C. (Ed.). (2002). Psychotherapy relationships that work: Therapist contributions and responsiveness to patients. New York, NY: Oxford University Press.

Norcross, J. C. (Ed.). (2011). Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed.). New York, NY: Oxford University Press.

Owen, J., Leach, M. M., Wampold, B., & Rodolfa, E. (2011). Client and therapist variability in clients’ perceptions of their therapists’ multicultural competencies. Journal of Counseling Psychology, 58, 1–9. doi:10.1037/a0021496

Pope-Davis, D. B., Toporek, R. L., Ortega-Villalobos, L., Ligiéro, D. P., Brittan-Powell, C. S., Liu, W. M., . . . & Liang, C. T. H. (2002). Client perspectives of multicultural counseling competence: A qualitative examination. The Counseling Psychologist, 30, 355–393. doi:10.1177/0011000002303001

Ratts, M. J., Singh, A. A., Nassar-McMillan, S., Butler, S. K., & McCullough, J. R. (2015). Multicultural and social justice counseling competencies. Retrieved from www.counseling.org/knowledge-center/competencies

Reynolds, W. M. (1982). Development of reliable and valid short forms of the Marlowe-Crowne Social Desirability Scale. Journal of Clinical Psychology, 38, 119–25.
doi:10.1002/1097-4679(198201)38:1<119::AID-JCLP2270380118>3.0.CO;2-I

Rønnestad, M. H., & Skovholt, T. M. (2003). The journey of the counselor and therapist: Research findings and perspectives on professional development. Journal of Career Development, 30, 5–44. doi:10.1023/A:1025173508081

Slone, N. C., & Owen, J. (2015). Therapist alliance activity, therapist comfort, and systematic alliance on individual psychotherapy outcome. Journal of Psychotherapy Integration, 25, 275–288.
doi:10.1037/a0039562

Smith, T. B., & Trimble, J. E. (2016). Foundations of multicultural psychology: Research to inform effective practice. Washington, DC: American Psychological Association.

Soto, A., Smith, T. B., Griner, D., Rodríguez, M. D., & Bernal, G. (2018). Cultural adaptations and therapist multicultural competence: Two meta-analytic reviews. Journal of Clinical Psychology, 1–17.
doi:10.1002/jclp.22679

Stoltenberg, C. D., & McNeill, B. W. (2010). IDM supervision: An integrative developmental model for supervising counselors and therapists (3rd ed.). New York, NY: Routledge.

Streiner, D. L., (2003). Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment, 80, 99–103. doi:10.1207/S15327752JPA8001_18

Sue, D. W., Arredondo, P., & McDavis, R. J. (1992). Multicultural counseling competencies and standards: A call to the profession. Journal of Counseling & Development, 70, 477–486.
doi:10.1002/j.1556-6676.1992.tb01642.x

Sue, D. W., Bernier, J. E., Durran, A., Feinberg, L., Pedersen, P., Smith, E. J., & Vasquez-Nuttall, E. (1982). Position paper: Cross-cultural counseling competencies. The Counseling Psychologist, 10(2), 45–52. doi:10.1177/0011000082102008

Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Allyn & Bacon.

Tao, K. W., Owen, J., Pace, B. T., & Imel, Z. E. (2015). A meta-analysis of multicultural competencies and psychotherapy process and outcome. Journal of Counseling Psychology, 62, 337–350.
doi:10.1037/cou0000086

Tracey, J. T., & Kokotovic, A. M. (1989). Factor structure of the Working Alliance Inventory. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 1, 207–210. doi:10.1037/1040-3590.1.3.207

Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work (2nd ed.). New York, NY: Routledge.

West, B. T., Welch, K. E., & Galecki, A. T. (2007). Linear mixed models: A practical guide using statistical software. Boca Raton, FL: Chapman-Hall/CRC.

Wolgast, B. M., Lambert, M. J., & Puschner, B. (2004). The dose-response relationship at a college counseling center. Journal of College Student Psychotherapy, 18(2), 15–29. doi:10.1300/J035v18n02_03

Worthington, R. L., Mobley, M., Franks, R. P., & Tan, J. A. (2000). Multicultural counseling competencies: Verbal content, counselor attributions, and social desirability. Journal of Counseling Psychology, 47, 460–468. doi:10.1037/0022-0167.47.4.460

Worthington, R. L., Soth-McNett, A. M., & Moreno, M. V. (2007). Multicultural counseling competencies research: A 20-year content analysis. Journal of Counseling Psychology, 54, 351–361.
doi:10.1037/0022-0167.54.4.351