Summary

With the expansion of couples’ voluntary HIV counseling and testing (CVCT) in urban Zambia, there is a growing need to evaluate CVCT provider trainings to ensure that couples are receiving quality counseling and care. We evaluated provider knowledge scores, pre- and post-training and predictors of pre- and post-training test scores. Providers operating in 67 government clinics in four Copperbelt Province cities were trained from 2008 to 2013 in three domains: counseling, rapid HIV laboratory testing and data management. Trainees received pre- and post-training tests on domain-specific topics. Pre- and post-training test scores were tabulated by provider demographics and training type, and paired t-tests evaluated differences in pre- and post-training test scores. Multivariable ANCOVA determined predictors of pre- and post-training test scores. We trained 1226 providers, and average test scores increased from 68.8% pre-training to 83.8% post-training (p <0.001). Test scores increased significantly for every demographic group and training type (p <0.001) with one exception—test scores did not significantly increase for those receiving counseling or data management training who had less than a high school education. In multivariable analysis, higher educational level and having a medical background were predictive of a higher pre-test score; higher pre-test scores and having a medical background were predictive of higher post-test scores. Pre- and post-test assessments are critical to ensure quality services, particularly as task-shifting from medical to lay staff becomes more common. Assessments showed that our CVCT trainings are successful at increasing knowledge, and that those with lower education may benefit from repeat trainings.

INTRODUCTION

Two-thirds of individuals living with HIV reside in sub-Saharan Africa, with the highest incidence occurring in cohabiting heterosexual couples (UNAIDS, 2008). Approximately 99% of incident HIV infections among married women and 84% among married men in urban Zambia occur within ‘discordant,’ stable relationships in which one partner is HIV-negative and the other is HIV-positive (DHS, 2003). This poses a significant concern to Zambians, as roughly 60% of reproductive age adults (DHS, 2007) are in cohabiting unions, and among married couples more than 90% of reported sexual contacts are with the spouse (Allen et al., 2003).

Couples’ voluntary HIV counseling and testing (CVCT) is estimated to reduce HIV transmission in discordant couples by two-thirds (Dunkle et al., 2008) and to reduce sexually transmitted infections, unplanned pregnancies and reported extramarital partners in all couples (Hira et al., 1990; Kamenga et al., 1991; Allen et al., 1992, 2003; Fideli et al., 2001; Guthrie et al., 2007; Becker et al., 2010; World Health Organization, 2012). Couples’ testing also plays an important role in HIV prevention by educating couples as a unit and providing the necessary support during disclosure of each partner’s HIV status (Kurth et al., 2011). The Zambia-Emory HIV Research Project (ZEHRP) has provided CVCT training and counseling services in Lusaka, Zambia since 1994. In 2010, with funding from the Canadian International Development Agency (CIDA) through the Arise program overseen by the Program in Appropriate Technology in Health (PATH), ZEHRP expanded its CVCT training programs to more than 50 government clinics within the densely populated Copperbelt mining province. The goal of the expansion was to strengthen CVCT as a prevention strategy.

In 2007, the importance of CVCT was recognized with the development of The Couples HIV Counseling and Testing Intervention and Training Curriculum, a joint collaboration between the Centers for Disease Control and Prevention (CDC), National Institutes of Health (NIH), ZEHRP and the Liverpool School of Tropical Medicine (CDC, 2007). The CVCT training curriculum was fully endorsed by the Zambian Ministry of Health (MoH) in 2008.

However, implementation and expansion of CVCT within Zambia faces structural obstacles. CVCT entails specialized training that utilizes prevention and support messages in the context of the couple instead of the individual (Chomba et al., 2008; Lehmann et al., 2009). Unfortunately, many African countries, including Zambia, lack a sufficient number of health care providers to administer HIV-related care. One solution to this issue includes task-shifting HIV counseling roles to non-medical staff, commonly known as ‘lay counselors’ (Lehmann et al. 2009; Morris et al. 2009; Sanjana et al., 2009; Walsh et al., 2010; Msisuka et al., 2011).

ZEHRP has worked with the Zambian MoH and local District Health Offices to conduct CVCT training sessions since 2008 within the Copperbelt Province (Sitrin et al., 2009; Lambdin et al., 2011). While assisting government clinics in Copperbelt cities establish CVCT services, ZEHRP has also implemented a comprehensive training program including pre- and post-training didactic examinations.

Earlier evaluations demonstrate that didactic training programs can significantly improve health care providers’ knowledge of HIV and improve the quality of care provided to HIV patients (Kamiru et al., 2009; Lehmann et al., 2009; Chao et al., 2010). The purpose of this study is to evaluate the training programs provided by ZEHRP in four cities in the Copperbelt Province. Specifically, we sought to determine the effect of training on pre- and post-training test scores, and we also evaluated predictors of pre- and post-test scores. We were especially interested in the role of education and prior medical training on pre- and post-training test scores.

METHODS

Trainings

Trainings were conducted with providers from 67 government clinics in four cities (Ndola, Kitwe, Chingola and Luanshya) between 2008 and 2013. Trainings were provided by senior ZEHRP counselors who are fluent in both English and Bemba, the local dialect, and utilized interactive, lecture-based training with time allocated towards role-playing and hands-on demonstrations to accommodate different learning modalities. The CVCT counseling curriculum includes the following modules: (i) background and HIV discordance; (ii) introduction to couples’ counseling skills; (iii) initial session of the CVCT intervention; (iv) providing concordant negative results; (v) providing concordant positive results; (vi) providing discordant results; (vii) support and prevention results and (viii) outreach and recruitment (CDC, 2007). The counselors are then provided with role-playing activities based on realistic clinic scenarios.

Additional training in data management and laboratory testing were offered to those who had successfully completed both didactic and practicum CVCT counseling training and had excelled in the first 2–3 months following counseling training. Modules for these trainings include good clinical laboratory practices, CVCT laboratory testing, and good data practice and quality control. The laboratory trainings include practicums with known and unknown samples and require previous certification in the rapid HIV testing algorithm training provided by the MoH. Similarly, the data trainings include recording of hypothetical couple results using the tools in use at CVCT services in government clinics with a focus on quality control and error checking.

Pre- and post-tests

For each training, the pre-test was given before the training, and the post-test was provided at the conclusion of the didactic training program (3 days for couples’ counseling, and 1 day each for data management and rapid HIV laboratory testing). Pre- and post-tests were administered in English. Participants had 15 min to answer the test questions during both the pre- and post-test sessions. For the CVCT counselor training, the test was organized into 10 true/false questions and 1 open-ended question that tested the counselor’s ability to explain a discordant result to the couple. The true/false section covered the main topics in the training modules, including the cause of HIV infection, modes of transmission, the basics of couples’ counseling and the counseling of discordant results. The data management pre-and post-tests also consisted of 10 true/false questions and covered additional topics on monitoring and evaluation and quality control of the data collection process.

The laboratory training evaluation included 8 true/false questions measuring the ability to differentiate between individual voluntary counseling and testing (VCT) and CVCT testing algorithms (Manigart et al., 2012), specific characteristics of each test kit, correct procedures for initial and follow-up testing and to identify the correct actions following the detection of an indeterminate or discrepant result. A multiple choice question on how to prevent testing errors was also included.

All pre- and post-tests were identical in order to ensure that no factors other than the intervention would have an impact on the test scores. The scores were calculated as a percentage of the correct answers, with each question weighted equally. Trainees achieving at least an 80% on the post-test proceed to practicums in the government clinics, and certification is given after competency is demonstrated during the practicum.

Analysis

The data were collected in Microsoft Access following each training workshop and were cleaned and analyzed retrospectively using SAS 9.0 (Cary, NC, USA) (SAS Institute, Inc., 1976). Participants were divided into three levels of education (i.e. less than high school, high school and college). Because 2008, 2009 and 2013 had a small number of participants, trainings by year were categorized to make the results of the analysis more meaningful. Job occupations were coded into a bivariate parameter that classified participants as either medical professionals or non-medical personnel. Medical professionals included nurses (equivalent to a licensed practical nurse, registered nurse or Bachelor’s level nurse in the US), midwives, clinical officers, clinical coordinators and laboratory technicians. The non-medical personnel included participants who were working as lay counselors, psychosocial counselors, social workers and community health workers.

Descriptive statistics were assessed, including age, gender, years of occupational experience, level of education and previous medical knowledge. Bivariate analyses using paired t-tests were used to evaluate the relationship between changes in pre- and post-test scores. Multivariable analysis of covariance (ANCOVA) was also used to assess the pre- and post-test, adjusting for the other parameters of interest. Variable multi-collinearity was evaluated for all variables, and effect measure modification by training type was explored. The model was built by applying backward selection methods to a full model. A significance level of p < 0.05 was used for all analyses.

Ethical consideration

The training exercises were approved by the institutional review boards (IRBs) at both Emory University and the University of Zambia. In addition, Emory University IRB reviewed and waived the need for informed consent since data collected during the training exercises would only be used for quality assurance and reporting purposes. The trainings and data collection tools were also pre-approved by the Zambian MoH. All personal information was maintained as confidential.

RESULTS

Demographic descriptors for the trainees are presented in Table 1. Overall, 419 counselors, 430 laboratory technicians and 349 data managers were trained by ZEHRP from 2008 until 2013. Eighty percent of the trainees were women and almost half were aged 36–50 years old. Sixty-four percent of the participants had received a high school education, while another 34% had attended college. Seventy-percent had a medical background.

Table 1:

Differences between pre- and post-test scores stratified by participant demographics

TotalPre-training test score
Post-training test score
Difference between pre- and post-test scoresa
%MeanSDMeanSD
Overall68.818.283.814.715.0
Training type
Counseling3558.213.279.614.621.4
Laboratory testing3674.615.786.111.611.5
Data management2976.618.287.215.810.6
Sex
Male2069.018.982.015.213.0
Female8068.818.084.314.515.5
Age
35 or younger2469.718.885.214.015.5
36 to 504870.218.184.714.414.5
Older than 502765.717.280.915.315.2
Years of experience
Less than 5 years4268.617.584.613.216.0
5–10 years4169.517.484.314.514.8
More than 10 years1773.118.384.214.811.1
Education
Less than high school238.314.763.017.824.7
High school6465.617.581.814.716.2
College or university3475.916.288.812.412.9
City
Ndola3970.117.483.314.513.2
Kitwe3171.318.086.013.114.7
Chingola2065.418.281.716.516.3
Luanshya1069.416.086.412.317.0
Medical background
Non-medical background3061.916.678.215.316.3
Medical professional7072.717.186.812.814.1
Training year
2010 and earlier1163.816.979.014.615.2
20116071.917.386.412.814.5
2012 and later2864.319.180.217.015.9
TotalPre-training test score
Post-training test score
Difference between pre- and post-test scoresa
%MeanSDMeanSD
Overall68.818.283.814.715.0
Training type
Counseling3558.213.279.614.621.4
Laboratory testing3674.615.786.111.611.5
Data management2976.618.287.215.810.6
Sex
Male2069.018.982.015.213.0
Female8068.818.084.314.515.5
Age
35 or younger2469.718.885.214.015.5
36 to 504870.218.184.714.414.5
Older than 502765.717.280.915.315.2
Years of experience
Less than 5 years4268.617.584.613.216.0
5–10 years4169.517.484.314.514.8
More than 10 years1773.118.384.214.811.1
Education
Less than high school238.314.763.017.824.7
High school6465.617.581.814.716.2
College or university3475.916.288.812.412.9
City
Ndola3970.117.483.314.513.2
Kitwe3171.318.086.013.114.7
Chingola2065.418.281.716.516.3
Luanshya1069.416.086.412.317.0
Medical background
Non-medical background3061.916.678.215.316.3
Medical professional7072.717.186.812.814.1
Training year
2010 and earlier1163.816.979.014.615.2
20116071.917.386.412.814.5
2012 and later2864.319.180.217.015.9
a

All paired t-test p-values (2-tailed) for differences between pre- and post-training test scores are statistically significant (p < 0.001).

Table 1:

Differences between pre- and post-test scores stratified by participant demographics

TotalPre-training test score
Post-training test score
Difference between pre- and post-test scoresa
%MeanSDMeanSD
Overall68.818.283.814.715.0
Training type
Counseling3558.213.279.614.621.4
Laboratory testing3674.615.786.111.611.5
Data management2976.618.287.215.810.6
Sex
Male2069.018.982.015.213.0
Female8068.818.084.314.515.5
Age
35 or younger2469.718.885.214.015.5
36 to 504870.218.184.714.414.5
Older than 502765.717.280.915.315.2
Years of experience
Less than 5 years4268.617.584.613.216.0
5–10 years4169.517.484.314.514.8
More than 10 years1773.118.384.214.811.1
Education
Less than high school238.314.763.017.824.7
High school6465.617.581.814.716.2
College or university3475.916.288.812.412.9
City
Ndola3970.117.483.314.513.2
Kitwe3171.318.086.013.114.7
Chingola2065.418.281.716.516.3
Luanshya1069.416.086.412.317.0
Medical background
Non-medical background3061.916.678.215.316.3
Medical professional7072.717.186.812.814.1
Training year
2010 and earlier1163.816.979.014.615.2
20116071.917.386.412.814.5
2012 and later2864.319.180.217.015.9
TotalPre-training test score
Post-training test score
Difference between pre- and post-test scoresa
%MeanSDMeanSD
Overall68.818.283.814.715.0
Training type
Counseling3558.213.279.614.621.4
Laboratory testing3674.615.786.111.611.5
Data management2976.618.287.215.810.6
Sex
Male2069.018.982.015.213.0
Female8068.818.084.314.515.5
Age
35 or younger2469.718.885.214.015.5
36 to 504870.218.184.714.414.5
Older than 502765.717.280.915.315.2
Years of experience
Less than 5 years4268.617.584.613.216.0
5–10 years4169.517.484.314.514.8
More than 10 years1773.118.384.214.811.1
Education
Less than high school238.314.763.017.824.7
High school6465.617.581.814.716.2
College or university3475.916.288.812.412.9
City
Ndola3970.117.483.314.513.2
Kitwe3171.318.086.013.114.7
Chingola2065.418.281.716.516.3
Luanshya1069.416.086.412.317.0
Medical background
Non-medical background3061.916.678.215.316.3
Medical professional7072.717.186.812.814.1
Training year
2010 and earlier1163.816.979.014.615.2
20116071.917.386.412.814.5
2012 and later2864.319.180.217.015.9
a

All paired t-test p-values (2-tailed) for differences between pre- and post-training test scores are statistically significant (p < 0.001).

Paired t-test comparisons of pre- and post-training test results are shown for all trainees in Table 1. Both the overall average test score and the scores within each parameter of interest demonstrated statistically significant improvement following training (p < 0.001). The mean pre-training score for all training types was 68.8%, with a mean of 58.2% for counseling, 74.6% for laboratory testing and 76.6% for data management. Following the training intervention, the overall average score in the post-test evaluation increased to 83.8%, a difference of 15 percentage points from the pre-training score. The averages within the 3 training types also improved to 79.6% for counseling, 86.1% for laboratory testing and 87.2% for data management, a difference of 21.4, 11.5 and 10.6 percentage points, respectively (Table 1). Ninety-eight percent of the data management and laboratory testing trainees passed their post-training test with at least an 80%. In contrast, counselors had an average post-training score just below the minimum requirement of 80%. Women and men had similar pre-training scores, but women showed more improvement than men following the intervention. Luanshya showed the greatest improvement by city with an overall 17.0 point increase from 69.4% at baseline to 86.4% in the post-training test. Average post-training scores were less than the minimum requirement of 80% for the few trainees with less than a high school education, trainees with no medical background and those trained in 2010 or earlier.

Paired t-test comparisons of pre- and post-training test results stratified by training type are shown in Table 2. These results also found statistically significant increases in test scores in most demographic groups (p < 0.0001). Among the counseling and data management trainees, only the 9 with less than a high school education did not pass their post-training test, and data management trainees in 2012–13 scored an average of 79.5%. Among laboratory trainees, all groups had passing average post-training scores with the exception of 9 trainees from Luanshya. Trainees with a medical background had substantially higher pre- and post-training scores than non-medical personnel in the data management trainings, but differences were minimal in the laboratory trainings.

Table 2:

Differences between pre- and post-test scores stratified by participant demographics and by training type

Counseling
Data Management
Laboratory Testing
Pre-training score
Post-training score
Pre-training score
Post-training score
Pre-training score
Post-training score
n%MeanSDMeanSDn%MeanSDMeanSDn%MeanSDMeanSD
Overall41958.213.279.614.634976.618.287.215.843074.615.786.111.6
Sex
Men7517.955.09.974.613.66618.976.222.086.616.79722.675.316.184.313.7
Women34482.159.013.780.714.628381.176.717.387.315.633377.474.415.686.610.9
Age
35 or younger9222.057.113.081.812.78022.978.218.091.312.211426.577.513.486.212.1
36–5019646.860.014.081.814.717249.377.119.186.317.121750.574.716.286.311.2
Older than 5013031.056.411.774.814.89727.874.416.985.215.79923.071.016.585.412.1
Years of experience
Less than 5 years19747.057.413.880.113.511533.076.516.589.412.716037.276.614.586.811.3
5–10 years15637.257.411.778.216.413438.478.517.787.913.317941.673.215.586.911.6
More than 10 years4811.564.213.383.112.66117.577.220.185.019.58118.875.417.984.111.8
Education
Less than high school51.252.05.461.414.541.135.510.555.520.3000000
High school27565.654.510.976.414.617349.675.117.286.714.924957.972.516.385.012.0
College or university10725.567.014.788.710.313137.580.516.489.415.413731.978.514.488.210.7
City
Ndola13732.756.611.575.814.516547.378.417.586.415.316638.672.914.786.511.2
Kitwe12830.556.310.581.58223.581.714.693.79.315937.078.016.585.812.2
Chingola7517.952.47.775.315.36518.668.822.181.321.39622.372.315.586.911.0
Luanshya7618.170.516.987.711.6298.369.314.686.913.092.160.38.674.410.0
Medical background
Non-medical background18143.253.010.073.514.87421.268.620.081.716.09421.974.013.484.312.8
Medical professional22954.762.113.684.512.525873.979.216.789.214.533477.774.816.386.611.3
Training year
2010 and earlier8821.055.910.975.314.9257.288.010.891.210.1255.867.814.879.710.3
201121451.155.910.380.014.217449.983.712.593.29.235281.975.715.887.011.5
2012 and later11727.964.317.182.214.515043.066.519.879.519.15312.370.414.483.212.2
Counseling
Data Management
Laboratory Testing
Pre-training score
Post-training score
Pre-training score
Post-training score
Pre-training score
Post-training score
n%MeanSDMeanSDn%MeanSDMeanSDn%MeanSDMeanSD
Overall41958.213.279.614.634976.618.287.215.843074.615.786.111.6
Sex
Men7517.955.09.974.613.66618.976.222.086.616.79722.675.316.184.313.7
Women34482.159.013.780.714.628381.176.717.387.315.633377.474.415.686.610.9
Age
35 or younger9222.057.113.081.812.78022.978.218.091.312.211426.577.513.486.212.1
36–5019646.860.014.081.814.717249.377.119.186.317.121750.574.716.286.311.2
Older than 5013031.056.411.774.814.89727.874.416.985.215.79923.071.016.585.412.1
Years of experience
Less than 5 years19747.057.413.880.113.511533.076.516.589.412.716037.276.614.586.811.3
5–10 years15637.257.411.778.216.413438.478.517.787.913.317941.673.215.586.911.6
More than 10 years4811.564.213.383.112.66117.577.220.185.019.58118.875.417.984.111.8
Education
Less than high school51.252.05.461.414.541.135.510.555.520.3000000
High school27565.654.510.976.414.617349.675.117.286.714.924957.972.516.385.012.0
College or university10725.567.014.788.710.313137.580.516.489.415.413731.978.514.488.210.7
City
Ndola13732.756.611.575.814.516547.378.417.586.415.316638.672.914.786.511.2
Kitwe12830.556.310.581.58223.581.714.693.79.315937.078.016.585.812.2
Chingola7517.952.47.775.315.36518.668.822.181.321.39622.372.315.586.911.0
Luanshya7618.170.516.987.711.6298.369.314.686.913.092.160.38.674.410.0
Medical background
Non-medical background18143.253.010.073.514.87421.268.620.081.716.09421.974.013.484.312.8
Medical professional22954.762.113.684.512.525873.979.216.789.214.533477.774.816.386.611.3
Training year
2010 and earlier8821.055.910.975.314.9257.288.010.891.210.1255.867.814.879.710.3
201121451.155.910.380.014.217449.983.712.593.29.235281.975.715.887.011.5
2012 and later11727.964.317.182.214.515043.066.519.879.519.15312.370.414.483.212.2
*

p-values (2-tailed) from paired t-tests for differences between pre- and post-training test scores are statistically significant (p < 0.05) with the following exceptions:

Difference between pre- and post-scores for those with less than a high school education who received the counseling training (p = 0.31) and data management training (p = 0.08).

Ns may not add to total due to missing values.

Table 2:

Differences between pre- and post-test scores stratified by participant demographics and by training type

Counseling
Data Management
Laboratory Testing
Pre-training score
Post-training score
Pre-training score
Post-training score
Pre-training score
Post-training score
n%MeanSDMeanSDn%MeanSDMeanSDn%MeanSDMeanSD
Overall41958.213.279.614.634976.618.287.215.843074.615.786.111.6
Sex
Men7517.955.09.974.613.66618.976.222.086.616.79722.675.316.184.313.7
Women34482.159.013.780.714.628381.176.717.387.315.633377.474.415.686.610.9
Age
35 or younger9222.057.113.081.812.78022.978.218.091.312.211426.577.513.486.212.1
36–5019646.860.014.081.814.717249.377.119.186.317.121750.574.716.286.311.2
Older than 5013031.056.411.774.814.89727.874.416.985.215.79923.071.016.585.412.1
Years of experience
Less than 5 years19747.057.413.880.113.511533.076.516.589.412.716037.276.614.586.811.3
5–10 years15637.257.411.778.216.413438.478.517.787.913.317941.673.215.586.911.6
More than 10 years4811.564.213.383.112.66117.577.220.185.019.58118.875.417.984.111.8
Education
Less than high school51.252.05.461.414.541.135.510.555.520.3000000
High school27565.654.510.976.414.617349.675.117.286.714.924957.972.516.385.012.0
College or university10725.567.014.788.710.313137.580.516.489.415.413731.978.514.488.210.7
City
Ndola13732.756.611.575.814.516547.378.417.586.415.316638.672.914.786.511.2
Kitwe12830.556.310.581.58223.581.714.693.79.315937.078.016.585.812.2
Chingola7517.952.47.775.315.36518.668.822.181.321.39622.372.315.586.911.0
Luanshya7618.170.516.987.711.6298.369.314.686.913.092.160.38.674.410.0
Medical background
Non-medical background18143.253.010.073.514.87421.268.620.081.716.09421.974.013.484.312.8
Medical professional22954.762.113.684.512.525873.979.216.789.214.533477.774.816.386.611.3
Training year
2010 and earlier8821.055.910.975.314.9257.288.010.891.210.1255.867.814.879.710.3
201121451.155.910.380.014.217449.983.712.593.29.235281.975.715.887.011.5
2012 and later11727.964.317.182.214.515043.066.519.879.519.15312.370.414.483.212.2
Counseling
Data Management
Laboratory Testing
Pre-training score
Post-training score
Pre-training score
Post-training score
Pre-training score
Post-training score
n%MeanSDMeanSDn%MeanSDMeanSDn%MeanSDMeanSD
Overall41958.213.279.614.634976.618.287.215.843074.615.786.111.6
Sex
Men7517.955.09.974.613.66618.976.222.086.616.79722.675.316.184.313.7
Women34482.159.013.780.714.628381.176.717.387.315.633377.474.415.686.610.9
Age
35 or younger9222.057.113.081.812.78022.978.218.091.312.211426.577.513.486.212.1
36–5019646.860.014.081.814.717249.377.119.186.317.121750.574.716.286.311.2
Older than 5013031.056.411.774.814.89727.874.416.985.215.79923.071.016.585.412.1
Years of experience
Less than 5 years19747.057.413.880.113.511533.076.516.589.412.716037.276.614.586.811.3
5–10 years15637.257.411.778.216.413438.478.517.787.913.317941.673.215.586.911.6
More than 10 years4811.564.213.383.112.66117.577.220.185.019.58118.875.417.984.111.8
Education
Less than high school51.252.05.461.414.541.135.510.555.520.3000000
High school27565.654.510.976.414.617349.675.117.286.714.924957.972.516.385.012.0
College or university10725.567.014.788.710.313137.580.516.489.415.413731.978.514.488.210.7
City
Ndola13732.756.611.575.814.516547.378.417.586.415.316638.672.914.786.511.2
Kitwe12830.556.310.581.58223.581.714.693.79.315937.078.016.585.812.2
Chingola7517.952.47.775.315.36518.668.822.181.321.39622.372.315.586.911.0
Luanshya7618.170.516.987.711.6298.369.314.686.913.092.160.38.674.410.0
Medical background
Non-medical background18143.253.010.073.514.87421.268.620.081.716.09421.974.013.484.312.8
Medical professional22954.762.113.684.512.525873.979.216.789.214.533477.774.816.386.611.3
Training year
2010 and earlier8821.055.910.975.314.9257.288.010.891.210.1255.867.814.879.710.3
201121451.155.910.380.014.217449.983.712.593.29.235281.975.715.887.011.5
2012 and later11727.964.317.182.214.515043.066.519.879.519.15312.370.414.483.212.2
*

p-values (2-tailed) from paired t-tests for differences between pre- and post-training test scores are statistically significant (p < 0.05) with the following exceptions:

Difference between pre- and post-scores for those with less than a high school education who received the counseling training (p = 0.31) and data management training (p = 0.08).

Ns may not add to total due to missing values.

In contrast, counseling training was less successful overall, with many groups having post-training scores below 80% (Table 2). Women counselors had higher scores than men for both the pre- and post-tests (women: pre = 59.0%, post = 80.7%; men: pre = 55.0%, post = 74.6%). Counselor trainees over the age of 50, those with 5–10 years of experience, those with less than a college education or a non-medical background, those from Ndola or Chingola, and those trained in 2010 or earlier had average post-training scores below the minimum 80%. In addition, counselor trainees with a medical background had substantially higher pre- and post-training scores than non-medical personnel.

An evaluation of the average test scores in the 4 cities and by training year found no consistent patterns. Overall, counselors in 2 of the 4 cities had average post-training scores greater than 80%, whereas data management and laboratory testing trainees had a score higher than 80% in all cities with the exception of Luanshya for laboratory testing (74.4%). Luanshya also had the lowest average laboratory testing pre-test score (60.3%), but had the highest counseling pre- and post-test scores of the 4 cities. Chingola had the lowest pre- and post-test scores for both counseling (52.4 and 75.3%, respectively) and data management (68.8 and 81.3%, respectively) trainings.

Multivariable analyses of predictors of pre- and post-test scores, shown in Table 3, also showed that having a medical background, receiving training in data management or laboratory testing and receiving training during 2011 remained predictive of higher test scores both pre- and post-training. Pre-test scores for high school (β = 11.1, p = 0.024) and college (β = 16.9, p = 0.001) educated participants were significantly higher compared to those who received less than a high school education. However, although there was a positive correlation between education level and post-test score averages, the difference was not statistically significant in the multivariable model (ref =less than high school, high school p = 0.100, college p = 0.130). Having a medical background versus non-medical background was predictive of higher average pre-training test score (β = 5.1, p < 0.0001) and post-training test score (β = 14.4, p < 0.0001). Age and years of experience were collinear, and both parameters were not predictive in either the pre- or post-test ANCOVA analyses. No effect measure modification was observed by training type.

Table 3:

Multivariable ANCOVA analysis of predictors of pre- and post-test scores

Pre-training tests
Post-training tests
βtpβtp
Pre-training test scoren/a38.95.2<0.001
Education
Less than high schoolRefRef
High school11.12.30.02410.81.60.100
College or university16.93.40.00110.01.50.130
Sex
Women−0.1−0.10.9501.51.70.090
MenRefRef
Training type
Laboratory testing14.67.3<0.000111.72.90.005
Data management28.713.3<0.0001−3.7−0.90.350
CounselingRefRef
Training year
2010 and earlier18.06.5<0.00014.10.30.768
201120.28.7<0.0001−12.6−1.40.171
2012 and laterRefRef
Medical background
Non-medical backgroundRefRef
Medical professional5.15.1<0.000114.44.6<0.001
City
NdolaRefRef
Kitwe5.30.60.530−1.60.20.816
Chingola13.33.9<0.0001−10.6−2.70.007
Luanshya29.93.2<0.00011.50.40.725
Pre-training tests
Post-training tests
βtpβtp
Pre-training test scoren/a38.95.2<0.001
Education
Less than high schoolRefRef
High school11.12.30.02410.81.60.100
College or university16.93.40.00110.01.50.130
Sex
Women−0.1−0.10.9501.51.70.090
MenRefRef
Training type
Laboratory testing14.67.3<0.000111.72.90.005
Data management28.713.3<0.0001−3.7−0.90.350
CounselingRefRef
Training year
2010 and earlier18.06.5<0.00014.10.30.768
201120.28.7<0.0001−12.6−1.40.171
2012 and laterRefRef
Medical background
Non-medical backgroundRefRef
Medical professional5.15.1<0.000114.44.6<0.001
City
NdolaRefRef
Kitwe5.30.60.530−1.60.20.816
Chingola13.33.9<0.0001−10.6−2.70.007
Luanshya29.93.2<0.00011.50.40.725
Table 3:

Multivariable ANCOVA analysis of predictors of pre- and post-test scores

Pre-training tests
Post-training tests
βtpβtp
Pre-training test scoren/a38.95.2<0.001
Education
Less than high schoolRefRef
High school11.12.30.02410.81.60.100
College or university16.93.40.00110.01.50.130
Sex
Women−0.1−0.10.9501.51.70.090
MenRefRef
Training type
Laboratory testing14.67.3<0.000111.72.90.005
Data management28.713.3<0.0001−3.7−0.90.350
CounselingRefRef
Training year
2010 and earlier18.06.5<0.00014.10.30.768
201120.28.7<0.0001−12.6−1.40.171
2012 and laterRefRef
Medical background
Non-medical backgroundRefRef
Medical professional5.15.1<0.000114.44.6<0.001
City
NdolaRefRef
Kitwe5.30.60.530−1.60.20.816
Chingola13.33.9<0.0001−10.6−2.70.007
Luanshya29.93.2<0.00011.50.40.725
Pre-training tests
Post-training tests
βtpβtp
Pre-training test scoren/a38.95.2<0.001
Education
Less than high schoolRefRef
High school11.12.30.02410.81.60.100
College or university16.93.40.00110.01.50.130
Sex
Women−0.1−0.10.9501.51.70.090
MenRefRef
Training type
Laboratory testing14.67.3<0.000111.72.90.005
Data management28.713.3<0.0001−3.7−0.90.350
CounselingRefRef
Training year
2010 and earlier18.06.5<0.00014.10.30.768
201120.28.7<0.0001−12.6−1.40.171
2012 and laterRefRef
Medical background
Non-medical backgroundRefRef
Medical professional5.15.1<0.000114.44.6<0.001
City
NdolaRefRef
Kitwe5.30.60.530−1.60.20.816
Chingola13.33.9<0.0001−10.6−2.70.007
Luanshya29.93.2<0.00011.50.40.725

DISCUSSION

As demonstrated in the pre-post analyses, standardized didactic materials offer a highly effective training method to prepare counselors for all aspects of CVCT. Though pre-test scores were significantly impacted by factors such as level of education and medical background, significant improvement in test score averages was noted in all educational groups. Additionally, while educational level was predictive of pre-training test scores, this covariate did not remain a significant predictor during post-test analysis.

Although overall knowledge scores pre-training were below an acceptable passing score, average post-training test scores were above the minimum passing grade of 80% for data management and laboratory training, and 79% for counseling. The main contributor to substandard post-test counseling scores were trainees with no medical background and lower educational attainment, who often required booster counseling training to achieve a passing score.

With the shortage of human medical resources in Zambia, CVCT has been delegated to lay counselors. Our results confirm that while the quality of CVCT can be maintained, it is essential to quantitatively assess the success of training and to provide booster trainings as needed. Maintaining the high quality of such training is paramount—a recent qualitative analysis of task-shifting and quality of HIV services conducted in Lusaka, Zambia showed that inadequate training and non-adherence to testing procedures were key challenges in successful task-shifting (Mwangala et al., 2015). Booster or refresher trainings are also an important part of successful task-shifting as has been demonstrated in another recent study in Zambia which indicated that lay counselors were at risk of protocol non-adherence without refresher trainings (Msisuka et al., 2011).

The consistently higher scores seen with medical professionals suggests that limiting the roles of trainers, or trainers of trainers, to medical staff may result in high quality services, as suggested by the CDC/Partner Program’s results of task-shifting and the Training the Trainers Model implemented in Zambia (Jones et al., 2015). Further, though we did not explicitly evaluate the role of supervision, adequate ongoing supervisory support for lay counselors has been cited repeatedly as a key component of successful task-shifting and warrants consideration by implementers (Ledikwe et al., 2013; Crowley and Mayers, 2015) and has been a mainstay of the successful CVCT implementation model.

The study was based over a 6-year period and the large training cohort allowed for stratification during analysis, while still maintaining good precision and adequate sample sizes within most subgroups. Using the same test questions on both the pre- and post-test also allowed for a more accurate evaluation of the training intervention by ensuring that a participant’s CVCT knowledge could not be influenced by factors including question or wording changes. The largest number of trainings of all types was conducted in 2011 when the efficiency of the training program was at its height: this may explain why the trainee scores were higher that year compared with earlier years when the training programs were first launching, and after 2011 when trainers resumed other tasks in addition to training.

There were several limitations due to both the design of the study and the inherent construction of the evaluation tool. Since the pre- and post-test questionnaires were based on true/false questions that were provided within 3 days of one another, this posed a threat to internal validity. Specifically, the short duration of time between the pre- and post-tests could lead to higher test scores in the post-test because of familiarity with the questions. The use of the ZEHRP database prevented any evaluation of specific topics or questions within the pre- and post-test questionnaires, because only the percentage of correct answers was entered into the database. There was also no data available on the number of HIV-related trainings each of the participants may have previously attended. English was the language of instruction and the language used in pre- and post-tests and in tools such as flip charts and data logs which likely contributed to poorer performance among those with limited English. Lastly, though knowledge is a prerequisite for successful performance, knowledge alone does not guarantee good counseling.

CONCLUSION

The study found that the ZEHRP training curriculum was highly effective in improving participants’ knowledge of CVCT and related counseling, testing and data recording procedures. Among those taking lab and data trainings, all trainees had passing scores regardless of prior medical training. The findings confirm that the training curriculum can help close the knowledge gap between medical professionals and non-medical personnel. This supports the MoH's decision to task-shift certain counseling roles to the lay counselors in order to address the shortage in the number of health care providers. However, among those participating in counselor trainings, the average score was below passing. This indicates an area for future improvement. Nevertheless, systematic pre- and post-test assessments are critical to ensure quality services and to highlight training components that must be repeated until passing scores are achieved.

FUNDING

This work was supported by funding from the Canadian International Development Agency (PATH-CIDA CID.1450-08863-sub) and the US National Institutes of Health (NIH 5R01 MH095503). This study was also supported by the AIDS International Training and Research Program Fogarty International Center (D43 TW001042); the Emory Center for AIDS Research (P30 AI050409); and the International AIDS Vaccine Initiative. This study was made possible by the generous support of the American people through the United States Agency for International Development (USAID). The contents do not necessarily reflect the views of USAID or the United States Government. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

CONFLICT OF INTEREST

None declared.

REFERENCES

Allen
S.
,
Meinzen-Derr
J.
,
Kautzman
M.
,
Zulu
I.
,
Trask
S.
,
Fideli
U.
, et al. (
2003
)
Sexual behavior of HIV discordant couples after HIV counseling and testing
.
Aids
17
,
733
740
.

Allen
S.
,
Tice
J.
,
Van de Perre
P.
,
Serufilira
A.
,
Hudes
E.
,
Nsengumuremyi
F.
, et al. (
1992
)
Effect of serotesting with counselling on condom use and seroconversion among HIV discordant couples in Africa
.
British Medical Journal
304
,
1605
1609
.

Becker
S.
,
Mlay
R.
,
Schwandt
H.M.
,
Lyamuya
E.
(
2010
)
Comparing couples' and individual voluntary counseling and testing for HIV at antenatal clinics in Tanzania: a randomized trial
.
AIDS and Behavior
14
,
558
566
.

CDC
(
2007
). Couples HIV Counseling and Testing Interventions and Curriculum. Atlanta, CDC.

Chao
L.W.
,
Gow
J.
,
Akintola
O.
,
Pauly
M.V.
(
2010
)
A comparative evaluation of two interventions for educator training in HIV/AIDS in South Africa
.
International Journal of Education and Development Using Information and Communication Technology
6
,
1
14
.

Chomba
E.
,
Allen
S.
,
Kanweka
W.
,
Tichacek
A.
,
Cox
G.
,
Shutes
E.
, et al. (
2008
)
Evolution of couples' voluntary counseling and testing for HIV in Lusaka, Zambia
.
Journal of Acquired Immune Deficiency Syndromes
47
,
108
115
.

Crowley
T.
,
Mayers
P.
(
2015
)
Trends in task shifting in HIV treatment in Africa: effectiveness, challenges and acceptability to the health professions
.
African Journal of Primary Health Care & Family Medicine
7
.

DHS
(
2003
) Zambia DHS, 2001–2002. Zambia Demographic and Health Surveys, Zambia Central Statistical Office.

DHS
(
2007
) Zambia Demographic and Health Surveys, Zambia Central Statistical Office.

Dunkle
K. L.
,
Stephenson
R.
,
Karita
E.
,
Chomba
E.
,
Kayitenkore
K.
,
Vwalika
C.
, et al. (
2008
)
New heterosexually transmitted HIV infections in married or cohabiting couples in urban Zambia and Rwanda: an analysis of survey and clinical data
.
Lancet
371
,
2183
2191
.

Fideli
U. S.
,
Allen
S. A.
,
Musonda
R.
,
Trask
S.
,
Hahn
B. H.
,
Weiss
H.
, et al. (
2001
)
Virologic and immunologic determinants of heterosexual transmission of human immunodeficiency virus type 1 in Africa
.
AIDS Research and Human Retroviruses
17
,
901
910
.

Guthrie
B. L.
,
de Bruyn
G.
,
Farquhar
C.
(
2007
)
HIV-1-discordant couples in sub-Saharan Africa: explanations and implications for high rates of discordancy
.
Current HIV Research
5
,
416
429
.

Hira
S. K.
,
Nkowane
B. M.
,
Kamanga
J.
,
Wadhawan
D.
,
Kavindele
D.
,
Macuacua
R.
et al. (
1990
)
Epidemiology of human immunodeficiency virus in families in Lusaka, Zambia
.
Journal of Acquired Immune Deficiency Syndromes
3
,
83
86
.

Jones
D.
,
Weiss
S.
,
Chitalu
N.
(
2015
)
HIV prevention in resource limited settings: a case study of challenges and opportunities for implementation
.
International Journal of Behavioral Medicine
22
,
384
392
.

Kamenga
M.
,
Ryder
R. W.
,
Jingu
M.
,
Mbuyi
N.
,
Mbu
L.
,
Behets
F.
, et al. (
1991
)
Evidence of marked sexual behavior change associated with low HIV-1 seroconversion in 149 married couples with discordant HIV-1 serostatus: experience at an HIV counselling center in Zaire
.
Aids
5
,
61
67
.

Kamiru
H. N.
,
Ross
M. W.
,
Bartholomew
L. K.
,
McCurdy
S. A.
,
Kline
M. W.
(
2009
)
Effectiveness of a training program to increase the capacity of health care providers to provide HIV/AIDS care and treatment in Swaziland
.
AIDS Care
21
,
1463
1470
.

Kurth
A. E.
,
Celum
C.
,
Baeten
J. M.
,
Vermund
S. H.
,
Wasserheit
J. N.
(
2011
)
Combination HIV prevention: significance, challenges, and opportunities
.
Current HIV/AIDS Reports
8
,
62
72
.

Lambdin
B. H.
,
Kanweka
W.
,
Inambao
M.
,
Mwananyanda
L.
,
Shah
H. D.
,
Linton
S.
, et al. (
2011
)
Local residents trained as ‘influence agents’ most effective in persuading African couples on HIV counseling and testing
.
Health Affairs (Millwood)
30
,
1488
1497
.

Ledikwe
J. H.
,
Kejelepula
M.
,
Maupo
K.
,
Sebetso
S.
,
Thekiso
M.
,
Smith
M.
, et al. (
2013
)
Evaluation of a well-established task-shifting initiative: the lay counselor cadre in Botswana
.
PLoS One
8
,
e61601.

Lehmann
U.
,
Van Damme
W.
,
Barten
F.
,
Sanders
D.
(
2009
)
Task shifting: the answer to the human resources crisis in Africa?
Hum Resources for Health
7
,
49.

Manigart
O.
,
Boeras
D. I.
,
Karita
E.
,
Hawkins
P. A.
,
Vwalika
C.
,
Makombe
N.
, et al. (
2012
)
A gp41-based heteroduplex mobility assay provides rapid and accurate assessment of intrasubtype epidemiological linkage in HIV type 1 heterosexual transmission Pairs
.
AIDS Research and Human Retroviruses
28
,
1745
1755
.

Morris
M. B.
,
Chapula
B. T.
,
Chi
B. H.
,
Mwango
A.
,
Chi
H. F.
,
Mwanza
J.
, et al. (
2009
)
Use of task-shifting to rapidly scale-up HIV treatment services: experiences from Lusaka, Zambia
.
BMC Health Services Research
9
,
5.

Msisuka
C.
,
Nozaki
I.
,
Kakimoto
K.
,
Seko
M.
,
Ulaya
M. M.
(
2011
)
An evaluation of a refresher training intervention for HIV lay counsellors in Chongwe District, Zambia
.
Sahara Journal
8
,
204
209
.

Mwangala
S.
,
Moland
K. M.
,
Nkamba
H. C.
,
Musonda
K. G.
,
Monze
M.
,
Musukwa
K. K.
, et al. (
2015
)
Task-shifting and quality of HIV testing services: experiences from a national reference hospital in Zambia
.
PLoS One
10
,
e0143075.

Sanjana
P.
,
Torpey
K.
,
Schwarzwalder
A.
,
Simumba
C.
,
Kasonde
P.
,
Nyirenda
L.
, et al. (
2009
)
Task-shifting HIV counselling and testing services in Zambia: the role of lay counsellors
.
Human Resources for Health
7
,
44
.

SAS Institute, Inc
. (
1976
) Computer Software, Cary, NC.

Sitrin
D.
,
Clements
A.
,
Mwananyanda
L.
,
Kilembe
W.
,
Kautzman
M.
,
Conkling
M.
, et al. (
2009
)
Using referrals from government health centers to expand an HIV discordant couple cohort in Lusaka, Zambia in preparation for vaccine efficacy trials
.
Retrovirology
6
,
93
.

UNAIDS
(
2008
). 2008 Report on the Global AIDS epidemic. Geneva, Joint United Nations Programme on HIV/AIDS.

Walsh
A.
,
Ndubani
P.
,
Simbaya
J.
,
Dicker
P.
,
Brugha
R.
(
2010
)
Task sharing in Zambia: HIV service scale-up compounds the human resource crisis
.
BMC Health Services Research
10
,
272.

World Health Organization
(
2012
) Guidance on couples HIV testing and counselling - including antiretroviral therapy for treatment and prevention in serodiscordant couples. Retrieved Feb 26, 2014, from http://apps.who.int/iris/bitstream/10665/44646/1/9789241501972_eng.pdf?ua=1 (last accessed 26 February 2014).

This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs licence (http://creativecommons.org/licenses/by-nc-nd/4.0/), which permits non-commercial reproduction and distribution of the work, in any medium, provided the original work is not altered or transformed in any way, and that the work properly cited. For commercial re-use, please contact [email protected]