Qualitative research Essay

PREPARING A vitrine lead hold of A Guide for roleing and Conducting a theme Study for Evaluation In arrogate By Palena Neale, PhD, Senior Evaluation concern Shyam Thapa, PhD, Senior supervise and Evaluation Advisor Carolyn Boyce, MA, Evaluation classify whitethorn 2006 P AT H F I N D E R I N T E R N AT I O N A L T O O L S E R I E S Monitoring and Evaluation 1 PREPARING A CASE STUDY A Guide for Designing and Conducting a drive Study for Evaluation Input By Palena Neale, PhD, Senior Evaluation Associate Shyam Thapa, PhD, Senior Monitoring and Evaluation Advisor Carolyn Boyce, MA, Evaluation Associate.May 2006 Acknowledgements The authors would uniform to thank the next Pathfinder employees and sliceners for their technical inputs into this document Emmanuel Boadi (Pathfinder/Ghana), Anne Palmer (Futures Group planetary), Ugo Daniels (Afri shadow younker Alliance (AYA)), Veronique Dupont (Pathfinder/Extending Service Deli truly (ESD)), Cathy Solter, Lauren Dunnington, and Shannon Pryor (Pathfinder headquarters). Jenny Wilder and Mary Burket argon also thanked for their inputs and assistance in editing and producing this document. 2 talent scout worldwide WRITING A CASE STUDY.What is a slick Study? A aspect lease is a story almost something unique, special, or raisestories can be about individuals, organizations, procedurees, plans, neighborhoods, institutions, and even events. 1 The shimmy exact gives the story lavatory the sequel by capturing what happened to bring it about, and can be a good opportwholey to highlight a projects success, or to bring attention to a particular ch solely toldenge or difficulty in a project. flakes2 might be selected beca use up they are super effective, not effective, exemplification, typical, or of special interest.A fewer examples of shell study topics are take into accountd belowthe strip studies would describe what happened when, to whom, and with what consequences in for each iodine case. reference Study Examples Shifting Attitudes of Youth-Serving Service Providers Uniqueness/Point of Interest Your design was able to change service sufferrs attitudes towards dealing with Adolescent Sexual and procreative health (ASRH) needs in an environment where leave behindrs attitudes draw been a barrier to young people accessing SRH services. Your program was effective in introducing YFS to the MOH and in institutionalizing an YFS curriculum in a setting where the MOH did not provide YFS.Your program was able to integrate HIV legal community in several(prenominal) FBO service delivery points in an environment that norm all(prenominal)y does not take or welcome HIV prevention activities. Your program built the leadinghip capacity of youth to advocate, promote, and insert in decision making round ASRH. This transpired in a setting that did not embroil ASRH on the docket nor encourage youth participation in general or in decision making in particular. Integrating Yo uth-Friendly function (YFS) in the Ministry of Health (MOH) Integrating HIV Prevention in Faith-Based Organization (FBO) Health Services Delivery. overhauling Youth Leadership in Tanzania 1 2 Yin, Robert K. (2003). courting Study Research Design and Methods. Thousand Oakds Sage Publications. lawsuit refers to the unit of analysis or topic chosen for study (i. e. , the individual, organization, or program). PATHFINDER world(prenominal) WRITING A CASE STUDY 3 When is a effect Study Appropriate? effect studies are appropriate when there is a unique or interesting story to be told. Case studies are often employ to provide context to other(a) entropy (such as outcome selective tuition), offering a more complete depiction of what happened in the program and wherefore.What are the Advantages and Limitations of a Case Study? The capital advantage of a case study is that it provides much more dilate entropy than what is available through other methods, such as valuates. Cas e studies also allow single to present data collected from triune methods (i. e. , surveys, discourses, document analyze, and observation) to provide the complete story. There are a few limitations and pitfalls however, each of which is described below. jackpot be lengthy Because they provide dilate information about the case in narrative form, it whitethorn be difficult to hold a readers interest if too lengthy.In writing the case study, care should be taken to provide the rich information in a digestible manner. Concern that case studies lack rigor Case studies deem been viewed in the evaluation and search fields as less rigorous than surveys or other methods. Reasons for this entangle the fact that qualitative investigate in general is still considered pseudoscientific by some and in m both cases, case study investigateers flummox not been systematic in their data collection or have allowed bias in their findings.In conducting and writing case studies, all baffling should use care in being systematic in their data collection and take steps to ensure validity3 and reliability4 in the study. Not generalizable A common complaint about case studies is that it is difficult to generalize from one case to some other. But case studies have also been prone to overgeneralization, which comes from selecting a few examples and assuming without evidence that they are typical or representative of the population.Yin, a prominent researcher, advises case study analysts to generalize findings to theories, as a scientist generalizes from experimental results to theories. 5 3 4 Validity refers to the degree to which a study accurately reflects or assesses the specific concept that the researcher is attempting to measure. reliableness is the extent to which an experiment, test, or each measuring procedure yields the same result on repeated trials. 5 Yin, Robert K. (2003). Case Study Research Design and Methods. Thousand Oaks Sage Publications. 4 PATHFINDER s upranational WRITING A CASE STUDY.What is the Process for Conducting a Case Study? The exercise for conducting case study research follows the same general unconscious process as is followed for other research plan, collect data, analyze data, and disseminate findings. More detailed steps are given below. 1. Plan Identify stakeholders who provide be voluminous. penetration a case study topic, considering types of cases and why they are unique or of interest. Identify what information is needed and from whom (see What are Potential Sources of learning? and What are the Elements of a Case Study? ). Identify whatsoever documents needed for review. identify stakeholders to be interviewed or surveyed (national, facility, and beneficiary levels) and determine sample if necessary. Ensure research will follow international and national ethical research standards, including review by ethical research committees. For more information, please see the International Ethical Guideli nes for Biomedical Research Involving Human Subjects, available at http//www. cioms. ch/frame_guidelines_nov_2002. htm. 2. Develop Instruments Develop interview/survey protocolsthe rules that guide the administration and implementation of the interview/survey.Put simply, these are the instructions that are followed to ensure consistency crossways interviews/surveys, and thus increase the reliability of the findings. The following instructions for the should be implicate in the protocol What to say to interviewees when setting up the interview/survey What to say to interviewees when beginning the interview/survey, including ensuring informed consent of the respondent (see addition 1 for an example) What to say to respondent in concluding the interview What to do during the interview (Example Take notes? Audio commemorate? Both?) and What to do following the interview (Example assemble in notes? Check audiotape for clarity?Summarize key information for each? Submit written f indings? ). Develop an interview guide/survey that lists the questions or issues to be explored and entangles an informed consent form. Please note that you will potential need interview guides/surveys for each group of stakeholders, as questions may differ. Where necessary, represent guides into local languages and test translation. PATHFINDER INTERNATIONAL WRITING A CASE STUDY 5 3. Train selective information Collectors Identify and train data collectors (if necessary).(See Training Tips for Data Collectors6. ) Where necessary, use interviewers that speak the local language. Training Tips for Data Collectors lag, youth program participants, or professional interviewers may be involved in data collection. Regardless of what experience data collectors have, training should take An introduction to the evaluation objectives, A review of data collection techniques, A thorough review of the data collection items and instruments, Practice in the use of the instruments, Skill- building exercises on interviewing and interpersonal communication, and Discussion of ethical issues.4. Collect Data crumple all relevant documents. Set up interviews/surveys with stakeholders (be sure to explain the target, why the stakeholder has been chosen, and the expected duration). Seek informed consent of each respondent (written or documented oral). Re-explain purpose of interview, why the stakeholder has been chosen, expected duration of, whether and how the information will be kept confidential, and the use of a note taker/tape recorder. If the respondent has consented, conduct the interview/survey. 5. Analyze Data Review all relevant documents. Review all interview/survey data. 6. Disseminate Findings redeem report (see What are the Elements of a Case Study? ). Solicit feedback. decree Disseminate 6 Adamchak, S. , et. al. (2000). A Guide to Monitoring and Evaluating Adolescent generative Health syllabuss. ready(prenominal) at http//www. pathfind. org/sit e/PageServer? pagename=Publications_FOCUS_Guides_and_Tools. 6 PATHFINDER INTERNATIONAL WRITING A CASE STUDY What are Potential Sources of education? Case studies typically rely on multiple sources of information and methods to provide as complete a picture as possible.Information sources could acknowledge stick out documents (including meeting minutes) Project reports, including quarterly reports, midterm reviews Monitoring visits closed book client reports ease assessment reports Interviews Questionnaire/survey results Evaluation reports Observation another(prenominal) What are the Elements of a Case Study? Case studies do not have set elements that need to be include the elements of each will vary depending on the case or story chosen, the data collected, and the purpose (for example, to illustrate a best case versus a typical case).However, case studies typically describe a program or intervention put in place to address a particular fuss. Therefore, we provide t he following elements and example on which you might draw 1. The Problem i. Identify the enigma ii. Explain why the problem is Copernican iii. How was the problem identified? iv. Was the process for identifying the problem effective? 2. travel taken to address the problem 3. Results 4. Challenges and how they were met 5. beyond Results 6. Lessons Learned.PATHFINDER INTERNATIONAL WRITING A CASE STUDY 7 1. The Problem It is essential to identify what the problem was. Specifically i. Identify the problem. For example, accredited FBO leadershiphip was opposed to including HIV prevention activities within their programming. Specifically, they felt that prevention activities would promote sex among youth and thereby increase the incidence of HIV. In addition, the FBO felt that the promotion of condoms as a form of prevention was virtuously wrong. ii. Explain why the problem is important.Following the same example, to provide a comprehensive response to HIV/AIDS, prevention activitie s are an important part of HIV programming, in addition to care and championship. Addressing moral and religious concerns and objections of FBO leaders in order to incorporate this component greatly expands the prevention essay and offers a greater breadth and depth in HIV programming. iii. How was the problem identified? It is give carely that program staff will have an estimate of what general problems exist. For example, YFS is not integrated in the MOH, FBOs do not include prevention activities, youth involvement does not occur, etc.What was ilkly missing and required exploration were the details around this general problem. In the case of working with FBOs, an initial project planning meeting was held to discuss the specifics behind the problem. It was revealed during this process that certain FBOs who conducted care and support activities did not offer prevention activities, specifically condom promotion. The primary reason given was religious objections another reason identified but not explicitly stated was stigma. iv. Was the process for identifying the problem effective?After additional one-on-one discussions with FBO leaders, it was determined that the leaders had concerns based on moral and religious grounds regarding prevention efforts, oddly promoting condoms. Furthermore, discussions revealed that a number of leaders had limited and/or erroneous information regarding transmission and prevention options. 8 PATHFINDER INTERNATIONAL WRITING A CASE STUDY 2. Steps Undertaken to Address the Problem What was done (activities/ interventions/ inputs), where, by whom, for whom?In the case of integrating prevention in FBOs, an illustrative portray of steps downstairstaken to address the problem is given below What was done? contour 1 sensitizing Sensitization of leadership activities included reviewing FBO policies and bylaws by program staff in order to demonstrate to leadership that there were no constitutional objections to prevention activ ities. Project staff engaged liberal FBO leaders to supply quotes from the Bible to build their evidence-based argument to convince other leaders that there was in fact no biblical basis for the forestalling of prevention activities.Sensitization of facility managers meet with managers to discuss leadership approving and present evidence-based arguments on why integration activities can be included. Sensitization of community work with groups to explain that these activities have been approved by the FBO leadership and where they can go to receive services. Phase 2 Integration easiness assessments Selected facilities Project round, FBO representatives Local Implementing component partners (IPs) Project mental faculty, Facility Managers Contractor FBOs, Project Staff Facility Staff District/ National Project Staff FBO leaders Where? By Whom? For Whom?Facilities Project Staff Facility Managers Community catchment areas Project Staff Community members Training of service providers Selected facilities Conduct staff orientations Facilities Facility Staff Physical infrastructure improved Phase 3 Outreach Identify peers that you destiny to work with Training Provide Tools Supervision Phase 4 M&E Reassessments Facilities Facility Selected facilities Facilities Facility Staff IPs Project compeer supervisors Beneficiaries Peers Peers Peers savour of selected facilities Project Staff, Facility Management, Youth Trained mystery clients Project Staff, Peer Supervisors.Facility, Project Staff Mystery client interviews Monitoring visits Facilities Facilities, Peers Facility staff, Project Staff PATHFINDER INTERNATIONAL WRITING A CASE STUDY 9 3. Results What were the results of your intervention, particularly the significant or unique results? For example your activities resulted in the FBO including HIV prevention activities in their programming, which contributed to an increase in condom distribution. Or, your activities resulted in youth-serving service providers a dopting a youth-friendly attitude which contributed to improved services and an increase in youth visits.Church leadership may have made a commitment and modified policies to include ASRH activities, leadership talking about the issues publicly. Facility managers may make financial commitments to refurbishments, training, etc. 4. Challenges and how they were met This focuses on what challenges or difficulties you encountered and what you did to catch them. One of the challenges in working with FBOs may have been dealing with Catholic FBOs and your response could have been to negotiate with them to include certain prevention activities like abstinence, and/or providing a referral point to youth who may want to get information about condoms.Another possible challenge is that not all FBOs who you had hoped to work with were willing to come on board and this required additional attention. 5. Beyond Results Are the results mentioned above sustainable? Why or why not? For example, an int egrated approach to programming (which included a whole policy and advocacy component) created an enabling policy environment with strong stakeholder support that can be nurtured and leveraged beyond the project duration. 6. Lessons Learned What lessons were learned programmatic, technical, financial, process, etc.?For example, the experience showed that it was imperative for project staff to have a very solid understanding of government policies to speak to these issues with key stakeholders. In addition, it was important to have a good understanding of the various religious beliefs in addition to their respective policies and by-laws for developing and delivering advocacy arguments. How are Case Studies Presented? Case studies are flexible in that they can be presented in a number of waysthere is no specific format to follow.However, like all evaluation results, justification and methodology of the study should be provided, as well up as any supporting information (i. e. , copie s of instruments and guides used in the study). Case studies may stand alone or be included in a larger evaluation report. If presented as a stand-alone report, the following report outline is suggested 1. Introduction and Justification 2. Methodology a. How was the process carried out? (Describe the process of selecting the case and data collection sources, as well as how data was collected. ) b. What assumptions are there (if any)?10 PATHFINDER INTERNATIONAL WRITING A CASE STUDY 3. 4. 5. 6. 7. 8. 9. 10. c. Are there any limitations with this method? d. What instruments were used to collect data? (You may want to include some or all in the appendix. ) e. What sample(s) is/are being used? f. Over which period of time was this data collected? The Problem The Steps Taken to Address the Problem The Results The Challenges and How They were Met Beyond Results Lessons Learned Conclusion Appendices Where Can More Information on Case Studies be Found? Information on Case Study Research Adam chak, S. , et. al. (2000).A Guide to Monitoring and Evaluating Adolescent Reproductive Health Programs. Available at http//www. pathfind. org/pf/pubs/focus/guidesandtools/PDF/Part%20II. pdf. Patton, Michael Q. (2002). Qualitative Research & Evaluation Methods. Thousand Oaks Sage Publications. Stake, Robert E. (1995). The Art of Case Study Research. Thousand Oaks Sage Publications. United States General Accounting Office, Program Evaluation and Methodology Division. (1987). Case Study Evaluations. Available at http//161. 203. 16. 4/t2pbat22/132683. pdf. Yin, Robert K. (2003). Case Study Research Design and Methods.London Sage Publications. Examples of Case Studies Cornwall, A. and Welbourn, A. (2002). Realizing Rights Transforming Approaches to Sexual and Reproductive Well-Being. London Zed Books. Population Council. Quality/Calidad/Qualite series. Available at http//www. popcouncil. org/publications/qcq/default. htm. SRI International. (2001). The Organization of tuition in Communi ty Technology Centers Learning with Technology in Six Communities. Available at http//www. americaconnects. net/research/SRI_case_study_report. pdf. PATHFINDER INTERNATIONAL WRITING A CASE STUDY 11Appendix 1 Sample Informed Consent Form constitute Components Thank you Your name Purpose Confidentiality Duration How interview will be conducted Opportunity for questions Signature of consent I want to thank you for victorious the time to meet with me today. My name is ________________________ and I would like to talk to you about your experiences participating in the African Youth Alliance (AYA) project. Specifically, as one of the components of our overall program evaluation we are assessing program effectiveness in order to capture lessons that can be used in proximo interventions.The interview should take less than an hour. I will be attach the session because I dont want to miss any of your comments. Although I will be taking some notes during the session, I cant possibl y write fast enough to get it all down. Because were on tape, please be sure to speak up so that we dont miss your comments. All responses will be kept confidential. This means that your interview responses will only be shared with research team members and we will ensure that any information we include in our report does not identify you as the respondent.Remember, you dont have to talk about anything you dont want to and you may end the interview at any time. Are there any questions about what I have just explained? Are you willing to participate in this interview? __________________ Interviewee __________________ Witness __________ Date ______________________________________Legal guardian (if interviewee is under 18) 12 PATHFINDER INTERNATIONAL SAMPLE IN makeED CONSENT FORM Pathfinder International 9 Galen Street, Suite 217 Watertown, MA 02472 USA Tel 617-924-7200 electronic mail Informationpathfind. org 05/06/500.