Contents

Preface

Prologue

Acknowledgments

Chapter 1        Introduction

Chapter Objectives

Key Terms

Introduction

Overview of Program Planning and Evaluation

Role of Stakeholders

Needs Assessment

Review of the Literature

Completing the Literature Review

Development of Goals and Objectives

Implementation

Internal and External Evaluators

Types of Evaluations

Formative Evaluation

Summative Evaluation

Process Evaluation

Outcome Evaluation

Impact Evaluation

Logic Models

Goal Statements and Objectives

Inputs

Activities

Outputs

Outcomes

Summary

Case Study: Healthy Food/Healthy Students (HFHS)

Goal Statement

Objectives

Case Study Discussion Questions

Student Activities

References

Chapter 2        Ethics

Chapter Objectives

Key Terms

Introduction

Historical Background of Ethical Principles

Basic Ethical Principles

Ethical Links between Research and Evaluation

Institutional Review Board

Informed Consent

Risk–Benefit Assessment

Selection of Individuals and Special Populations

Ethical Guidelines for Evaluators

Challenges Faced by Evaluators

Confidentiality of Personal Information

Summary

Case Study: Diaz versus Hillsborough County Hospital Authority

An Inquiry

The Next Step

The Lawsuit

Doctors’ Perspective

The Settlement

A Postscript

Case Study Discussion Questions

Student Activities

References

Chapter 3        Determinants of Health

Chapter Objectives

Key Terms

Introduction

Historical View of Achievement in Health

Overview of the Healthy People Initiative

Using Healthy People 2020: Goals and Objectives

Determinants of Health

Policymaking

Social Determinants

Physical Determinants

Health Services

Health Disparities and Health Equity

Health Disparities

Health Equity

Using Healthy People 2020

DATA2020

Evidence-Based Resources

Healthy People in Action

Individual Health Risks and Behaviors

Health Risks and Life Expectancy

Biology and Genetics

Health Literacy

Summary

Case Study

Family One

Family Two

Family Three

Student Activity

References

Chapter 4        Theories and Models

Chapter Objectives

Key Terms

Introduction

Types of Theories and Models

Communities and Organizations

Individual Behavior Theories and Models

Strategic Planning Models

Gantt Charts

Action Plans

Strengths, Weaknesses, Opportunities, and Threats (SWOT) Analysis

Summary

Case Study

Case Study Discussion Questions

Student Activities

References

Chapter 5        Reliability and Validity

Chapter Objectives

Key Terms

Introduction

Reliability

Stability

Internal Consistency

Validity

Types of Validity

Threats to Internal Validity

Threats to External Validity

Relationship Between Internal and External Validity

Measurement Error

Random Errors

Systematic Errors

Reliable and Valid Research

Randomized Controlled Trial Designs

Adequate Sample Size

Free of Bias

Pilot Testing

Sample of Respondents

Data Collection for Pilot Tests

Data Analysis

Outcome

Summary

Case Study

Step 1: Review Existing Survey Data Step

2: Reliability of Existing Survey

Step 3: Validity of Existing Survey

Step 4: Creating a New Survey

Step 5: Pilot Testing

Step 6: One Year Later

Case Study Discussion Questions

Student Activity

Questions

Answers

References

Chapter 6        Qualitative Data

Chapter Objectives

Key Terms

Introduction

The Qualitative-Quantitative Debate

Qualitative Research: Validity and Reliability

Types of Qualitative Design

Interviews

Observations

Case Studies

Phenomenology

Historical Documents

Content Analysis

Ethnography

Grounded Theory

Ethical Issues in Qualitative Research

Analyses of Qualitative Data

Data Organization

Coding Data

Data Display

Summary

Case Study

Summary

Case Study Discussion Questions

Student Activity

Case Study 1

Case Study 2

Case Study 3

Case Study 4

References

Chapter 7        Evaluation Design

Chapter Objectives

Key Terms

Introduction

Elements of Design

Operational Definitions

Variables

Observations or Measurements

Treatments or Programs

Group Assignment

Constructs

Types of Design

True Experimental Design

Quasi-Experimental Design

Non-Experimental Design

Summary

Case Study

Operational Definition

Recruitment

Study Design

Data Collection

Case Study Discussion Questions

Student Activities

Case 1

Case 2

Case 3

Case 4

References

Chapter 8        Surveys

Chapter Objectives

Key Terms

Introduction

Survey Selection

Creating a Survey

Survey Data Collection

Types of Surveys

Tests

Personality Inventories

Scales

Cultural and Diversity Influences in Data Collection

Survey: Reliability and Validity

Summary

Case Study

Research Questions

Operational Definitions

Data Collection and Data Entry Training

Data Analysis

Case Study Discussion Questions

Student Activities

Questions

Answers

References

Chapter 9        Data Tools

Chapter Objectives

Key Terms

Introduction

Data Classification

Categorical Data

Continuous Data

Data Organization

Descriptive Data

Graphic Presentation

Measures of Central Tendency

Normal Curve

Standard Deviation and Variance

Summary

Case Study

Survey Questions

Case Study Discussion Questions

Student Activities

Answers

References

Chapter 10      Populations and Samples

Chapter Objectives

Key Terms

Introduction

Populations and Samples

Probability and Inferential Statistics

Null Hypothesis

Level of Significance

Sample Size Considerations

Margin of Error

Population, Sample, and Variability

Confidence Level

Budget and Budget Justification

Timeline

Probability and Nonprobability Samples

Probability Sampling

Nonprobability Sampling

Sampling Bias

Item Nonresponse Bias

Unit Nonresponse Bias

Summary

Case Study

Case Study Discussion Questions

Student Activity

Answers

References

Chapter 11      Inferential Statistics

Chapter Objectives

Key Terms

Introduction

Types of Statistics

The Need for Statistics

Inferential Statistics

Development of Research Questions

Null Hypothesis and Alternate Hypothesis

Basic Inferential Statistical Tests

One-Tailed and Two-Tailed Statistical Tests

Using Excel for Statistics

Chi-Square Test

t-Tests

Correlation Coefficients

Confidence Intervals

Type I and Type II Errors

Summary

Case Study

Case Study Discussion Questions

Student Activities

Answers

References

Chapter 12      Budgets and Cost Analyses

Chapter Objectives

Key Terms

Introduction

Budgets

Personal Budgets

Evaluation and Research Project Budgets

Budget Summaries: Profit and Loss Statements

Cost Analysis

Cost-Benefit Analysis

Cost-Effectiveness Analysis

Cost-Utility Analysis

Cost-Feasibility Analysis

Summary

Case Study

Case Study Questions

Student Activities

Answers

References

Chapter 13      Reports and Presentations

Chapter Objectives

Key Terms

Introduction

Types of Written Reports

Elements of the Report

Title Page

Table of Contents

Abstract or Executive Summary

Introduction

Literature Review or Background

Methods

Results

Discussion, Conclusion, Recommendations, and Future Research

References and Appendices

Writer’s Block Causes and Solutions

Presentation of Results

Oral Presentations

Tips for Successful Presentations

Poster Presentations

Summary

Case Study

Case Study Discussion Questions

Student Activities

References

Chapter 14      Case Study: Learn, Experience, and Achieve Program (LEAP): Program Planning and Evaluation

Year 1: Planning

Goals and Objectives

Theoretical Framework

Curriculum

Target Population and Sample Size

Study Design

Year 1: Program Planning

Personnel

LEAP Training

Website Development

Institutional Review Board

School Recruitment

Year 2: Implementation

Review of Program Planning

LEAP Curriculum

Cultural Competency

Development of Data Collection

Pilot Testing

Data Collection

Year 3: Evaluation

Process Evaluation

Outcome Evaluation

Data Analysis

Year 5: Results

Facilitators

Students

Parents

Principals and School Staff

Case Study Questions

Index