Instructor-Led
Training, Workshops, and Seminars
Environmental Compliance Training
Lawrence Livermore National Laboratory (LLNL), Environmental Protection Department
(EPD), U.S. Department of Energy (DOE)
ICF International is currently assisting LLNL's
Environmental Protection Department (EPD)
in the design, development, and delivery
of technical environmental
compliance training.
The LLNL courses are designed to meet regulatory
and DOE requirements and best management
practices for a wide variety of waste-related
issues. These courses cover technical job-specific
topics for LLNL staff at all levels who handle
hazardous waste. In total, ICF International
has designed and developed 18 courses for
LLNL, delivering them more than 450 times
since 1990. Employing performance-based training
(PBT) methods as described in DOE's Training
Accreditation Program (TAP) for each of these
courses, ICF International first conducts an
assessment of the target audience and its
training needs. ICF International then identifies
lesson objectives, prepared lesson plans,
and developed course materials, final examinations,
course evaluation forms, and other student
materials. Courses range in duration from
four hours to 24 hours.
Automated Contract Management System (ACMS)
User Training Course
Joint Chiefs of Staff, Comptroller's Office, U.S. Department of Defense (DoD)
ICF International worked with the Joint Chiefs
of Staff Comptroller's Office to redesign
and develop instructor-led training materials
on its proprietary procurement software
system, the Automated Contract Management
System (ACMS). The audience for this training
was primarily Action Officers, service personnel
from all branches of the military who routinely
create, modify, and manage acquisition packages
for the Joint Chiefs of Staff. ICF International
developed instructor and student materials
that not only provided content knowledge
about ACMS, but also included multiple hands-on
exercises that simulated the creation of
different types of acquisition packages requesting
various supplies and services in an ACMS
test environment. In addition, ICF International
developed a comprehensive desk-side ACMS
Reference Guide that provides step-by-step
instructions on completing critical processes
associated with building various types of
acquisition packages in ACMS.
Advanced Maintenance and Munitions Officers
School (AMMOS)
Air Combat Command, Maintenance Training Branch, U.S. Air Force
ICF International worked with Air Combat Command
to develop an integrated Air Force CORONA-directed
training initiative for logistics officers.
The training was developed to provide a high-level
understanding of all facets of logistics
operations on par with the Air Force Weapons
School. The project included developing the
benchmark Concept of Training, P-Plan Implementation,
curriculum development and validation, facility
design and equipage, and systems management
and classroom instruction by four on-site
contract instructors.
ICF International helped the Air Force develop
instructor cadre and candidate selection
processes and instructor qualification requirements.
Our on-site staff developed curriculum, systems
requirements, and monitored Site Activation
Task Force (SATAF) actions. ICF International
continues to provide the latest expeditionary
logistics and Agile Combat Support (ACS)
initiatives to ensure that the AMMOS curriculum
stays synchronized with the Expeditionary
Aerospace Forces (EAF) vision. ICF International
offers direct support of the computer systems
and software as well as mentoring and guidance
to AMMOS candidates during execution of the
curriculum.
Transition Management and Blended Training
Program Development
U.S. Federal Aviation Administration (FAA)
When the Federal Aviation Administration
(FAA) redesigned its acquisition management
system (AMS), it required a blended-learning
intervention to manage the human performance
aspects of the change. ICF International developed
and presented a series of learning interventions
designed to orient FAA acquisitions personnel
to new responsibilities. Specifically,
ICF International developed a blended learning
approach that included self-paced e-learning,
face-to-face instruction, distance learning,
and forums. The AMS overview seminar was
instructor-taught and delivered in a classroom/auditorium
setting of about 50 students on a monthly
basis. The presentation included topic
areas such as a historical perspective of
acquisition problems in the FAA, the legislative
mandate for AMS, and the policy and guidance
of AMS. In addition, ICF International planned,
arranged, and facilitated a forum for the
FAA acquisition workforce, agency customers,
and prospective vendors that allowed participants
to share best practices and acquisition management
innovations. In total, more than 1,500
FAA employees and support contractors were
trained.
Design and Development of Instructor-Led
Course: Producing Results
Center for Medicare and Medicaid Services (CMS), U.S. Department of Health
and Human Services (HHS)
The Center for Medicare and Medicaid Services
(CMS) is undergoing a major transformation
in response to the Medicare Modernization
Act, which is changing dramatically how medical
services are provided to elderly and low-income
Americans. In response to the many new requirements
and provisions in the Act, CMS must significantly
change its strategies, business processes,
core values, and behaviors. CMS had already
developed four courses in its Dimensions
of Leadership program to help non-managers
function in a more integrated way. CMS asked
ICF International to develop a fifth course,
"Producing Results," as the final
portion of its overall curriculum. The
2-3 day course focuses on a variety of topics
including systems thinking, working across
teams, and fostering individual and organizational
accountability. The project involves developing
a detailed instructor manual and participant
manual, conducting a train-the-trainer session
with the managers who will facilitate the
workshop sessions, attending a pilot delivery
of the course, and modifying the final course
based on the pilot.
Training to Introduce New EDL and ATLAS
Technology
U.S. Postal Service (USPS)
ICF International, working with USPS, developed
the Enhanced Distribution Label (EDL) and
Automated Tray Label Assignment System (ATLAS).
The EDL is a new, 24-digit barcoded tray
label that allows for unique identification
of each tray. The ATLAS system is a Web-based
software application that allows postal workers
to print the EDL from a centrally located
workstation or from machine-side printers.
The transition to the ATLAS system required
the vast majority of the more than 700,000
career employees in the USPS to understand
the human readable information on the EDL,
the main functions of the ATLAS program,
and the changes in mail distribution processes
necessary to make each tray individually
identifiable. ICF International developed a
comprehensive training and communications
plan to introduce the new technology to postal
workers. ICF International's blended learning
solution included train-the-trainer workshops
delivered to regional sites across the United
States, an on-line Help system integrated
into the ATLAS application, and interactive
Web-based training. In addition, ICF International
developed a variety of communication materials—from
a distinctive logo to posters, brochures,
pocket cards, and Web site content—to
launch the new technology. The EDL/ATLAS
program was launched officially in late summer
2005. Employee response has been extremely
positive, and USPS expects to apply the lessons
learned from this technology launch to future
technology introductions.
Organizational Transition Learning Events
in Response to the President's Management
Agenda (PMA)
Division of Human Capital Leadership
and Merit System Accountability (HCLMSA), U.S. Office of Personnel Management
(OPM)
ICF International was chosen by OPM's
Office of Human Capital Leadership and Merit System
Accountability (HCLMSA) to develop a series
of workshops ("Knowledge Exchanges")
designed to share best practices and disseminate
key information to federal agency practitioners
responsible for improving human capital
management and performance. The workshops
were designed in response to the requirements
laid out in the President's Management
Agenda, OPM's Standards of Success, and
the Human Capital Assessment and Accountability
Framework. Thus far, Knowledge Exchange
Workshops and subsequent workshop development
have focused on the topics of Diversity,
Accountability, Human Resource Flexibilities,
Workforce Planning, Performance Planning,
and Succession Planning. In developing
these workshops, ICF International has helped
OPM and other federal agencies to structure
and define emerging human capital issues;
formulate models, strategies, and tactics
that can be introduced into the management
operations of a variety of core federal
agencies; and provide highly interactive
learning experiences to federal agencies
and other stakeholders.
Train-the-Trainer Seminars
Office of Radiation Programs, U.S. Environmental Protection Agency (EPA)
ICF International has a long record of successfully designing, developing, and
delivering training in the "green building"
field—from
radon and indoor air quality to Green Lights,
ENERGY STAR Homes, and beyond. ICF International
has also developed and taught “train
the trainer” courses developed to
teach others how to present a particular
product, such as ENERGY STAR HVAC or ENERGY STAR Homes opportunities, or to teach clients
the key elements of successful stand-up
training in a classroom. Finally, ICF International
has long been a contractor of choice for
EPA and DOE in developing and delivering
technical training in wide range of environmental
topics.
ICF International provided logistical support
to EPA's Office of Radiation Programs in
setting up five "Reducing Radon in
Structures" seminars and two "Train
the Trainer" seminars. The "Reducing
Radon in Structures" course was held
in cities across the United States and was
open to all radon contractors. The "Train
the Trainer" seminars were held in
Kansas City, Missouri, and Newark, New Jersey,
and were open to individuals selected by
EPA.
Simulations and Tabletop Exercises
State Terrorism Exercises
ICF International assists U.S. state and local
agencies in designing customized single and
multi-jurisdictional tabletop, functional,
and full-scale exercises. Recent clients
include Colorado, District of Columbia, Florida,
Iowa, Massachusetts, Nebraska, and Tennessee.
Scenarios include responses to chemical,
biological, and radiological weapons of mass
destruction (WMD), communicable animal disease,
dam
failure, and energy
infrastructure failure. Learn more about
ICF International's disaster response programs and
services.
CBRNE/WMD Exercises for State and Local
Governments
U.S. Department of Homeland Security (DHS)
ICF International supported the Department
of Homeland Security (DHS) Office for State
and Local Government Coordination and Preparedness
(OSLGCP) with the development and delivery
of its national exercise program to prepare
state and local governments for chemical,
nuclear, biological, radiological, or explosive
WMD incidents. CBRNE refers to chemical,
biological, radiological, nuclear, and high-yield
explosives. We provided technical assistance
in designing, controlling, and evaluating
WMD exercises, including terrorism scenarios
that target critical
infrastructure.
Agroterrorism and Agricultural Emergency
Exercises
Nebraska Counties and U.S. Food and Drug Administration (FDA) Office of Emergency
Operations
In 2004, ICF International developed and conducted
a tabletop exercise and a functional exercise
to prepare Nebraska counties to respond to
outbreaks of foot and mouth disease caused
by acts of agroterrorism. The exercises brought
together local, state, federal, and private
sector representatives to address the critical
response time immediately after the disease
is identified and before federal resources
arrive. Previously, ICF International supported
the FDA Office of Emergency Operations in
developing response plans, two tabletop exercises,
and a functional exercise relative to potential
outbreaks of bovine spongiform encephalopathy
(BSE), also known as "mad cow disease."
Meeting Facilitation
Facilitation of Strategy Mapping Sessions
for the Human Capital Office and Embedded
Executives and Senior Managers
Planning and Measures Division, U.S. Internal Revenue Service (IRS)
In an effort to identify and prioritize
its human capital needs, IRS convened leaders
from across the organization to complete
a series of "strategy mapping sessions."
The purpose of the mapping was to evaluate
the alignment of IRS's human capital objectives
with business goals, then gain consensus
on the strategies necessary to achieve those
human capital objectives. The final outcome
was a balanced scorecard that mapped IRS
human capital strategies against activities/initiatives
that support them. The scorecard will be
used to determine IRS's strategic human capital
priorities. The eight full-day mapping sessions
were attended by approximately 25 executives
and senior managers. IRS's Deputy Director
for the Planning & Measures Division
asked ICF International to facilitate the final
three strategy mapping sessions. (ICF International
was continuing the work of an earlier firm.)
ICF International's expert facilitator led participants
through a crowded schedule of agenda items
and maintained the meeting pace by summarizing
participant observations and suggesting ways
to reconcile competing views. IRS's feedback
was universally positive. ICF International's
final task was meeting with the Deputy Director
to share observations on meeting dynamics
and recommend next steps.
Economic Development and Workforce Development
Conference
Department of Labor, Union County, New Jersey
ICF International assisted in the development
of a strategic plan to integrate the plans
and activities of Union County workforce
development and economic development efforts.
Union County hosted a summit of more than
300 workforce development and economic development
professionals. The two-day summit examined
how these two professions could better coordinate
their efforts and work collaboratively. ICF International developed and facilitated the
summit, and we created interactive case studies
that would highlight both the problems and
the opportunities for better collaboration
between these two groups. The outputs of
the summit guided the county's effort to
develop the strategy so that these groups
would work in concert to foster both economic
development and increased employment in the
county.
Consultation and Facilitation Services
Division of Research, Analysis, and Statistics, Office of Program Evaluation
and Risk Analysis (OPERA), U.S. Internal Revenue Service (IRS)
This project
involved the design and facilitation of a management off-site meeting for
the Director of the IRS Office of Program Evaluation
and Risk Analysis (OPERA) and his senior
management staff. After preliminary consultation
with the Director of OPERA and designated
members of his staff, ICF International's
expert facilitator participated in a bi-weekly
OPERA managers meeting to share the plan,
approach, expectations, target outcome/measure
of "success," and
timeline. ICF International went on to prepare
and deliver a team-building workshop to
eight participants over a two-day period.
This workshop focused on OPERA's mission,
vision, role within the organization, and
long-term goals, moving on to address such
topics as communication, collaboration, team
development, change management, functional
versus matrix organizations, leadership,
internal marketing, and succession planning.
After the team-building session, ICF International
prepared and delivered a debrief document
to verify that the objectives of the team-building
session were met and suggest recommendations
for next steps. By the end of the session,
OPERA managers had a clearer sense of direction
and a better picture of the contributions
and value OPERA adds to the IRS. Participants
learned to develop and clarify expectations
of the management team, and managers discovered
how OPERA aligns with overall IRS strategy
and how to promote OPERA's services more
effectively to internal clients.
Kirkpatrick Evaluation
Levels 2 and 4 Procedural Guidelines and
Templates: Evaluating Training Effectiveness
U.S. Internal Revenue Service (IRS)
ICF International was asked by the IRS to develop
content for the IRS Integrated Training Evaluation
and Measurement Services (ITEMS) Web site,
accessed by IRS employees involved in training
design, development, administration, and
evaluation. ICF International experts developed
procedural guidelines and templates for conducting
modified Kirkpatrick Level 2 (learning or
achievement) and Level 4 (organizational
impact) evaluations. ICF International evaluation
experts first developed Level 2 sections
covering the principles of criterion-referenced
testing suitable for application to IRS training;
step-by-step procedures and templates for
establishing reliability of test instruments;
expansion of existing coverage of item statistics;
and practical guidelines and procedures for
complying with issues involving the Americans
with Disabilities Act, adverse impact, and
protected classes in the IRS testing arena.
ICF International went on to develop step-by-step
procedures and templates for conducting Level
4 evaluation studies that address the specific
concerns of the federal sector. Specifically,
ICF International consultants devised an innovative
methodology for conducting Level 4 evaluations
that do not employ the use of traditional
control groups and do not focus on return
on investment, a measure more appropriately
suited to a for-profit environment. The procedural
guidelines and templates developed by ICF International now appear on the ITEMS Web site.
Management Training and Evaluation
Defense Finance and Accounting Service (DFAS), U.S. Department of Defense (DoD)
DFAS
contracted with ICF International to help them design and deliver a management/leadership
development program to identify and prepare
future DFAS managers and supervisors, as
well as improve overall leadership skills
throughout the organization. ICF International
worked with DFAS to develop a curriculum
map based on previously identified competencies,
then developed 14 courses tailored to the
three groups of DFAS managers—supervisors,
managers, and executives. A key element
of the development was the inclusion of
a comprehensive evaluation process through
two pilot deliveries of each course.
More than 100 offerings of the 14 courses
have been given in the past three years.
Evaluation instruments administered include
a student satisfaction evaluation (Kirkpatrick
Level 1) for all courses and an end-of-course
test for most of the supervisor-level courses
(Kirkpatrick Level 2). ICF International's Quality
Assurance Program for the DFAS courses includes
an automatic assessment and corrective action
process whenever either of these evaluation
techniques triggers a cause for concern (such
as an average score below a pre-set number
in student evaluations of instructor's ability).
DFAS is also considering the conduct of a
Kirkpatrick Level 3 analysis of the courses
to assess whether and to what extent the
skills acquired through the training are
being applied on the job.
Training Evaluation and Quality Assurance
U.S. Federal Aviation Administration (FAA)
ICF International assisted the FAA's Air Traffic
Organization's Workforce Development staff
with the design, test, documentation, and
implementation of a Training Quality Assurance
(TQA) program that collects and analyzes
data on formal training provided to these
field technicians in the FAA's maintenance
organization. The TQA program assures technical
workforce proficiency through the evaluation
and reporting of substantiated training problems,
recommending changes to curricula, drawing
awareness to training policies, identifying
solutions to training problems, and reporting
on issue closure and business impacts. The
scope of ICF International's support has been
broad, ranging from specific course content
issues to administration of the training
quota assignment process. The TQA program
focuses on training evaluation at Level 3
(application of learned skills on the job)
and Level 4 (impact or contribution to organization
goals). Data is collected from a variety
of sources including direct interviews on-site
with technicians at the nation's busiest
airports. Evaluation findings are formally
recorded in a database, tracked to resolution,
and reported to management.
Evaluation of Leadership Development Program
Substance Abuse and Mental Health Services Administration (SAMHSA), U.S. Department
of Health and Human Services (HHS)
ICF International conducted a needs assessment
that helped guide the creation of a new
Leadership Development Program (LDP) at the
Substance Abuse and Mental Health Services
Administration (SAMHSA). ICF International developed
five instructor-led courses, as well as seminars,
coaching, and management orientation programs
to address the most vital needs of leaders
in this community. Each training course or
other learning event includes a Level I evaluation
to gauge participant satisfaction with the
course. Additionally, ICF International will
conduct a more robust evaluation of the program
to shape the curriculum and other learning
interventions for future years of the program.
At the same time, ICF International will evaluate
the LDP from a return-on-investment (ROI)
outcomes perspective to enable SAMHSA to
determine how best to use scarce human capital
and funding resources, as well as ensure
that the LDP is consistent with the goals
and mission of the organization.
Design, Develop, and Validate Accounting
Knowledge and Skill Assessment Tests and
Related Training Modules
U.S. Federal Deposit Insurance Corporation (FDIC)
FDIC Corporate University
contracted with ICF International to develop basic and bank
accounting assessments (pre- and post-tests)
that will be used to ensure that newly
hired bank examination employees have a basic
level of competency in fundamental accounting
concepts and bank-specific accounting theory
and terminology. Those employees who do not
pass the assessments will be provided training
modules to study before retaking the tests.
In general, all newly hired employees will
complete the modules or pass assessment tests
in accounting prior to attending Introduction
to Examination School (IES). New hires generally
attend IES within six to 10 months of their
start date with the FDIC. Project activities
include development of question banks of
basic and bank accounting test items, surveying
and evaluating commercial off-the-shelf (COTS)
products to determine their viability as
study material, piloting the assessments
to validate test reliability and validity,
and assistance in the development of custom
FIDC study materials. |
