Loren Data's SAM Daily™

FBO DAILY ISSUE OF AUGUST 28, 2010 FBO #3199
SOLICITATION NOTICE

U -- EVALUATION WORKSHOPS

Notice Date

8/26/2010
 

Notice Type

Combined Synopsis/Solicitation
 

NAICS

611420 — Computer Training
 

Contracting Office

Department of Veteran Affairs;Employee Education System (EES);Attn: Contracting Office BLDG 50;#1 Jefferson Barracks Dr;Saint Louis MO 63125
 

ZIP Code

63125
 

Solicitation Number

VA77710RQ0244
 

Response Due

8/31/2010
 

Archive Date

10/30/2010
 

Point of Contact

Linda Eley
 

E-Mail Address

ct
 

Small Business Set-Aside

Total Small Business
 

Description

This is a combined synopsis/solicitation for commercial items prepared in accordance with the format in Subpart 12.6, and 13, as supplemented with additional information included in this notice. This announcement constitutes the only solicitation; proposals are being requested and a written solicitation will not be issued. The provisions and clauses incorporated herein are those in effect through Federal Acquisition Circular 2005-23, effective Jun 12, 2008. The Department of Veterans Affairs Medical Center/Employee Education Resource Center, St. Louis, MO proposes to enter into a non-competitive commercial contract with ROI Institute, 350 Crossbrook Drive, Chelsea, AL. This solicitation is unrestricted and The North American Industry Classification System (NAICS) is 611430 and the small business size code is $7.0 million. Point of contact is Linda Eley, Contract Specialist, linda.eley@va.gov STATEMENT OF WORK Evaluation with Return on Investment (ROI) Training and Project Based Application 1.BACKGROUND The Employee Education System was established in 1996 as a VA Central Office (VACO) Program Office under the VHA Principal Deputy Under Secretary for Health. As VHA's National Education Program Office, EES provides training programs, products, and services that support VHA's strategic goals, objectives, strategies, and performance measures. EES develops and delivers quality educational programs, products, and services using sound educational design and evaluation and employing a variety of delivery methods. Through its strategic focus area (SFA) prioritization process, EES aligns its programs, products, and services with VHA's strategic educational priorities. In FY09, EES delivered 6,269 programs and products, 884 other services, and 4,235 accredited programs utilizing approximately 20 different modalities for the delivery learning. One of several EES specialty units providing national coordination of a core function across the organization is the Measurement Unit. The EES Measurement Unit is led by the National Measurement Coordinator and is responsible for providing support and coordination related to EES learning measurement activities including data management, analysis and reporting. The over arching goal of this unit is to build EES capability in demonstrating the value and outcomes resulting from the learning and performance solutions offered. Among the many services offered to strengthen the alignment and results of learning solutions, the EES Measurement Unit provides the oversight and management of EES standard data collection and survey systems that gather program evaluation data and feedback from participants. Since 1999, the Employee Education System (EES) has adopted and implemented the Return on Investment (ROI) Methodology developed by Jack Phillips of the ROI Institute, Inc. within VA. The ROI methodology has been deployed throughout VA in order to provide a framework and model of practice for improving the assessment, design and evaluation of training and performance improvement programs to ensure they are measurable and results-focused and to demonstrate the impact and benefits realized of investments made to these educational and performance-based initiatives. EES began using the ROI ProcessTM in 2002 to strengthen evaluation and enhance educational assessment, design and evaluation. EES has partnered with Veterans Integrated Service Networks (VISN's) to train staff and/or to conduct ROI/Impact Analysis studies as well as EES project managers and education specialists. Trained VA and EES staff are being prepared to conduct studies of VA selected educational interventions to measure the impact and effectiveness of the ROI training within the organization on five key levels: (Reaction, Learning, Application, Business/Organizational Impact, and Return on Investment) and include methods for isolating the effects of the solution. Preferably, study plans are developed concurrently with the planning of the educational intervention. Levels 1 and 2 evaluations are conducted during the classroom education. Levels 3 and 4 evaluations are done at the work site where the learned knowledge and skills are applied. The impact of the applied learning can be measured 3 - 9 months after the training is completed. The final report is typically completed within 12 months of the training. 2.PURPOSE The Department of Veterans Affairs, Employee Education System's (EES) Measurement Unit requires training and measurement studies for ongoing strategic initiatives to link learning to performance and measure impact. EES desires to enhance and develop capability within VA and EES to measure the impact of learning and performance improvement initiatives as well as calculate return on investment (ROI) by providing appropriate training to EES project management employees. The overall goal is to provide a consistent, systematic, theoretically sound and credible ROI process that can be used throughout VA for measurement and results-based practice to determine the effectiveness of the training and performance improvement initiatives. 3.OBJECTIVE The objective of this effort is to develop the capability of EES project management staff by offering a 3-day hands-on workshop with application projects that will develop the skills required to complete higher level evaluation and ROI impact studies consistent with previous organizational efforts using the Jack Phillip's ROI Methodology. 4.DELIVERABLES AND TASKS Task 1: 3-day ROI Workshop (Timeline: To be held within 14 days of contract award) The Contractor shall provide the following related to the 3-day workshop: a)A description of the 3-day workshop that provides participants with hands-on measurement experience. a)Detailed workshop agenda with timelines and topics to be covered. b)Workshop pre-work assignments and materials c)Workshop syllabus with handouts and exercises that address all the objectives. d)Workshop evaluation instruments that include a pre-post test to assess learning and satisfaction, and a follow up questionnaire to assess application and identify barriers and enablers to performance. e)10 coaching sessions conducted with participants related to unique evaluation projects to reinforce and apply skills learned at the workshop. "10 coaching sessions with workshop participants "Coaching sessions conducted via teleconference "Duration of each coaching session - 60 minutes. f)Measurable course objectives at level 1 (satisfaction), level 2 (Learning), level 3 (application), and level 4 (business impact) that include: "Setting objectives which reflect ultimate outcomes "Determining the timing of data collection "Selecting appropriate data collection instruments "Identifying factors which influence results "Selecting appropriate strategies for Isolating the Effects of Training "Calculating or estimating the value of an improvement "Identifying and monitoring appropriate program costs "Applying simple statistical tools to data analysis "Analyzing data including calculating the actual return on investment "Presenting evaluation data to target audiences "Implementing the ROI process "Gaining management support for training "Identifying and removing barriers to implementation of the ROI process "Providing internal consulting on ROI Task 2: Impact Analysis and Return on Investment (ROI) Studies The Contractor shall work with the ROI workshop select participants to plan, design, implement, analyze and report the impact and ROI of 2 selected ROI projects. Each study should follow the ROI Process and include: a)ROI study planning: The contractor shall plan and facilitate an ROI study planning meeting with the project team to clearly identify the study purpose and objectives, and to design a data collection plan and ROI analysis plan. The study plan shall include 5 levels of evaluation objectives, measures, data sources, data collection methods, accountabilities and timeline for the study. b)Data collection: The contractor shall develop data collection instruments in order to accomplish the objectives of the ROI study plan. The contractor shall facilitate the gathering of data and information in support of the data collection plan. Data collection shall also include fully-loaded costs associated with the projects. c)Data analysis: The contractor shall review, analyze and synthesis data collected to identify the extent to which learning, application, business impact, ROI were realized and study objectives met. d)Data reporting: The contractor shall document the results and findings from the evaluation and ROI studies in a written report containing the following elements: "Title page with project title, data and author(s) names. "Table of contents "Executive Summary "Methodology "Results "Recommendations "Appendices Task 3: Monthly Status Report (Timeline: To be submitted on the last business day of each month) The contractor shall provide the COTR/EES Project Manager at a minimum a monthly progress report that includes the following elements: a)Narrative description of work completed against each task, with status of deliverables for each task. b)Brief description of evaluation/ROI studies. c)Brief summary of accomplishments during the reporting period and significant events regarding task. d)Deliverables submitted or progress on deliverable products. e)Conference calls and meeting with VA/EES staff including the date, time, names and method of communication of those contacted and a brief description of the meeting. f)Any current or anticipated problems. g)Brief summary of activity planned for next reporting period. 5.QUALITY ASSURANCE PLAN TaskQuality StandardsAcceptable Quality LevelMeans of MeasurementPenalties/Incentives 1.0Training objectives listed in the syllabus for the 3-day workshop have been met All objectives addressed COTR concurrence Rework at no cost to Government. Delays not approved by COTR will be noted in performance evaluation. 2.0 ROI study plan provided electronically All objectives addressed Study plan provided electronically COTR concurrence Rework at no cost to Government 2.0Data collection and analysis completed according to data collection plan All objectives addressed COTR concurrence Rework at no cost to Government 2.0ROI study report provided electronically All report requirements met as listed. COTR concurrence Rework at no cost to Government 3.0Monthly progress report provided electronically Progress reports provided on the last working day of each month until all projects are completed. No later than the 3rd of each month. Rework at no cost to Government 6. CONTACTS Melissa Scherwinski Employee Education System National Measurement Coordinator Phone: 202-674-9081 Email: Melissa.Scherwinski@va.gov 7.PLACE OF PERFORMANCE Place of planning meeting will be selected by the VA project team but will reside within the U.S. The majority of the project shall be conducted via email and conference call. The following provisions and clauses shall apply to this solicitation: 52.252-2 Clauses Incorporated by Reference. This contract incorporates one or more clauses by reference, with the same force and effect as if they were given in full text. Upon request, the Contracting Officer will make their full text available. Also, the full text of a clause may be accessed electronically at this/these address (es): http://www.arnet.gov/far (FAR) and http://www.va.govoa&mm/vaar/ (VAAR); 52.212-1 Instructions to Offerors Commercial Items; 52.212-2, 52.212-3 Offeror Representations and Certification-Commercial Items. Offerors must include a completed copy of the FAR 52.212-3 Offeror Representations and Certification along with his/her proposal; FAR 52.212-4 Contract Terms and Conditions Commercial Items; 52.212-5 Contract Terms and Conditions Required to Implement Statutes on Executive Orders Commercial Items and in accordance with FAR 12.603(c) (2)(xii) and VAAR 852.270-4 Commercial Advertising; 852.237-70 Contractor Responsibilities; and 852.270-1 Representatives of Contracting Officers.
 

Web Link

FBO.gov Permalink
(https://www.fbo.gov/spg/VA/VAAAC/VAAAC/VA77710RQ0244/listing.html)
 

Place of Performance

Address: TBD

Zip Code: 6
 

Record

SN02255605-W 20100828/100826235415-ab47af85815db2561722d155214c62f4 (fbodaily.com)
 

Source

FedBizOpps Link to This Notice
(may not be valid after Archive Date)

---

| FSG Index  |  This Issue's Index  |  Today's FBO Daily Index Page |