Pilot & Scale

What are the anticipated outcomes of the Program?

Booz Allen proposes a multi-track program to develop of a community of digital service acquisition experts across the Federal Government. Similar to the pace and change of the tech industry, our proposed program establishes a flexible and scalable framework – both in terms of the content sections and learning methods – that can evolve with new interpretations of acquisition policies, new case studies, and direct community input.

As outlined in Figure 5 below, the program should integrate the experience with the mature acquisitions training offerings provided through established venues such as the DAU and FAI.

We envision a future where the 80-160 hours of this program are supplementary to portions of the Level II and III certification. Ultimately, students with general contracting and procurement experience (similar to Gary and Emma of the personas described earlier), will participate in a pilot program through already mandated and budgeted training for their respective agency. The program aims to quickly promote and incorporate experience through existing venues for affected agencies such as the Treasury Acquisition Institute (TAI).

Depending on the participant and agency’s competing priorities, we highly recommend the coordination of this program with a rotational program with USDS to support the acquisitions planning and execution of a digital service initiative across government. At the end of the program, the new digital service contracting professionals will visibly exhibit the knowledge and behaviors outlined in the 13 digital service plays and will become stewards for the evolving IT contracting landscape.

What are the objectives for the pilot?

Booz Allen recommends designing a pilot that runs between four and six months to test content and learning methods. The pilot will build awareness and foster interest in the digital service training and development program. The pilot will be primarily composed of 25-30 students with general procurement experience and an awareness of digital service processes (similar to the Gary persona). Nonetheless, we recommend diversifying the student base with 4-5 students representative of the Emma persona (thorough knowledge of acquisitions in general, no experience in digital service) given the longer-term opportunity to target education for Contracting Officer’s Representatives (COR) and select business and IT program managers. We recommend to structure this around 80 hours of formal in-class training, and 4-6 hours per week over the remaining 3-4 months for an estimated 160 hours per student. This is in line with existing FAC-C level II and III certification commitments and as previously articulated an opportunity for integration in future iterations of the program. Throughout the pilot, monitoring and feedback mechanisms will be established and promoted to gather input and inform improvement of the content and delivery aimed at increasing engagement and satisfaction for the next iteration.

Our initial focus will be on experienced acquisition experts interested in furthering their skills in modern IT product, platform, and services acquisition. We recommend selecting candidates across multiple agencies that are currently supporting the stand-up of digital service teams or high-profile initiatives with OMB and USDS (e.g., redesign of a major consumer-facing .gov website). Additionally, the expectation is that many members of the first cohort will become trained trainers and mentors for future events beyond the initial pilot as program starts to scale across government.

What are the options to pilot this Program?

The program content could be piloted using one of two approaches. Both of these approaches would adopt the Digital Service best practices of testing solutions and using an iterative approach to delivery.

1)

Develop an in-depth segment of content. Pick one key topic or section of the Digital Service Playbook; design, develop, pilot, and evaluate the learning solution components for this one topic. The successes and failures learned from this segment would then be applied to development of the additional segments. This solution provides a cost-effective way of producing a program that will engage, apply to, and resonate with the digital service contracting professionals. The program can be scaled to include the priority topics and additional topics can be added in the future to create an even more robust and complete solution.

2)

Go broad and develop a core program. A core program with the critical topics can be developed using an iterative approach with feedback to ensure success. After the core program is implemented and evaluated for effectiveness, additional topics can be added to make the program more robust. There are multiple advantages to this approach:

The program would be basic, but encompass the entire acquisitions process.

Once implemented, the participants will immediately apply new knowledge and skills to meet the program goal — improving the way the government builds and buys digital service.

One of the key success factors in this program is learning from experts and learning from peers. By establishing the core program first, the students who have completed the program can use their knowledge to contribute to the community and the curriculum through the Community of Practice (COP), presenting in the classes, or creating videos to support the learning.

The core program would be available as a separate track. Not all Contracting Officers, Contracting Officer’s Representatives, Program Leaders, and Contracting Specialists require the full training program. The core program, as initially developed, will stand on its own for an audience who needs only high-level or entry-level training on digital service acquisitions.

Based on Booz Allen Hamilton’s experience and expertise in learning strategy, the second option would provide a greater benefit as a pilot to learn and inform the design of tomorrow’s full-scale program.

What would be required from Program stakeholders?

The pilot will focus on developing new interactive content and tools in an iterative fashion. For the best results, we recommend a diverse group of stakeholders from key agencies participate. The following is an initial set of government stakeholders required and commitments to make this a successful pilot.

Step

Activities

Government Stakeholder Requirements

Setting the Stage

Research and data-gathering on content, priorities, audience needs, learning goals

Input from subject matter experts covering a broad range of digital service acquisition needs

Focus groups and user interviews with existing COs, CORs, program leaders, and specialists

Contribute content, use-cases, scenarios

Program Design

Establish the learning objectives, delivery methods, material resources, and sequence for effective and efficient learning tools

Input on program priorities, learning goals, processes details, realistic scenarios, and existing resources

Program Development

Development of tools, course materials, assets, and COP sites would be developed based on the design

SME reviews would be required to ensure the information is accurate, complete, and will meet the learning goals

Meetings and interviews with the target audience will offer insight into the needs and delivery methods

Implementation

SME delivery

Acquisitions experts (SMEs) will be needed to participate as guest speakers and contribute to COP activity

Logistics support for identifying participants and arranging training sessions

Members of the potential audience to participate in the pilot sessions from start-to-finish

Evaluation

Collect evaluation data to validate content and delivery methods

Designated stakeholders need to participate in the training sessions to provide feedback and observations

What are the cost assumptions of the Program?

Programs of this nature do not live in isolation, but rather they integrate with many existing public (Defense Acquisition University, FAC-C Certification) and private sector (General Assembly) offerings. At this stage of the concept, we recommend assessing total program costs in terms of:

1)

Setup costs associated with developing content and imparting the training for the pilot

2)

Ongoing cost per student after the pilot for an equivalent 3-6 month development effort

3)

Monthly or yearly maintenance cost to continuously improve and inject fresh content and learning methods

Given the broad nature of this training, intensity and length, and the required specialization by both the facilitators and the participants, we anticipate a cost per participant equivalent to many modern education offerings out in the market today.

Many factors should be contemplated when calculating the overall cost of the program, including but not limited to:

Government participant time (e.g., paid professional development or optional personal development, on weekdays or weekends, after hours)

Government or private sector facilitator or SME time

Facilities and additional materials for classroom training

Initial content development by vendor(s)

Ongoing online content management

Online knowledge management and collaboration tool(s) configuration and maintenance

Online infrastructure hosting and management (e.g., is the content hosted by DAU and thus a cost that does not need to be accounted for by this program)

Train the trainer whereby the home organization absorbs cost of future iterations of the training by the trainer with the rest of his or her agency’s procurement office

Speed of scale to the +10,000 IT professional services acquisition core

These are not nice to have skillsets, but at the core of what will enable government to deliver high-visibility and high-value digital service at a fraction of today’s costs.

What are the estimated costs to implement the Program?

Many of the start-up costs in the pilot will be allocated towards fundamental improvements to the content and learning methods, which will be informed by student feedback. The core curriculum and products developed will be modular and reusable by existing training and learning programs, reducing the cost per participant in the future. Taking these factors into account and comparing to similar offerings across the market today, the cost of the program is estimated below:

Cost of pilot = ~$320K — $450K

Cost per student for future iterations after the pilot = ~$5K — $6K (akin to similar level certification costs)

We also recognize that many Government Fiscal Year training budgetary plans may be determined by the time this pilot initiates. Assuming no additional government costs to engage and impart the pilot (e.g., student time), Booz Allen is confident it can design, develop, and execute a minimum viable version of the proposed experience with the planned challenge awards for winning proposals.

These cost estimates are subject to change based on the assumptions and possibilities of integrating with existing government learning programs. The solution will result in many tangible and intangible returns for the Federal Government.

What is next?

Urgency

Digital service and IT procurements are in the works. The sooner this program is designed, developed and implemented, the greater impact it will have on current procurements

Groundwork

Having established the framework for a successful and innovative learning solution and hosted our white paper on GitHub for feedback, we have started the journey and are confident we can hit the ground running as we can limit strategic planning, upfront design activities, and related costs

Show, Not Tell

The successful demonstration of this innovative program through the mock classroom training (phase II) will demonstrate our expertise in learning strategies and understanding of the complexities of digital service procurement

Making a Difference

We are ready to work with you to make this program a success and help to “dramatically improve the way the government builds and buys digital service”

.

Meet Our Team of Experts

Ron Sanders

Booz Allen Industry Leader in Human Capital and Organizational Development

Bryce Pippert

Booz Allen Leader in Digital, Open Data, and Analytics Solutions

Brian Love

Booz Allen Leader in Digital Citizen Services and Design Thinking

Juli Dixon

Booz Allen Leader in Acquisitions and Procurement Mastery

Dan Tucker

Booz Allen Leader in Modern Systems Delivery

Kendra Herlig

Booz Allen Leader in Learning Strategy and Instructional Design