Needs Assessment

LMNOP Aviation

Business Unit: Domestic Service Center Network
Assessment Window: 2 months (remote data collection)

Note: LMNOP Aviation is a pseudonym. Proprietary metrics and key information were anonymized.

Challenge

LMNOP Aviation operates one of the largest Domestic Service Center Networks (DSN) and faced significant operational inefficiencies. Leadership initially identified the inefficiencies as a lack of project management knowledge and requested project management training for frontline staff. An organizational scan suggested that the gaps were rooted in systemic environmental issues rather than individuals' knowledge gaps, which led to a full needs assessment.

The organization faces a complex market landscape defined by rising demand for maintenance services, significant parts shortages, and a shifting technician demographic. To remain competitive, the network must maintain high levels of operational efficiency and customer trust.

Target

The assessment targeted two primary metrics: Productivity and Invoice Accuracy. Less than one-fifth of locations met organizational goals for both metrics.

Productivity: Potential impact of up to $18 million annually.

Invoice Accuracy: Potential impact of up to $10.36 million annually.

Target: 90% of sites meet both goals

Two donut charts comparing metrics: the first shows Productivity with a larger portion missed and a smaller portion met, the second shows Invoice Accuracy with a larger portion met and a smaller portion missed.

Organizational Analysis

An organizational chart for LMNOP Aviation Service Centers showing hierarchy from Vice President of Domestic Service, to General Managers at the site, then to Maintenance Managers, Technical Service Managers, and Technicians, with Customer Service Managers and Customers connected via dashed lines.

Methods

My team applied several frameworks as part of the needs assessment.

Chevalier's Behavior Engineering Model and Rummler and Brache's Nine-Variable Model provided the structure necessary to categorize our data. This allowed correlation to environmental factors and individual factors for productivity, and to the organizational level or process level for invoice accuracy.

The Five Whys technique was applied after data collection to identify root causes.

A SWOT analysis was used during intervention selection to identify which root causes would have the greatest impact, and then the Multicriteria Analysis was used to prioritize potential solutions.

Bar chart illustrating agreement levels on statements related to work performance and motivation, with preferences ranging from strongly disagree to strongly agree.

Extant Data Review

My team used internal Power BI metrics for each location. The data analyzed were proprietary metrics that mapped to productivity and invoice accuracy. Additional related metrics were reviewed.

Comparative Sampling Strategy

We utilized those metrics to identify the network’s two "exemplary" locations and the two lowest-performing locations. By focusing interviews on TSMs and CSMs from these locations, the team was able to contrast the environmental supports present in high-performing sites against those missing in low-performing ones.

To review each key role identified by the project sponsors, the team distributed role-specific surveys to GMs, MMs, TSMs, CSMs, and Technicians, receiving over 300 total responses. Interviews and surveys were conducted over three weeks.

Codebook Analysis

My team developed a codebook based on the BEM and Rummler and Brache’s Nine Boxes to systematically analyze qualitative data from TSM and CSM interviews at exemplary and non-exemplary sites, as well as from organization-wide surveys.

The team coded the interview transcripts and open-ended survey responses using the structured codebook, assigning each statement or observation to the relevant variables

Key

Finding

Differences in performance across sites reflected less about individual effort and more about whether sites are consistently enabled with standard work, usable systems, mentoring, and sufficient role capacity by site leadership.

Causes

My team applied strategic analysis tools to ensure recommendations were both evidence-based and aligned with LMNOP Aviation’s organizational goals. We started by categorizing root causes into key themes.

Correlations between several root causes for both Productivity and Invoice Accuracy were discovered, which affected the Information, Resources, and Knowledge factors of the BEM.

Intervention Selection

We then applied strategic analysis tools to ensure recommendations were both evidence-based and aligned with LMNOP Aviation’s organizational goals. We started by categorizing root causes into key themes.

Correlations between several root causes for both Productivity and Invoice Accuracy were discovered, which affected the Information, Resources, and Knowledge factors of the BEM.

A flowchart diagram illustrating root causes of issues in technical service and customer service, including lack of SOPs, lack of issues locating documentation, lack of invoice review documentation, no formal training, and inconsistent expectations, with a focus on improving tools, formalizing knowledge transfer, and standardizing SOPs.

We used SWOT analysis to evaluate internal strengths and weaknesses alongside external opportunities and threats. This helped identify leverage points and constraints shaping LMNOP’s ability to improve productivity and invoice accuracy.

To ensure that intervention recommendations were grounded in business reality rather than subjective preference, my team utilized a Multicriteria Analysis to evaluate and prioritize potential solutions. 

Rather than selecting interventions in isolation, the team met with a core group of General Managers (GMs) to define the specific standards for success. Using their responses, the team established six weighted criteria to score each proposed solution:

  • Cost (20%): Will the cost be prohibitive?

  • Work Stoppage (25%): Can this be implemented without impacting the floor?

  • Speed (10%): How quickly can the change be implemented?

  • Sustainability (5%): How sustainable is the intervention?

  • Impact on Performance metric(s) (20%): Is this intervention likely to impact the productivity and invoice accuracy?

  • Number of locations affected (20%): How many locations will be impacted by the intervention?

The team applied these weighted criteria to the list of potential interventions.

Recommendations

Primary Intervention Recommendations

These interventions address the root causes affecting both productivity and invoice accuracy across the entire network. The interventions will have the maximum impact on the performance gap.

Second Level Recommendations

These recommendations target network-wide causes that, while critical, are secondary to the systemic failures identified in the primary recommendations. They will impact the performance gap, but less than the primary recommendations, or require implementation of the primary recommendations before implementation.

Third Level Recommendations

The final level recommendations consist of targeted interventions designed to address site-specific infrastructure needs that do not necessarily apply to the entire network.

A Gantt chart titled 'Implementation' showing actions and their timelines across six time periods: 0-3 months, 3-6 months, 6-9 months, 9-12 months, 12-15 months, and 12-18+ months. Actions include Setup & Team Formation, Standardize SOPs, Improve Tools & Systems, Formalize Knowledge Transfer, Second Level Recommendations, and Third Level Recommendations.

Timeline

My team proposed a phased 12–18 month plan that balances ambition with practicality to deliver early wins. The focus is on three primary interventions, while also providing timelines for second-level and third-level interventions.

References

Chevalier, R. (2008). The evolution of a performance analysis job aid. Performance Improvement, 47(10), 9–18.

Gilbert, T. F. (2007). Human competence: Engineering worthy performance (3rd ed.). Pfeiffer/John Wiley & Sons.

Rothwell, W. J., Hohne, C. K., & King, S. B. (2018). Human performance improvement: building practitioner performance. Routledge.

Rummler-Brache Group (N.D.) The three levels of performance. Retrieved from https://www.rummler-brache.com.

Stefaniak, J. (2020). Needs Assessment for Learning and Performance. Routledge.

Watkins, R., Meiers, M. W., & Visser, Y. L. (2011). A guide to assessing needs: essential tools for collecting information, making decisions, and achieving development results.