City of San Diego logo Citywide Comprehensive Performance Report

Provide feedback for this page

Provide feedback for this page

NOTE: Due to limited resources, we are unable to respond to every submission.

PERFORMANCE MANAGEMENT PRINCIPLES & PRACTICES

Key Concepts In Performance Management

Systems Thinking

A continual focus on ‘systems thinking’ is the backbone of the City’s performance management framework. Systems thinking is a holistic way of problem solving that examines relationships in a process, system, or organization, rather than just the individual components. This approach is particularly relevant for the City, where addressing even a ‘simple’ problem can involve multiple departments, affect other areas of operation, and have impacts both near- and long-term.  

Systems Thinking

“An interconnected set of elements that is coherently organized in a way that achieves something.”
- Donella Meadows, Thinking In Systems: A Primer, 2008

“A framework for seeing interrelationships rather than things, for seeing patterns rather than static snapshots.”
- Peter Senge, The Fifth Discipline, 2nd Ed 2006

A systems-thinking approach challenges City leaders to address complexity in their work, with an acknowledgement that understanding a problem requires understanding the context it exists in and how it connects to every other part within that context.

The City’s performance management principles and practices are based on this concept that outcomes and results are not produced in isolation or driven solely by any one person's successes or failures. Instead, they arise from interconnected relationships and systems that shape all outcomes, both positive and negative. By building the performance framework on this foundation, the City can better equip its employees and leaders to make operational changes that have an actual and lasting positive impact.

Equity + Systems Thinking
Systems thinking deepens equity work by showing how inequitable outcomes are produced by systems, not merely the individuals in it. Addressing systemic racism and structural disparities means looking at a higher level to examine how systems, policies, and practices mutually reinforce each other.

Performance Management & Performance Measurement

Two closely related and important concepts mentioned throughout this report are performance management and performance measurement. We define performance measurement as the process of defining, collecting, analyzing, and reporting data about programs and services, operations, outputs, outcomes, and conditions. Performance management is the use of that information to guide decisions, improve programs and services, allocate resources, and strengthen accountability.  

In other words, performance measurement helps the organization see what is happening, and performance management helps the organization understand what it means and what should happen next.  

This distinction between the two is important because a performance system that only produces metrics or reports can become passive, focused on turning out numbers rather than the more difficult task of managing the systems and process that produce those results.  A true, high-quality performance management system creates a regular practice of learning, decision-making, and improvement.

Performance Measurement

Collecting, tracking, and reporting data about services, outputs, outcomes, and conditions

Performance Management

Using performance information to guide decisions, improve services, allocate resources, and learn

Measures, Metrics & Key Performance Indicators

Measures, metrics, key performance indicators - there is no shortage of terms that all refer to the same thing: a desire to measure our efforts or their impacts. Though these terms are used almost interchangeably, how each is used and applied has notable implications for the City’s performance management practices.  

Measure
A raw, factual, unit-specific number, existing without context, comparison, or target.

Metric
A measure given context and tracked over time to understand performance, behavior, or health of a system or process.

[Key] Performance Indicator (KPI)
A specific specialized type of metric tied to specific goals or objectives, used to evaluate progress, success, or failure.

Throughout this publication, the City will use the term ‘measure’ to refer to outputs of performance measurement in the broadest sense.

It follows that all KPIs are metrics, and all metrics are measures, but the reverse is not true. The distinction between a KPI and a metric is particularly important. Performance data used to understand a process or to detect changes serves a different purpose than evaluating whether that process is effective at delivering what it was designed to do. In short, processes and systems are designed to perfectly deliver the results they deliver. Whether or not those are the results that should be delivered raises a different question altogether.

Both metrics and KPIs can and should prompt decisions and actions from staff. Because of this, process and system managers must be mindful of what behavioral incentives are created with the use of performance targets. Continual improvement, in terms of both effectiveness and efficiency, is a core part of managing City performance for the public good. It’s not to say that because they create behavioral incentives that the use of performance targets or goals should be avoided, but rather it emphasizes the importance of understanding outcomes at a system level, so that no single metric or indicator creates undue or disproportional influence on staff.  

Performance metrics and indicators are best interpreted in context, with mindfulness given to the relevant factors that may also impact how a program or service delivers results. This concept is reflected in the performance principles and practices with a strong emphasis on thoroughness and intentionality when developing metrics. The addition of guardrails can also prevent an overreliance on metrics and indicators outside their intended use.  

Types of Measures

The City and its departments have made a concerted effort to develop performance measures that are consistent with their missions, goals, and objectives. These measures state what is going to be accomplished, the outcome or impact to customers, and/or what it is going to cost. Accordingly, the City uses the following definitions to indicate what question the measure is intended to answer:  

Input Measures (Resource Allocation)
The amount of resources needed to provide a program, service, or product. Input measures can include things like labor/personnel, material, supplies, and equipment.

Output Measures (Workload / Quantity)
The amount, volume, or level of work, service, or product provided. Output measures can also be referred to as process measures and efficiency measures (unit cost, unit productivity, for example).

Outcome Measures (Quality / Result / Impact)
The impact of what input and outputs do or do not achieve. Outcome measures describe the extent to which success has been achieved or how well a program or service accomplishes its intended aims. Outcome measures can also be referred to as effectiveness measures.

Contextual Measures (Structural / Descriptive)
Contextual measures function as descriptive factors that can influence inputs, outputs, and outcomes, but sit outside the strict connection between those components. It may include things like capabilities or capacity (such as staffing ratios or workload), or important characteristics for consideration alongside performance (such as community-wide characteristics, demographic data, or information about the way a program or service is provided).3

Each of these measures can be classified as internal or external.

Internal measures are utilized by staff to understand and monitor department operations and day-to-day matters, and may have importance for success of key objectives. They are typically not published in external facing reports, and are not included in this Performance Report.

External measures are highlighted in public reports, including this Performance Report, and represent the most important metrics for the City and departments to monitor and track their goals, objectives, or intended impact.

Lastly, these measures may also be further described as leading or lagging. The definitions below are adapted from ICMA, Getting Started: Performance Management for Local Government, 2nd Ed., 2019.

Lead measures indicate actions that must be done well to achieve the desired result. Lead measures typically include input and output measures.

Lag measures how well a desired result was achieved. Lag measures typically include output and outcome measures.