Contact

GlossaryResponse performance and resources

Benchmark

A benchmark is a stated reference used to compare performance. Its source and measurement rules determine whether the comparison is fair.

A benchmark is a defined reference used to compare a measure. In public safety, it might be an adopted target, a previous year's result, or a statistic from a specified group of comparable agencies. The comparison is meaningful only when the reference and the reported result use compatible definitions.

A benchmark should identify its source, period, and purpose. A peer average describes what a group reported; an adopted objective describes what an agency intends to achieve. Neither automatically establishes a universal standard for every community.

Choose the reference carefully

A response-time comparison needs matching clocks and response types. A staffing comparison needs matching personnel categories and populations served. Otherwise the numerical difference can come from definitions rather than service performance.

The Bureau of Justice Statistics' 2020 local-police report provides staffing ratios by population group using full-time-equivalent sworn officers. Those historical comparisons illustrate a defined reference population and personnel measure. They are not current staffing prescriptions for individual departments. BJS local-police personnel report, published November 2022

Example

Hypothetical: A fire department compares its current first-unit travel time with its own prior year, using en-route-to-arrival timestamps in both years. That previous result is a historical benchmark.

It also considers a neighboring department's published “response time.” The neighbor starts its clock at call receipt. Comparing the two values directly would include call processing and turnout in one measure but not the other.

The neighboring value may still provide useful context after its components are understood. It cannot support a simple claim that one department travels faster merely because the displayed number is smaller.

Common confusion

A benchmark is not necessarily a legal minimum, contractual obligation, or adopted goal. The document establishing the reference determines its status. Washington's statute, for example, expressly addresses adopted fire-service objectives; that is different from an informal peer comparison. Washington RCW 35.103.030

A benchmark is also not an explanation. Falling above a comparison value does not establish why the difference occurred. Geography, responsibilities, incident mix, and data coverage may matter.

Presenting a comparison

Name the reference group or source, its date, and the exact measure. Explain important differences that remain after aligning definitions. A small set of dissimilar agencies should not be labeled a representative national norm.

Where comparable data are unavailable, present the individual measures with their definitions rather than forcing a ranking. A transparent comparison shows what is known and leaves unsupported judgments out.

Sources