The Observatory / Methodology
Methodology

A basis for evidence that can be examined.

The Observatory documents sources and definitions so that institutions can understand what the evidence does, and does not, establish.

Data collection is ongoing. The Observatory is building coverage across U.S. degree-granting institutions using IPEDS 2024 as its reference. It currently publishes selected institutional records and court cases from 2018 onward.

Research approach

Clarity before comparison.

A meaningful picture begins with the underlying record: who counted what, over which period, and under which procedure.

01 / SCOPE

Identify the decision

Grade appeals, integrity proceedings, academic standing petitions and litigation are recorded according to their actual scope.

02 / EVIDENCE

Trace every finding

Institutional reports and primary sources accompany each published finding, together with its time period and limitations.

03 / INTERPRETATION

Compare with care

Different definitions, incomplete reporting and overlapping categories limit comparisons. Absence of a public number is not zero.

The Observatory aims to cover U.S. higher education institutions systematically, using institutional records and other primary sources from 2018 onward. For each institution, we distinguish between the scope of our research, the sources examined, and the dispute data available.

Coverage and updates

Data collection is ongoing. The catalog is updated once a week as the collection grows. We classify each observation by the process described in its source and bring court decisions, appeals, and amounts together when the documents relate to the same case. We reserve ongoing status for cases whose docket status can be verified and dated.

A changing context

Following the record over time.

The Observatory is being developed to follow evidence from 2018 onward, with attention to important changes in the environment around academic assessment.

2018

Starting point

The research looks back to 2018 where comparable institutional sources are available.

2020

COVID-19

The pandemic changed the conditions in which institutions teach and assess.

30 NOV 2022

ChatGPT launches

Generative AI introduced a new context for student work and institutional assessment.

These dates provide context; they do not establish the causes of changes in reported figures.