Run Tests

Run targeted tests one-by-one, prioritized by what's most likely to fail given recent changes. Never run the full test suite blindly — it's too large. Fix each failure before moving on.

Step 1: Identify What Changed

Look at the recent changes (staged, unstaged, or recent commits) and determine which test files are most likely affected. Use this mapping:

Step 2: Run the Most Likely Test First

Tests are selected by a prefix of their group/name and run in parallel worker processes. Run a single test file on CPU:

CUDA_VISIBLE_DEVICES=-1 TEST_ARCHITECTURE=CPU julia --project -e '
using Pkg
Pkg.test("Oceananigans"; test_args=["unit/grids"])
'

Or run a whole group if the changes span multiple areas:

CUDA_VISIBLE_DEVICES=-1 TEST_ARCHITECTURE=CPU julia --project -e '
using Pkg
Pkg.test("Oceananigans"; test_args=["unit", "--jobs=4", "--verbose"])
'

Pkg.test(; test_args=["--list"]) prints every test with its last measured duration. The groups are the directories under test/: unit, abstract_operations, coriolis, tripolar_grid, poisson_solvers, general_solvers, turbulence_closures, time_stepping, regression, hydrostatic_free_surface, vertical_coordinate, shallow_water, simulation, lagrangian_particles, multi_region, conservative_regridding, scripts, memory_allocation, init; and, only when selected explicitly, distributed, enzyme, reactant, sharding, metal, amdgpu, oneapi, makie, convergence. TEST_GROUP=unit is equivalent to test_args=["unit"].

Step 3: Fix and Iterate

1. If a test fails, fix the issue
2. Re-run the same test to confirm the fix
3. Move on to the next most likely test
4. After direct tests pass, run unit/quality_assurance to catch import/doctest issues

Notes

• GPU tests may fail with "dynamic invocation error" — always test on CPU first
• unit/quality_assurance checks explicit imports and Aqua.jl quality — run this for any change
• test/mpi/ tests need 4 MPI ranks (MPI_TEST=true mpiexec -n 4 julia --project -e 'using Pkg; Pkg.test()' with TEST_GROUP=distributed) — skip unless changes touch src/DistributedComputations/
• If Julia version issues arise, delete Manifest.toml and run Pkg.instantiate()