You can use pyperf to get perf stats using what was learned doin perf...

@mistersql

You can use pyperf to get perf stats using what was learned doin perf benchmarking for the python runtime

pypi.org/project/pyperf/

Self-replies

Continuous benchmarking (CI tools) needs bare metal machines or you get to too much noise from non-code reasons for the thing being fast/slow

Bare metal/non-shared CI machines are expensive.

(Sounds pessimistic about the possibility of perf testing side projects or in a corporate shared build server)