Avatar for the equinor user
equinor
ert
BlogDocsChangelog

Validate `DESIGN_MATRIX` when running `DESIGN2PARAMS`

#10316Merged
Comparing
jonathan-eq:validate-ert-design-matrix
(
8ffd82d
) with
main
(
a0fda20
)
CodSpeed Performance Gauge
0%
Improvements
0
Regressions
0
Untouched
25
New
0
Dropped
0
Ignored
0

Benchmarks

Passed

test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_observations]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_observations]
CodSpeed Performance Gauge
+6%
1.4 ms
1.3 ms
test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_observations]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_observations]
CodSpeed Performance Gauge
+4%
2.7 ms
2.6 ms
test_load_from_context[gen_x: 20, sum_x: 20 reals: 10]
tests/ert/performance_tests/enkf/test_load_state.py::test_load_from_context[gen_x: 20, sum_x: 20 reals: 10]
CodSpeed Performance Gauge
+2%
6.5 ms
6.4 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_parameters]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_parameters]
CodSpeed Performance Gauge
+1%
255.2 µs
253.1 µs
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_csv]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_csv]
CodSpeed Performance Gauge
+1%
14.3 ms
14.2 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_parquet]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_parquet]
CodSpeed Performance Gauge
+1%
18.1 ms
18 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_parameters]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_parameters]
CodSpeed Performance Gauge
+1%
255.3 µs
253.9 µs
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_csv]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_csv]
CodSpeed Performance Gauge
0%
14 ms
13.9 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_parquet]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_parquet]
CodSpeed Performance Gauge
0%
21.5 ms
21.4 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_parameters]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_parameters]
CodSpeed Performance Gauge
0%
252.8 µs
252.2 µs
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_parquet]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_parquet]
CodSpeed Performance Gauge
0%
18.1 ms
18.1 ms
test_speed_performance_of_doing_es_update[setup_es_benchmark0]
tests/ert/performance_tests/test_obs_and_responses_performance.py::test_speed_performance_of_doing_es_update[setup_es_benchmark0]
CodSpeed Performance Gauge
0%
85 ms
84.8 ms
test_and_benchmark_adaptive_localization_with_fields
tests/ert/performance_tests/test_analysis.py::test_and_benchmark_adaptive_localization_with_fields
CodSpeed Performance Gauge
0%
3 s
3 s
test_snapshot_handling_of_forward_model_events[100-10-1]
tests/ert/performance_tests/test_snapshot.py::test_snapshot_handling_of_forward_model_events[100-10-1]
CodSpeed Performance Gauge
0%
104.4 ms
104.4 ms
test_snapshot_handling_of_forward_model_events[10-10-10]
tests/ert/performance_tests/test_snapshot.py::test_snapshot_handling_of_forward_model_events[10-10-10]
CodSpeed Performance Gauge
0%
38.8 ms
38.8 ms
test_snapshot_handling_of_forward_model_events[10-10-1]
tests/ert/performance_tests/test_snapshot.py::test_snapshot_handling_of_forward_model_events[10-10-1]
CodSpeed Performance Gauge
0%
10.6 ms
10.6 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_parameters]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_parameters]
CodSpeed Performance Gauge
0%
260 µs
260.3 µs
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_csv]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_csv]
CodSpeed Performance Gauge
0%
12 ms
12 ms
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_csv]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_csv]
CodSpeed Performance Gauge
0%
12 ms
12 ms
test_snapshot_handling_of_forward_model_events[10-100-1]
tests/ert/performance_tests/test_snapshot.py::test_snapshot_handling_of_forward_model_events[10-100-1]
CodSpeed Performance Gauge
0%
99.6 ms
99.9 ms
test_plotter_on_all_snake_oil_responses_time[0]
tests/ert/performance_tests/test_dark_storage_performance.py::test_plotter_on_all_snake_oil_responses_time[0]
CodSpeed Performance Gauge
0%
11 s
11.1 s
test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_parquet]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_parquet]
CodSpeed Performance Gauge
-1%
20.8 ms
21 ms
test_time_performance_of_joining_observations_and_responses[setup_benchmark0]
tests/ert/performance_tests/test_obs_and_responses_performance.py::test_time_performance_of_joining_observations_and_responses[setup_benchmark0]
CodSpeed Performance Gauge
-2%
12.8 ms
13 ms
test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_observations]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_observations]
CodSpeed Performance Gauge
-2%
1.5 ms
1.5 ms
test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_observations]
tests/ert/performance_tests/test_dark_storage_performance.py::test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_observations]
CodSpeed Performance Gauge
-5%
3.8 ms
4.1 ms

Commits

Click on a commit to change the comparison range
Base
main
a0fda20
0%
Validate `DESIGN_MATRIX` when running `DESIGN2PARAMS` This commit makes us run validation for DESIGN_MATRIX when parsing configs using DESIGN2PARAMS, and log a warning if it would have failed.
8ffd82d
11 days ago
by jonathan-eq
© 2025 CodSpeed Technology
Home Terms PrivacyDocs