SAKavli:show-cpu-overspending-warning-to-user - Branch - equinor/ert

Make Ert warn users when overspending unrequested CPU resources

#12381

Comparing

SAKavli:show-cpu-overspending-warning-to-user

(

b85a60e

) with

main

(

f91c64f

)

-1%

Untouched: 22

Benchmarks

Passed

test_snapshot_handling_of_forward_model_events[10-100-1]

tests/ert/performance_tests/test_snapshot.py

100.6 ms100.5 ms

test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_observations]

tests/ert/performance_tests/test_dark_storage_performance.py

253.9 µs253.7 µs

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_csv]

tests/ert/performance_tests/test_dark_storage_performance.py

17.2 ms17.2 ms

test_snapshot_handling_of_forward_model_events[100-10-1]

tests/ert/performance_tests/test_snapshot.py

105.3 ms105.2 ms

test_plotter_on_all_snake_oil_responses_time[0]

tests/ert/performance_tests/test_dark_storage_performance.py

10.8 s10.8 s

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_parquet]

tests/ert/performance_tests/test_dark_storage_performance.py

23.4 ms23.5 ms

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_parquet]

tests/ert/performance_tests/test_dark_storage_performance.py

21.2 ms21.2 ms

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_parquet]

tests/ert/performance_tests/test_dark_storage_performance.py

23.8 ms23.8 ms

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-summary-get_record_csv]

tests/ert/performance_tests/test_dark_storage_performance.py

17.3 ms17.3 ms

test_snapshot_handling_of_forward_model_events[10-10-10]

tests/ert/performance_tests/test_snapshot.py

39.8 ms40 ms

test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_observations]

tests/ert/performance_tests/test_dark_storage_performance.py

273.6 µs274.5 µs

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_parquet]

tests/ert/performance_tests/test_dark_storage_performance.py

21.1 ms21.2 ms

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_csv]

tests/ert/performance_tests/test_dark_storage_performance.py

15.6 ms15.6 ms

test_and_benchmark_adaptive_localization_with_fields

tests/ert/performance_tests/test_analysis.py

3 s3 s

test_snapshot_handling_of_forward_model_events[10-10-1]

tests/ert/performance_tests/test_snapshot.py

-1%

10.8 ms10.8 ms

test_direct_dark_performance[gen_x: 20, sum_x: 20 reals: 10-gen_data-get_record_csv]

tests/ert/performance_tests/test_dark_storage_performance.py

-1%

15.6 ms15.7 ms

test_load_from_context[gen_x: 20, sum_x: 20 reals: 10]

tests/ert/performance_tests/enkf/test_load_state.py

-2%

7.3 ms7.5 ms

test_speed_performance_of_doing_enif_update[setup_es_benchmark0]

tests/ert/performance_tests/test_obs_and_responses_performance.py

-2%

92.4 ms94 ms

test_time_performance_of_joining_observations_and_responses[setup_benchmark0]

tests/ert/performance_tests/test_obs_and_responses_performance.py

-2%

21.7 ms22.1 ms

test_speed_performance_of_doing_es_update[setup_es_benchmark0]

tests/ert/performance_tests/test_obs_and_responses_performance.py

-3%

31.5 ms32.4 ms

test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-summary_with_obs-get_record_observations]

tests/ert/performance_tests/test_dark_storage_performance.py

-6%

3.4 ms3.6 ms

test_direct_dark_performance_with_storage[gen_x: 20, sum_x: 20 reals: 10-gen_data_with_obs-get_record_observations]

tests/ert/performance_tests/test_dark_storage_performance.py

-8%

2.3 ms2.5 ms

Commits

Click on a commit to change the comparison range

Base

main

f91c64f

-1.14%

Propagate the worst cpu violation as warning There is a need to monitor whether users are over-spending cpu resources. We call it a 'violation' should a user spend more cpu seconds than they have requested. We detect this by the following logic in EnsemblEvaluator: cpu_seconds / experiment_duration > NUM_CPU

b85a60e

3 days ago

by SAKavli

Home Terms Privacy Docs