Skip to content

Conversation

sgreenbury
Copy link
Collaborator

@sgreenbury sgreenbury commented Jul 14, 2025

Closes #454.

This PR adds for benchmarking:

  • scripts (python and bash for parallel runs)
  • plotting

It might work well to include a version of this to be run by github actions at regular intervals.

Base automatically changed from 617-bootstrap to main July 14, 2025 10:55
@sgreenbury sgreenbury changed the base branch from main to fix/607 July 14, 2025 16:03
@sgreenbury sgreenbury changed the base branch from fix/607 to main July 14, 2025 16:04
Copy link
Contributor

github-actions bot commented Jul 14, 2025

Coverage report

Click to see where and how coverage changed

FileStatementsMissingCoverageCoverage
(new stmts)
Lines missing
  autoemulate/experimental/simulations
  __init__.py
  flow_problem.py 50-71
Project Total  

This report was generated by python-coverage-comment-action

@codecov-commenter
Copy link

codecov-commenter commented Jul 14, 2025

Codecov Report

❌ Patch coverage is 66.66667% with 2 lines in your changes missing coverage. Please review.
✅ Project coverage is 80.27%. Comparing base (cecf95d) to head (2ca6acc).
⚠️ Report is 40 commits behind head on main.

Files with missing lines Patch % Lines
...toemulate/experimental/simulations/flow_problem.py 33.33% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #621      +/-   ##
==========================================
+ Coverage   80.20%   80.27%   +0.06%     
==========================================
  Files         155      154       -1     
  Lines       11132    11166      +34     
==========================================
+ Hits         8928     8963      +35     
+ Misses       2204     2203       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@radka-j
Copy link
Member

radka-j commented Jul 15, 2025

Could we include in the benchmark performance of the main AutoEmulate (test model performance given different N simulated datapoints but otherwise keeping the default AE settings).

@sgreenbury sgreenbury changed the base branch from main to 644-fixes-from-454 July 24, 2025 15:07
@sgreenbury sgreenbury force-pushed the 644-fixes-from-454 branch from 9eb54fd to 9250d61 Compare July 24, 2025 15:17
Base automatically changed from 644-fixes-from-454 to main July 24, 2025 15:47
@sgreenbury sgreenbury marked this pull request as ready for review July 24, 2025 16:32
@sgreenbury sgreenbury merged commit b1840bc into main Jul 30, 2025
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Refactor: enhance the testing of compare
3 participants