Skip to content

Conversation

ray6080
Copy link
Contributor

@ray6080 ray6080 commented Sep 9, 2025

Description

To avoid waiting for some long-running tests locally, this PR starts to add an initial separation of fast and slow tests, which is done by appending a "_SLOW" suffix at the end of test case name.

There can be other more sophisticated mechanisms to separate the fast and slow test cases, but I feel it's unnecessarily complicated vs. simply use the test case suffix, which still allows us to organize tests accordingly to their functionality and is more flexible.

Copy link

codecov bot commented Sep 9, 2025

Codecov Report

❌ Patch coverage is 0% with 34 lines in your changes missing coverage. Please review.
✅ Project coverage is 63.55%. Comparing base (bcbfabd) to head (3fea517).
⚠️ Report is 1 commits behind head on master.

Files with missing lines Patch % Lines
test/transaction/checkpoint_test.cpp 0.00% 10 Missing ⚠️
test/transaction/transaction_test.cpp 0.00% 9 Missing ⚠️
test/copy/copy_test.cpp 0.00% 7 Missing ⚠️
test/copy/multi_copy_test.cpp 0.00% 7 Missing ⚠️
test/storage/node_update_test.cpp 0.00% 1 Missing ⚠️

❌ Your patch check has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage.
❌ Your project check has failed because the head coverage (63.55%) is below the target coverage (80.00%). You can increase the head coverage or adjust the target coverage.

❗ There is a different number of reports uploaded between BASE (bcbfabd) and HEAD (3fea517). Click for more details.

HEAD has 3 uploads less than BASE
Flag BASE (bcbfabd) HEAD (3fea517)
on-disk 1 0
in-mem 1 0
recovery 1 0
Additional details and impacted files
@@             Coverage Diff             @@
##           master    #5995       +/-   ##
===========================================
- Coverage   85.77%   63.55%   -22.22%     
===========================================
  Files        1642     1642               
  Lines       75827    75768       -59     
  Branches     9023     8819      -204     
===========================================
- Hits        65037    48157    -16880     
- Misses      10529    27477    +16948     
+ Partials      261      134      -127     
Flag Coverage Δ
extension 63.55% <0.00%> (+<0.01%) ⬆️
in-mem ?
on-disk ?
recovery ?

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copy link

github-actions bot commented Sep 9, 2025

Benchmark Result

Master commit hash: 12569744b4958f53c7ce02f31f96afbea8464b0e
Branch commit hash: 663ee12ba98ed698bd4b4a40a6e196b879880352

No major diffs!

Other queries
Query Group Query Name Mean Time - Commit (ms)
aggregation q24 717.26
aggregation q28 7716.29
filter q14 60.68
filter q15 63.05
filter q16 283.03
filter q17 388.59
filter q18 1862.56
filter zonemap-node 24.76
filter zonemap-node-lhs-cast 25.73
filter zonemap-node-null 24.95
filter zonemap-rel 5619.46
fixed_size_expr_evaluator q07 630.87
fixed_size_expr_evaluator q08 917.05
fixed_size_expr_evaluator q09 920.99
fixed_size_expr_evaluator q10 193.53
fixed_size_expr_evaluator q11 194.03
fixed_size_expr_evaluator q12 170.96
fixed_size_expr_evaluator q13 1518.63
fixed_size_seq_scan q23 44.99
join q29 725.80
join q30 1768.10
join q31 4.17
join SelectiveTwoHopJoin 46.82
ldbc_snb_ic q35 9.54
ldbc_snb_ic q36 97.50
ldbc_snb_is q32 5.39
ldbc_snb_is q33 12.15
ldbc_snb_is q34 1.22
limit push-down-limit-into-distinct 1946.13
multi-rel multi-rel-large-scan 1627.56
multi-rel multi-rel-lookup 7.03
multi-rel multi-rel-small-scan 190.22
order_by q25 65.87
order_by q26 383.36
order_by q27 1318.05
recursive_join recursive-join-bidirection 344.71
recursive_join recursive-join-dense 7100.70
recursive_join recursive-join-path 23431.97
recursive_join recursive-join-sparse 10.97
recursive_join recursive-join-trail 7082.18
scan_after_filter q01 106.98
scan_after_filter q02 94.41
shortest_path_ldbc100 q37 151.31
shortest_path_ldbc100 q38 351.63
shortest_path_ldbc100 q39 88.27
shortest_path_ldbc100 q40 518.41
var_size_expr_evaluator q03 2137.65
var_size_expr_evaluator q04 2199.66
var_size_expr_evaluator q05 2616.65
var_size_expr_evaluator q06 1297.04
var_size_seq_scan q19 1371.59
var_size_seq_scan q20 2659.60
var_size_seq_scan q21 2179.80
var_size_seq_scan q22 109.93

@ray6080 ray6080 requested a review from andyfengHKU September 10, 2025 15:33
@ray6080 ray6080 marked this pull request as ready for review September 10, 2025 15:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant