Avatar for the meltano user
meltano
sdk
BlogDocsChangelog

perf(taps): Improved discovery performance for SQL taps

#2793Merged
Comparing
2166-discovery-performance
(
304e206
) with
main
(
b989747
)
CodSpeed Performance Gauge
+36%
Improvements
1
Regressions
0
Untouched
6
New
0
Dropped
0
Ignored
0

Benchmarks

Improved

test_bench_discovery
tests/core/test_connector_sql.py::test_bench_discovery
CodSpeed Performance Gauge
+36%
988.5 ms
724.2 ms

Passed

test_bench_format_message
tests/core/test_io.py::test_bench_format_message
CodSpeed Performance Gauge
0%
53.8 ms
53.5 ms
test_bench_parse_timestamps_in_record
tests/core/sinks/test_validation.py::test_bench_parse_timestamps_in_record
CodSpeed Performance Gauge
0%
11.6 ms
11.6 ms
test_bench_simple_map_transforms
tests/core/test_mapper.py::test_bench_simple_map_transforms
CodSpeed Performance Gauge
0%
692.3 ms
692.7 ms
test_bench_deserialize_json
tests/core/test_io.py::test_bench_deserialize_json
CodSpeed Performance Gauge
0%
23.8 ms
23.8 ms
test_bench_validate_record_with_schema
tests/core/sinks/test_validation.py::test_bench_validate_record_with_schema
CodSpeed Performance Gauge
-1%
122.1 ms
122.9 ms
test_bench_validate_and_parse
tests/core/sinks/test_validation.py::test_bench_validate_and_parse
CodSpeed Performance Gauge
-1%
134.8 ms
136.4 ms

Commits

Click on a commit to change the comparison range
Base
main
b989747
+1%
perf(taps): Improved discovery performance for SQL taps
6eaca46
1 month ago
by edgarrmondragon
-16%
Discover constraints scoped by object type
1bf62d9
1 month ago
by edgarrmondragon
+25%
Inspect only once per schema
d291084
1 month ago
by edgarrmondragon
+26%
Try indices instead of UNIQUE constraints
a567254
1 month ago
by edgarrmondragon
-36%
Extend existing API
bea370d
1 month ago
by edgarrmondragon
+36%
Avoid unnecessarily reflecting stuff
307d4d9
1 month ago
by edgarrmondragon
0%
Backwards-compatible API
edd2d99
1 month ago
by edgarrmondragon
0%
Deprecate `SQLConnector.get_object_names`
304e206
1 month ago
by edgarrmondragon
Home Terms PrivacyDocs