queue-child-streams - Branch - meltano/sdk

feat(taps): Queue parent contexts and sync child streams only when the queue is full

#3058

Comparing

queue-child-streams

(

d01a550

) with

main

(

006da34

)

Untouched: 8

Benchmarks

Passed

test_bench_format_message

tests/benchmarks/test_io.py

4.1 ms4.1 ms

test_bench_deserialize_json

tests/benchmarks/test_io.py

5.6 ms5.6 ms

test_bench_discovery

tests/core/test_connector_sql.py

744.2 ms743 ms

test_bench_parse_timestamps_in_record

tests/core/sinks/test_validation.py

13.4 ms13.4 ms

test_bench_validate_and_parse

tests/core/sinks/test_validation.py

127.3 ms127.2 ms

test_bench_validate_record_with_schema

tests/core/sinks/test_validation.py

112.8 ms112.7 ms

test_bench_conform_record_data_types

tests/core/test_typing.py

75.6 ms75.7 ms

test_bench_simple_map_transforms

tests/core/test_mapper.py

552.2 ms553.6 ms

Commits

Click on a commit to change the comparison range

Base

main

006da34

+0.01%

Test with a smaller queue size

01aff07

5 months ago

by edgarrmondragon

-0.07%

Merge branch 'main' into queue-child-streams

27a9de4

5 months ago

by edgarrmondragon

-0.08%

Update snapshots

cc79638

4 months ago

by edgarrmondragon

+0.08%

Merge branch 'main' into queue-child-streams

a6a0993

4 months ago

by MeltyBot

+0.04%

Merge branch 'main' into queue-child-streams

11d4f35

4 months ago

by edgarrmondragon

-0.41%

Merge branch 'main' into queue-child-streams

5f10311

25 days ago

by edgarrmondragon

+0.4%

Update singer_sdk/streams/core.py Co-authored-by: sourcery-ai[bot] <58596630+sourcery-ai[bot]@users.noreply.github.com>

d55bfdc

25 days ago

by edgarrmondragon

-0.04%

Test failing child

ded5a02

25 days ago

by edgarrmondragon

+0.14%

Merge branch 'main' into queue-child-streams

d01a550

1 day ago

by edgarrmondragon

Home Terms Privacy Docs