BuzzCutNorman:feat-tap-parallel-streams - Branch - meltano/sdk

feat(tap): Utilize `Joblib` to run parallel streams during `sync_all`

#2295

Comparing

BuzzCutNorman:feat-tap-parallel-streams

(

3323b45

) with

main

(

b6fa56a

)

Untouched: 6

Benchmarks

Passed

test_bench_parse_timestamps_in_record

tests/core/sinks/test_validation.py

+1%

11.6 ms11.5 ms

test_bench_deserialize_json

tests/core/test_io.py

24.3 ms24.2 ms

test_bench_format_message

tests/core/test_io.py

53.5 ms53.5 ms

test_bench_validate_and_parse

tests/core/sinks/test_validation.py

125 ms125 ms

test_bench_simple_map_transforms

tests/core/test_mapper.py

715.3 ms715 ms

test_bench_validate_record_with_schema

tests/core/sinks/test_validation.py

-1%

112.2 ms112.8 ms

Commits

Click on a commit to change the comparison range

Base

main

b6fa56a

+0.26%

fixed missing console logging from stream processes

502b36d

2 years ago

by BuzzCutNorman

+0.08%

Merge branch 'main' into feat-tap-parallel-streams

73342d4

1 year ago

by edgarrmondragon

-0.22%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into feat-tap-parallel-streams

3323b45

1 year ago

by BuzzCutNorman

Home Terms Privacy Docs