2648-feat-add-a-generic-filestream-interface - Branch - meltano/sdk

Blog Docs

refactor: Added a generic `FileStream` (still in active development!)(#2654)

Merging

2648-feat-add-a-generic-filestream-interface

(

4628468

) into

main

(

e997deb

)

IMPROVEMENTS: 0

REGRESSIONS: 0

UNTOUCHED: 6

NEW: 0

DROPPED: 0

IGNORED: 0

Benchmarks

Passed

test_bench_deserialize_json

tests/core/test_io.py::test_bench_deserialize_json

24.1 ms

24 ms

test_bench_validate_record_with_schema

tests/core/sinks/test_validation.py::test_bench_validate_record_with_schema

121.3 ms

121.2 ms

test_bench_format_message

tests/core/test_io.py::test_bench_format_message

53.4 ms

test_bench_parse_timestamps_in_record

tests/core/sinks/test_validation.py::test_bench_parse_timestamps_in_record

11.5 ms

test_bench_validate_and_parse

tests/core/sinks/test_validation.py::test_bench_validate_and_parse

134 ms

134.1 ms

test_bench_simple_map_transforms

tests/core/test_mapper.py::test_bench_simple_map_transforms

713.8 ms

714.6 ms

Commits

Click on a commit to change the comparison range

base

main

e997deb

Initial impl

a45d34d

24 days ago

by edgarrmondragon

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

20b8edc

20 days ago

by edgarrmondragon

Implement a simple local file and directory

914520c

20 days ago

by edgarrmondragon

Fix order

bf66f7f

20 days ago

by edgarrmondragon

Creation and modification time

bd5c138

20 days ago

by edgarrmondragon

Implement S3 file and directory

e1ffcc0

19 days ago

by edgarrmondragon

Use a different caching approach

fca4f2d

19 days ago

by edgarrmondragon

Change S3 list_contents implementation

79707cc

19 days ago

by edgarrmondragon

Add boto3 as an extra dep

8881efa

19 days ago

by edgarrmondragon

Simpler interface

ce600f6

19 days ago

by edgarrmondragon

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

97b27d7

13 days ago

by edgarrmondragon

Use fsspec

0fd556a

13 days ago

by edgarrmondragon

Start abstracting away a `FileStream`

5a24cad

13 days ago

by edgarrmondragon

Move implementation upstream

742524c

12 days ago

by edgarrmondragon

Use preferred fsspec abstraction

83c6754

12 days ago

by edgarrmondragon

Use fsspec to list directory contents

ecabf25

12 days ago

by edgarrmondragon

Test incremental extraction

b85739e

12 days ago

by edgarrmondragon

Fix types

33c8c04

12 days ago

by edgarrmondragon

Clean up

982b6d8

12 days ago

by edgarrmondragon

Increase coverage

3d08c62

12 days ago

by edgarrmondragon

Move tap logic upstream

2aabcc4

12 days ago

by edgarrmondragon

Fix imports

8795b7a

12 days ago

by edgarrmondragon

CSV-specific settings

8144fe2

12 days ago

by edgarrmondragon

Test custom delimiter

22b4fbe

12 days ago

by edgarrmondragon

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

a01449a

7 days ago

by edgarrmondragon

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

92f1522

4 days ago

by edgarrmondragon

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

e5a4a4f

4 days ago

by edgarrmondragon

Implement schema discovery

95d8b82

4 days ago

by edgarrmondragon

Add pragma: no cover

cbf69c9

4 days ago

by edgarrmondragon

Move ReadMode

9fd33fe

4 days ago

by edgarrmondragon

Implement FTP and SFTP configurations

3b11ac4

3 days ago

by edgarrmondragon

Make deptry happy

e20567f

3 days ago

by edgarrmondragon

Link to docs

4628468

3 days ago

by edgarrmondragon

ResourcesHome Pricing Docs Blog GitHub Changelog

Getting StartedSample repository Explore repositories Support

AboutCareers Twitter Discord Contact Us Terms of Service Privacy Policy