2648-feat-add-a-generic-filestream-interface - Branch - meltano/sdk

refactor: Added a generic `FileStream` (still in active development!)

#2654Merged

Comparing

2648-feat-add-a-generic-filestream-interface

(

e527cee

) with

main

(

56b496f

)

Untouched: 6

Benchmarks

Passed

test_bench_deserialize_json

tests/core/test_io.py

+1%

24.3 ms24 ms

test_bench_validate_record_with_schema

tests/core/sinks/test_validation.py

121.6 ms121.3 ms

test_bench_parse_timestamps_in_record

tests/core/sinks/test_validation.py

11.5 ms11.5 ms

test_bench_format_message

tests/core/test_io.py

53.3 ms53.4 ms

test_bench_simple_map_transforms

tests/core/test_mapper.py

714.2 ms714.8 ms

test_bench_validate_and_parse

tests/core/sinks/test_validation.py

133.9 ms134 ms

Commits

Click on a commit to change the comparison range

Base

main

56b496f

-0.24%

Initial impl

a45d34d

1 year ago

by edgarrmondragon

+0.16%

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

20b8edc

1 year ago

by edgarrmondragon

+0.24%

Implement a simple local file and directory

914520c

1 year ago

by edgarrmondragon

-0.05%

Fix order

bf66f7f

1 year ago

by edgarrmondragon

-0.14%

Creation and modification time

bd5c138

1 year ago

by edgarrmondragon

+0.07%

Implement S3 file and directory

e1ffcc0

1 year ago

by edgarrmondragon

+0.07%

Use a different caching approach

fca4f2d

1 year ago

by edgarrmondragon

+0.01%

Change S3 list_contents implementation

79707cc

1 year ago

by edgarrmondragon

-0.14%

Add boto3 as an extra dep

8881efa

1 year ago

by edgarrmondragon

+0.14%

Simpler interface

ce600f6

1 year ago

by edgarrmondragon

+0.04%

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

97b27d7

1 year ago

by edgarrmondragon

-0.15%

Use fsspec

0fd556a

1 year ago

by edgarrmondragon

+0.17%

Start abstracting away a `FileStream`

5a24cad

1 year ago

by edgarrmondragon

-0.11%

Move implementation upstream

742524c

1 year ago

by edgarrmondragon

-0.32%

Use preferred fsspec abstraction

83c6754

1 year ago

by edgarrmondragon

+0.12%

Use fsspec to list directory contents

ecabf25

1 year ago

by edgarrmondragon

+0.43%

Test incremental extraction

b85739e

1 year ago

by edgarrmondragon

-0.06%

Fix types

33c8c04

1 year ago

by edgarrmondragon

-0.05%

Clean up

982b6d8

1 year ago

by edgarrmondragon

-0.04%

Increase coverage

3d08c62

1 year ago

by edgarrmondragon

-0.17%

Move tap logic upstream

2aabcc4

1 year ago

by edgarrmondragon

+0.17%

Fix imports

8795b7a

1 year ago

by edgarrmondragon

+0.08%

CSV-specific settings

8144fe2

1 year ago

by edgarrmondragon

-0.1%

Test custom delimiter

22b4fbe

1 year ago

by edgarrmondragon

+0.24%

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

a01449a

1 year ago

by edgarrmondragon

-0.37%

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

92f1522

1 year ago

by edgarrmondragon

+0.04%

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

e5a4a4f

1 year ago

by edgarrmondragon

+0.02%

Implement schema discovery

95d8b82

1 year ago

by edgarrmondragon

-0.28%

Add pragma: no cover

cbf69c9

1 year ago

by edgarrmondragon

+0.19%

Move ReadMode

9fd33fe

1 year ago

by edgarrmondragon

+0.01%

Implement FTP and SFTP configurations

3b11ac4

1 year ago

by edgarrmondragon

-0.03%

Make deptry happy

e20567f

1 year ago

by edgarrmondragon

+0.15%

Link to docs

4628468

1 year ago

by edgarrmondragon

+0.03%

Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface

47ba446

1 year ago

by edgarrmondragon

+0.26%

Update pyproject.toml

d6c4cc9

1 year ago

by edgarrmondragon

-0.17%

Implement primary keys

e527cee

1 year ago

by edgarrmondragon

Home Terms Privacy Docs