Avatar for the meltano user
meltano
sdk
BlogDocsChangelog

refactor: Added a generic `FileStream` (still in active development!)

#2654Merged
Comparing
2648-feat-add-a-generic-filestream-interface
(
e527cee
) with
main
(
56b496f
)
CodSpeed Performance Gauge
0%
Improvements
0
Regressions
0
Untouched
6
New
0
Dropped
0
Ignored
0

Benchmarks

Passed

test_bench_deserialize_json
tests/core/test_io.py::test_bench_deserialize_json
CodSpeed Performance Gauge
+1%
24.3 ms
24 ms
test_bench_validate_record_with_schema
tests/core/sinks/test_validation.py::test_bench_validate_record_with_schema
CodSpeed Performance Gauge
0%
121.6 ms
121.3 ms
test_bench_parse_timestamps_in_record
tests/core/sinks/test_validation.py::test_bench_parse_timestamps_in_record
CodSpeed Performance Gauge
0%
11.5 ms
11.5 ms
test_bench_format_message
tests/core/test_io.py::test_bench_format_message
CodSpeed Performance Gauge
0%
53.3 ms
53.4 ms
test_bench_simple_map_transforms
tests/core/test_mapper.py::test_bench_simple_map_transforms
CodSpeed Performance Gauge
0%
714.2 ms
714.8 ms
test_bench_validate_and_parse
tests/core/sinks/test_validation.py::test_bench_validate_and_parse
CodSpeed Performance Gauge
0%
133.9 ms
134 ms

Commits

Click on a commit to change the comparison range
Base
main
56b496f
0%
Initial impl
a45d34d
4 months ago
by edgarrmondragon
0%
Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface
20b8edc
4 months ago
by edgarrmondragon
0%
Implement a simple local file and directory
914520c
4 months ago
by edgarrmondragon
0%
Fix order
bf66f7f
4 months ago
by edgarrmondragon
0%
Creation and modification time
bd5c138
4 months ago
by edgarrmondragon
0%
Implement S3 file and directory
e1ffcc0
4 months ago
by edgarrmondragon
0%
Use a different caching approach
fca4f2d
4 months ago
by edgarrmondragon
0%
Change S3 list_contents implementation
79707cc
4 months ago
by edgarrmondragon
0%
Add boto3 as an extra dep
8881efa
4 months ago
by edgarrmondragon
0%
Simpler interface
ce600f6
4 months ago
by edgarrmondragon
0%
Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface
97b27d7
4 months ago
by edgarrmondragon
0%
Use fsspec
0fd556a
4 months ago
by edgarrmondragon
0%
Start abstracting away a `FileStream`
5a24cad
4 months ago
by edgarrmondragon
0%
Move implementation upstream
742524c
4 months ago
by edgarrmondragon
0%
Use preferred fsspec abstraction
83c6754
4 months ago
by edgarrmondragon
0%
Use fsspec to list directory contents
ecabf25
4 months ago
by edgarrmondragon
0%
Test incremental extraction
b85739e
4 months ago
by edgarrmondragon
0%
Fix types
33c8c04
4 months ago
by edgarrmondragon
0%
Clean up
982b6d8
4 months ago
by edgarrmondragon
0%
Increase coverage
3d08c62
4 months ago
by edgarrmondragon
0%
Move tap logic upstream
2aabcc4
4 months ago
by edgarrmondragon
0%
Fix imports
8795b7a
4 months ago
by edgarrmondragon
0%
CSV-specific settings
8144fe2
4 months ago
by edgarrmondragon
0%
Test custom delimiter
22b4fbe
4 months ago
by edgarrmondragon
0%
Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface
a01449a
4 months ago
by edgarrmondragon
0%
Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface
92f1522
3 months ago
by edgarrmondragon
0%
Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface
e5a4a4f
3 months ago
by edgarrmondragon
0%
Implement schema discovery
95d8b82
3 months ago
by edgarrmondragon
0%
Add pragma: no cover
cbf69c9
3 months ago
by edgarrmondragon
0%
Move ReadMode
9fd33fe
3 months ago
by edgarrmondragon
0%
Implement FTP and SFTP configurations
3b11ac4
3 months ago
by edgarrmondragon
0%
Make deptry happy
e20567f
3 months ago
by edgarrmondragon
0%
Link to docs
4628468
3 months ago
by edgarrmondragon
0%
Merge branch 'main' into 2648-feat-add-a-generic-filestream-interface
47ba446
3 months ago
by edgarrmondragon
0%
Update pyproject.toml
d6c4cc9
3 months ago
by edgarrmondragon
0%
Implement primary keys
e527cee
3 months ago
by edgarrmondragon
Home Terms PrivacyDocs