BuzzCutNorman:1046-feat-faster-json-dumps-with-msgspec - Branch - meltano/sdk

feat: Faster JSON dumps in `format_message` with `msgspec`

#1784Closed

Comparing

BuzzCutNorman:1046-feat-faster-json-dumps-with-msgspec

(

0ec59f2

) with

main

(

4a066fe

)

-14%

Improvements: 0

Regressions: 1

Untouched: 5

New: 0

Dropped: 0

Ignored: 0

Benchmarks

Failed

test_bench_deserialize_jsonRegression

tests/core/test_io.py::test_bench_deserialize_json

-14%

24.1 ms

28.1 ms

Passed

test_bench_validate_and_parse

tests/core/sinks/test_validation.py::test_bench_validate_and_parse

126.8 ms

126.5 ms

test_bench_parse_timestamps_in_record

tests/core/sinks/test_validation.py::test_bench_parse_timestamps_in_record

11.5 ms

test_bench_format_message

tests/core/test_io.py::test_bench_format_message

53.5 ms

test_bench_simple_map_transforms

tests/core/test_mapper.py::test_bench_simple_map_transforms

640.8 ms

642.9 ms

test_bench_validate_record_with_schema

tests/core/sinks/test_validation.py::test_bench_validate_record_with_schema

113.2 ms

113.7 ms

Commits

Click on a commit to change the comparison range

Base

main

4a066fe

updated pytest snapshot mapped_stream jsonl files

e8e34b9

1 year ago

by BuzzCutNorman

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

b3535be

1 year ago

by BuzzCutNorman

removed a Python 3.7 from classifers, update ruff target-version to py38

27dce2c

1 year ago

by BuzzCutNorman

[pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci

dde28c2

1 year ago

by pre-commit-ci[bot]

added the changes in drop support for python 3.7 from v1

77236d9

1 year ago

by BuzzCutNorman

updated register_stream_stuct and deserialize_record

f437c48

1 year ago

by BuzzCutNorman

added conform_name and used it in register_stream_struct and deserialize_record

50fe1ff

1 year ago

by BuzzCutNorman

utilizing float_hook=decimal.Decimal in Decoder and code cleanup to match change

f15cb35

1 year ago

by BuzzCutNorman

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

8e813e8

1 year ago

by BuzzCutNorman

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

5cf4e76

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

b723dad

1 year ago

by BuzzCutNorman

fix pyarrow dependency walk issue

a035da0

1 year ago

by BuzzCutNorman

update test to utilize SingerWriter class

af90f6c

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

20a53f2

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

04c3338

1 year ago

by BuzzCutNorman

attempt to resolve dependency walk issue

1be25c1

1 year ago

by BuzzCutNorman

attempt to resolve e2e test failures

b41c6a3

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

0429fbb

1 year ago

by BuzzCutNorman

reduce mypy issue

5c5d173

1 year ago

by BuzzCutNorman

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

6b68391

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

14f8b78

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

55cbc5f

1 year ago

by BuzzCutNorman

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

4dc2fe1

1 year ago

by BuzzCutNorman

updated tests to utlize RunnerStandardOutErr

792277b

1 year ago

by BuzzCutNorman

+1%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

257f312

1 year ago

by BuzzCutNorman

added xfail to test_sqlite_state

e616df4

1 year ago

by BuzzCutNorman

-1%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

4876246

1 year ago

by BuzzCutNorman

cleanup of unused code

b0ac8aa

1 year ago

by BuzzCutNorman

+1%

paramaterized test_dec_hook and test_enc_hook

719652d

1 year ago

by BuzzCutNorman

add test_listen_file_input to test_io

5eefa0e

1 year ago

by BuzzCutNorman

+1,564%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

418d42f

1 year ago

by BuzzCutNorman

-2%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

643ee6d

1 year ago

by BuzzCutNorman

-215%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

35d8063

1 year ago

by BuzzCutNorman

bump msgspec to 0.18.5

517f6f1

1 year ago

by BuzzCutNorman

-9%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

3a8eb0f

1 year ago

by BuzzCutNorman

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

a9023f8

1 year ago

by BuzzCutNorman

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

98f17e5

1 year ago

by BuzzCutNorman

-11%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

3caf6c1

1 year ago

by BuzzCutNorman

Apply suggestions from code review Co-authored-by: Edgar Ramírez Mondragón <16805946+edgarrmondragon@users.noreply.github.com>

efea905

1 year ago

by BuzzCutNorman

-5%

switch to using t.Final to decorate listen in SingerReader

e12dc58

1 year ago

by BuzzCutNorman

-1%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

187a347

1 year ago

by edgarrmondragon

+8%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

3913955

1 year ago

by edgarrmondragon

-2%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

2f7d05b

1 year ago

by BuzzCutNorman

-6%

updated snapshot files to work with msgpec output

32be3a9

11 months ago

by BuzzCutNorman

+7%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

e08d7ca

11 months ago

by BuzzCutNorman

updated flattening snapshots

718a640

11 months ago

by BuzzCutNorman

-2%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

9a172d8

11 months ago

by BuzzCutNorman

+3%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

c331bb3

11 months ago

by BuzzCutNorman

-1%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

559d352

11 months ago

by BuzzCutNorman

-7%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

6c9760c

11 months ago

by BuzzCutNorman

+6%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

dc4b35d

10 months ago

by BuzzCutNorman

-9%

Merge branch 'main' of https://github.com/BuzzCutNorman/sdk into 1046-feat-faster-json-dumps-with-msgspec

2fb541c

7 months ago

by BuzzCutNorman

+17%

Merge branch 'main' into 1046-feat-faster-json-dumps-with-msgspec

1c7de71

6 months ago

by edgarrmondragon

-1,352%

Fix some missing imports

cd61c69

6 months ago

by edgarrmondragon

+1%

Move tests

0ec59f2

6 months ago

by edgarrmondragon

Home Terms Privacy Docs