mozilla-ai
encoderfile
BlogDocsChangelog

merge main into matryoshka docs branch

#184Closed
Comparing
main
(
a96e0bc
) with
165-cookbook-serve-matryoshka-embeddings
(
05b9c67
)
CodSpeed Performance Gauge
0%
Untouched
20
Skipped
20

Benchmarks

Skipped (20)

Passed

bench_seq_cls_softmax[(16, 2)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
+1%
138.3 Β΅s137 Β΅s
bench_tok_cls_softmax[(16, 16, 2)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
+1%
183.1 Β΅s182.1 Β΅s
bench_seq_cls_softmax[(32, 8)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
+1%
147.7 Β΅s147 Β΅s
bench_seq_cls_softmax[(128, 32)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
0%
292.7 Β΅s292 Β΅s
token_classification_postprocess[(64, 512)]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
61.3 ms61.2 ms
bench_embedding_l2_normalization[(16, 16, 16)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
0%
337.8 Β΅s337.4 Β΅s
token_classification_postprocess[(16, 128)]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
8.2 ms8.2 ms
token_classification_postprocess[(8, 16)]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
3.6 ms3.6 ms
bench_tok_cls_softmax[(32, 128, 8)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
0%
1.8 ms1.8 ms
embedding_postprocess[(8, 16, 384)]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
4.6 ms4.6 ms
embedding_postprocess[(16, 128, 768)]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
25.2 ms25.2 ms
bench_l2_normalize[Axis(0)]
encoderfile-core/benches/l2_norm.rs
CodSpeed Performance Gauge
0%
1.6 ms1.6 ms
bench_tok_cls_softmax[(128, 256, 32)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
0%
35.3 ms35.3 ms
embedding_postprocess[(64, 512, 1024)]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
312.1 ms312.1 ms
bench_l2_normalize[Axis(1)]
encoderfile-core/benches/l2_norm.rs
CodSpeed Performance Gauge
0%
3 ms3 ms
bench_embedding_l2_normalization[(32, 128, 384)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
0%
65.3 ms65.3 ms
bench_embedding_l2_normalization[(32, 256, 768)]
encoderfile-core/benches/benchmark_transforms.rs
CodSpeed Performance Gauge
0%
267 ms267 ms
sequence_classification_postprocess[64]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
0%
48.2 Β΅s48.3 Β΅s
sequence_classification_postprocess[8]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
-1%
10.9 Β΅s11.1 Β΅s
sequence_classification_postprocess[16]
encoderfile-core/benches/postprocessing.rs
CodSpeed Performance Gauge
-2%
32.4 Β΅s32.9 Β΅s

Commits

Click on a commit to change the comparison range
Base
main
378c5c3
0%
feat: add benchmarking (#18) Adds: - Workflow CI for microbenchmarks - Benchmarks for L2 normalization and postprocessing functions
87512a5
2 months ago
by besaleli
+0.36%
docs: add badges (#19)
973e6d7
2 months ago
by besaleli
-0.8%
docs: add ci badges
a7317f4
2 months ago
by besaleli
+0.62%
ci: add codecov.yaml
30dd104
2 months ago
by besaleli
-0.48%
ci: add codecov.yaml
e1ce59f
2 months ago
by besaleli
+0.01%
test: shared test utils library
eb4d123
2 months ago
by besaleli
+0.69%
test: shared test utils library
64ff21e
2 months ago
by besaleli
-0.82%
ci: fix clippy to check all features in pre-commit
89958d9
2 months ago
by besaleli
+0.82%
ci: update vscode default settings
5815652
2 months ago
by besaleli
-0.75%
docs: update third-party licenses
5137667
2 months ago
by besaleli
+0.02%
test: add test get model
c0ddb7e
2 months ago
by besaleli
+0.71%
test: add test get model
d9ea594
2 months ago
by besaleli
-1.07%
test: add http tests (#20)
a657a1e
2 months ago
by besaleli
+1.34%
test: overhaul grpc tests (#21)
3b1a27b
2 months ago
by besaleli
-0.36%
docs: Add project logo (#23)
ad1f29b
2 months ago
by hasangzl
-0.6%
refactor: Make vendored assets only accessible through AppState::default() (#22) In my everlasting quest to minimize state
b2db649
2 months ago
by besaleli
+0.36%
fix pre-commit
51ba568
2 months ago
by besaleli
+1.12%
ci: force install cargo-codspeed
2e3d734
2 months ago
by besaleli
-2.25%
docs: Add more instructions with a real example (#26)
7f7b608
2 months ago
by angpt
+1.16%
Add MCP support (#24) The official Rust MCP SDK https://github.com/modelcontextprotocol/rust-sdk is used to provide an MCP interface to encoderfile.
a0aa6fb
2 months ago
by javiermtorres
+35.12%
feat(postprocessing): embeddable lua scripts for postprocessing (#25) Big feature! Lua scripts are embedded at compile time to handle embedding/logit postprocessing. Examples can be found in `transforms/` folder. This will be extended to custom pooling for sentence transformers.
f6727a3
2 months ago
by besaleli
-35.26%
feat: Refactor protobufs (#33) Instead of having all services in one encoderfile.proto, keep in respective embedding.proto, sequence_classification.proto, etc. files
44e24c6
2 months ago
by besaleli
-0.03%
feat: add lua stubs for dsl
246ed9c
2 months ago
by besaleli
+0.3%
docs: Set up mkdocs (#37)
a423e83
2 months ago
by besaleli
+0.06%
ci: fix docs deploy
e706760
2 months ago
by besaleli
-0.31%
ci: fix docs deploy
f3663bf
2 months ago
by besaleli
-0.4%
ci: fix docs deploy
50646a8
2 months ago
by besaleli
+0.58%
docs: fix ci
af4f07a
2 months ago
by besaleli
-0.37%
Add GitHub Actions workflow for GitHub Pages deployment
aa7b4d2
2 months ago
by besaleli
+0.27%
update
7ce2905
2 months ago
by besaleli
-0.14%
docs: add docs ci badge to README
f180b07
2 months ago
by besaleli
+0.45%
docs: update badge name
b0bae5d
2 months ago
by besaleli
-10.78%
docs: add discord to the README
ef43839
2 months ago
by besaleli
+10.49%
ci: replace clippy with check in pre-commit
f8a3ca2
2 months ago
by besaleli
+0.27%
ci: install rust deps for benchmarking
2423bac
2 months ago
by besaleli
-0.74%
ci: update cargo-check name in pre-commit
6aa11a9
2 months ago
by besaleli
+0.52%
ci: add option for stable vs nightly toolchain
8babcd2
2 months ago
by besaleli
-0.24%
ci: fix vscode settings
1cf1337
2 months ago
by besaleli
+0.21%
fix: remove config.ld
c06fe99
2 months ago
by besaleli
-0.17%
ci: use cargo llvm cov
d17cdfa
2 months ago
by besaleli
+0.22%
ci: install clippy
4a97c92
2 months ago
by besaleli
-0.39%
lint: fix clippy errors
2e766e0
2 months ago
by besaleli
+0.4%
lint: fix clippy errors
ef90999
2 months ago
by besaleli
-0.38%
ci: cargo clean if target becomes too large
d6eecc0
2 months ago
by besaleli
+13.59%
feat: remove duplicate logits from protobuf (#43)
3b4a68d
2 months ago
by besaleli
-12.98%
feat: add sentence transformers support (#45) - Add support for sentence transformers - Add `mean_pool` tensor operation
1e90b98
2 months ago
by besaleli
-0.59%
ci: only deploy docs when needed
61e424b
2 months ago
by besaleli
+0.47%
update Makefile
426db87
2 months ago
by besaleli
-0.55%
docs: add lua tensor stubs to reference
3b902c0
2 months ago
by besaleli
+0.33%
feat: merge postprocess and pool (#49)
c84d530
2 months ago
by besaleli
-0.32%
refactor: pre-commit
0e87766
2 months ago
by besaleli
+0.49%
refactor: simplify vendor macro
aecc6c7
2 months ago
by besaleli
+0.1%
docs: Adding docs for the CLI (#44)
34d4bb5
2 months ago
by angpt
-0.81%
feat: we do not need torch
0d1ed90
2 months ago
by besaleli
-0.01%
feat: optimize tensor ops (#51) too many owned tensors :(
e72a224
2 months ago
by besaleli
+0.43%
feat: Revamp Build CLI (#52)
a3855f5
2 months ago
by besaleli
-0.01%
docs: fix stub refs
7daabc0
2 months ago
by besaleli
-0.3%
docs: Add docs for build CLI (#64) These are autogenerated. Let me know if they're too austereβ€”we can always write them by hand.
72cf58a
2 months ago
by besaleli
+0.77%
refactor: get rid of old encoderbuild dir
e7ff1ea
2 months ago
by besaleli
-0.48%
chore: update licenses
3f31ff0
2 months ago
by besaleli
+0.03%
chore: switch to cargo about
3d44af0
2 months ago
by besaleli
-0.2%
chore: switch from html to md for third party libraries
659515f
2 months ago
by besaleli
+0.59%
ci: add versioning (#65)
ad696e8
2 months ago
by besaleli
-0.78%
ci: fix version.py
d746b20
2 months ago
by besaleli
+0.54%
ci: fix version.py
1176df4
2 months ago
by besaleli
+0.15%
ci: update cargo lock on version change
02fdfbd
2 months ago
by besaleli
-0.47%
ci: update Cargo.lock for all packages on version bump
007c2c0
2 months ago
by besaleli
+0.21%
ci: only add root pyproject.toml on version bump
8ddc277
2 months ago
by besaleli
-0.1%
version: Version Bump πŸš€ 0.1.0 β†’ 0.1.0-beta.1 (#66) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0 to 0.1.0-beta.1. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
86b2e33
2 months ago
by github-actions[bot]
+0.32%
ci: do not ever run version management on push
9e51eec
2 months ago
by besaleli
-0.37%
ci: release workflow (#67)
81112bd
2 months ago
by besaleli
+0.48%
ci: fix git bot names
a02813f
2 months ago
by besaleli
-0.62%
ci: add permissions to release workflow
58dbf89
2 months ago
by besaleli
+0.12%
ci: add macos deps for build
0e517e4
2 months ago
by besaleli
+0.35%
ci: fix matrix on release
4c7aa84
2 months ago
by besaleli
-0.26%
ci: fix glibc issue in release
d05a151
2 months ago
by besaleli
-0.13%
ci: fix target issue
cba0703
2 months ago
by besaleli
+0.34%
ci: debug rustup targets
c42248d
2 months ago
by besaleli
-0.24%
ci: we will regroup on cross compilation later
83283c9
2 months ago
by besaleli
+0.44%
chore: remove license-file in cargo.toml
62ba41c
2 months ago
by besaleli
-0.88%
ci: release script (#70)
fdd25cb
2 months ago
by besaleli
+0.67%
ci: releases for encoderfile (#71)
0cfd63e
2 months ago
by besaleli
+0.09%
version: Version Bump πŸš€ 0.1.0-beta.1 β†’ 0.1.0-beta.2 (#72) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.1 to 0.1.0-beta.2. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
077ef9b
2 months ago
by github-actions[bot]
-0.2%
ci: publish encoderfile-core to crates.io
1c7cac3
2 months ago
by besaleli
-0.1%
version: Version Bump πŸš€ 0.1.0-beta.2 β†’ 0.1.0-beta.3 (#73) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.2 to 0.1.0-beta.3. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
818449f
2 months ago
by github-actions[bot]
-0.24%
ci: project setup for crates.io release
a968363
2 months ago
by besaleli
+0.33%
ci: project setup for crates.io release but in the right order this time
c13bbd6
2 months ago
by besaleli
+0.04%
ci: description for crate and envs
769b3ee
2 months ago
by besaleli
-0.03%
ci: publish encoderfile core as prereq to release
f9afe6b
2 months ago
by besaleli
-0.22%
version: Version Bump πŸš€ 0.1.0-beta.3 β†’ 0.1.0-beta.4 (#77) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.3 to 0.1.0-beta.4. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
01b252b
2 months ago
by github-actions[bot]
+0.29%
ci: no more empty release tags?
4bd5ee8
2 months ago
by besaleli
-0.31%
version: Version Bump πŸš€ 0.1.0-beta.4 β†’ 0.1.0-beta.5 (#78) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.4 to 0.1.0-beta.5. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
501e07b
2 months ago
by github-actions[bot]
+0.21%
ci: fix release naming
6681e9b
2 months ago
by besaleli
-0.01%
version: Version Bump πŸš€ 0.1.0-beta.5 β†’ 0.1.0-beta.6 (#79) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.5 to 0.1.0-beta.6. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
16228b7
2 months ago
by github-actions[bot]
+0.32%
ci: add run-dev-setup option to action
ec236d9
2 months ago
by besaleli
+0.05%
version: Version Bump πŸš€ 0.1.0-beta.6 β†’ 0.1.0-beta.7 (#81) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.6 to 0.1.0-beta.7. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
79d7f84
2 months ago
by github-actions[bot]
-0.54%
ci: add outputs to create-tag step in release
4a60e1c
2 months ago
by besaleli
-0.13%
version: Version Bump πŸš€ 0.1.0-beta.7 β†’ 0.1.0-beta.8 (#82) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.7 to 0.1.0-beta.8. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
3ad1c7f
2 months ago
by github-actions[bot]
+0.48%
ci: generate release notes
1d0f0dc
2 months ago
by besaleli
-0.26%
fix: update output path (#83)
6b2bf8a
2 months ago
by besaleli
+0.22%
docs: fix badges in README
e846030
2 months ago
by besaleli
-0.22%
version: Version Bump πŸš€ 0.1.0-beta.8 β†’ 0.1.0-beta.9 (#84) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.8 to 0.1.0-beta.9. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
8cd8e9a
2 months ago
by github-actions[bot]
-0.08%
fix: remove local deps bug (#86)
2dc0b4f
2 months ago
by besaleli
+0.25%
docs: update test config
35756ea
2 months ago
by besaleli
-0.22%
feat: no unwrap in hot paths
8f53011
2 months ago
by besaleli
+0.44%
feat: Build dockerfile (#88)
828b3d2
2 months ago
by besaleli
-0.42%
feat: add docker release workflow
2e9103a
2 months ago
by besaleli
+0.16%
ci: rename docker release workflow
70ebeb6
2 months ago
by besaleli
+0.1%
version: Version Bump πŸš€ 0.1.0-beta.9 β†’ 0.1.0-rc.1 (#90) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-beta.9 to 0.1.0-rc.1. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
11b991c
2 months ago
by github-actions[bot]
-0.2%
feat: merge release file
d8a979a
2 months ago
by besaleli
-0.04%
ci: optimize docker builds
444c7d0
2 months ago
by besaleli
+0.09%
version: Version Bump πŸš€ 0.1.0-rc.1 β†’ 0.1.0-rc.2 (#91) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.1 to 0.1.0-rc.2. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
19b1272
2 months ago
by github-actions[bot]
+0.15%
ci: fix release
92e740b
2 months ago
by besaleli
-0.59%
version: Version Bump πŸš€ 0.1.0-rc.2 β†’ 0.1.0-rc.3 (#93) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.2 to 0.1.0-rc.3. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
7952987
2 months ago
by github-actions[bot]
+0.96%
ci: add create-tag as dep of docker-build for release
e905c90
2 months ago
by besaleli
-0.9%
version: Version Bump πŸš€ 0.1.0-rc.3 β†’ 0.1.0-rc.4 (#94) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.3 to 0.1.0-rc.4. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
d874fae
2 months ago
by github-actions[bot]
+0.61%
version: Version Bump πŸš€ 0.1.0-rc.4 β†’ 0.1.0-rc.5 (#95) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.4 to 0.1.0-rc.5. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
efec31c
2 months ago
by github-actions[bot]
-0.24%
ci: fix dockerfile workdir
18a3a39
2 months ago
by besaleli
-0.04%
version: Version Bump πŸš€ 0.1.0-rc.5 β†’ 0.1.0-rc.6 (#97) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.5 to 0.1.0-rc.6. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
fe1ca76
2 months ago
by github-actions[bot]
-0.12%
ci: fix arm64 build
4e307cc
2 months ago
by besaleli
0%
version: Version Bump πŸš€ 0.1.0-rc.6 β†’ 0.1.0-rc.7 (#99) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.6 to 0.1.0-rc.7. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
eac742d
2 months ago
by github-actions[bot]
+0.42%
ci: add qemu for docker builds
7830e25
2 months ago
by besaleli
-0.12%
version: Version Bump πŸš€ 0.1.0-rc.7 β†’ 0.1.0-rc.8 (#100) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.7 to 0.1.0-rc.8. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
c6b669c
2 months ago
by github-actions[bot]
-0.46%
ci: use native runners for docker builds
807939e
2 months ago
by besaleli
+0.75%
version: Version Bump πŸš€ 0.1.0-rc.8 β†’ 0.1.0-rc.9 (#101) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.8 to 0.1.0-rc.9. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
b363ad7
2 months ago
by github-actions[bot]
-0.63%
fix: update Dockerfile
cfb7a07
2 months ago
by besaleli
+0.27%
style: format
b34c1cf
2 months ago
by besaleli
-0.07%
version: Version Bump πŸš€ 0.1.0-rc.9 β†’ 0.1.0-rc.10 (#102) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.9 to 0.1.0-rc.10. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
bab5e5e
2 months ago
by github-actions[bot]
+0.34%
ci: only tag docker image as latest if not prerelease
cc3927e
2 months ago
by besaleli
-0.64%
version: Version Bump πŸš€ 0.1.0-rc.10 β†’ 0.1.0-rc.11 (#103) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.10 to 0.1.0-rc.11. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
168d951
2 months ago
by github-actions[bot]
+0.4%
ci: fix lock step
43f2374
2 months ago
by besaleli
-21.92%
feat: feature gates for encoderfile-core (#126)
2daccea
2 months ago
by besaleli
+11.59%
docs: update badges
43f7516
2 months ago
by besaleli
+10.36%
docs: update badges
9970908
2 months ago
by besaleli
+0.01%
Refactor diagram phases and update labels (#127)
1e47694
2 months ago
by angpt
-0.05%
version: Version Bump πŸš€ 0.1.0-rc.23 β†’ 0.1.0-rc.24 (#128) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.23 to 0.1.0-rc.24. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
1578b6f
2 months ago
by github-actions[bot]
-0.08%
version: Version Bump πŸš€ 0.1.0-rc.24 β†’ 0.1.0 (#129) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0-rc.24 to 0.1.0. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
77a0788
2 months ago
by github-actions[bot]
+0.26%
ci: add release to actions
6f8c6e2
2 months ago
by besaleli
-12.4%
docs: copy readme in homepage
0157c1e
2 months ago
by besaleli
+12.55%
ci: update docs workflow
c1a755f
2 months ago
by besaleli
-0.56%
ci: update versioning script
4b588d4
2 months ago
by besaleli
-0.1%
version: Version Bump πŸš€ 0.1.0 β†’ 0.1.1 (#130) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.0 to 0.1.1. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
a2e4fd4
2 months ago
by github-actions[bot]
+0.59%
docs: add pymd superfences
26d0e33
2 months ago
by besaleli
-0.7%
docs: fix links in readme (#132) These were not pointing to anything since the building guide is in the docs. I've linked it directly to our deployed docs.
86d20ee
2 months ago
by besaleli
+0.88%
docs: Updating index.md (#133)
2be28bb
2 months ago
by angpt
-0.58%
version: Version Bump πŸš€ 0.1.2-rc.1 (#143) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.2-rc.0 to 0.1.2-rc.1. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
fe27806
2 months ago
by github-actions[bot]
-0.05%
version: Version Bump πŸš€ 0.1.2 (#144) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.2-rc.1 to 0.1.2. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
7604809
2 months ago
by github-actions[bot]
+0.43%
feat: MCP integration tests (#131) A single MCP integration test is provided, through the same use of the rmcp library. A client is started, and a request is done to a local server on localhost. Using an in-memory transport channel would be more interesting; alternatives include a unix socket, which seems to be supported in both [reqwest](https://docs.rs/reqwest/latest/reqwest/trait.UnixSocketProvider.html) and [hyper (through hyperlocal)](https://lib.rs/crates/hyperlocal).
f179b4b
2 months ago
by javiermtorres
-0.65%
docs: remove versioned docs (#149)
ef6c587
1 month ago
by besaleli
+1.75%
feat: validate transforms on compile (#151) - Adds compile-time checks for transforms during encoderfile build stage - DRY mean pooling code a little Scope creep: - remove old config docs generation - new makefile commands
dedca60
1 month ago
by besaleli
-1.64%
feat(tensor): clamp (#157) ## Add `Tensor:clamp` with PyTorch-style semantics + Rust specialization This PR introduces a `clamp` method for `Tensor`, matching PyTorch’s behavior: * `clamp(min, max)` applies both bounds * `clamp(min, nil)` applies only the lower bound * `clamp(nil, max)` applies only the upper bound * `clamp(nil, nil)` returns an identity copy * bounds may be `f32::NAN`, and NaN is treated as a valid bound * `(Some(NaN), Some(NaN))` produces an all-NaN output, mirroring IEEE-754 rules ### Implementation details * Works on `ArrayD<f32>` and returns a new tensor (input remains immutable). * Requires arrays to be contiguous; non-contiguous inputs return an error. * Loop specialization is used to avoid per-element `Option` checks: * four fast paths: `(min,max)`, `(min)`, `(max)`, `(none)` * allows LLVM to fully optimize and auto-vectorize the clamp loop * identity case uses `copy_from_slice` instead of a manual loop * NaN semantics follow raw IEEE-754 float operations (`max`, `min`) with no extra filtering. ### Tests * Basic clamp behavior * Lower-bound-only / upper-bound-only * Identity case * Degenerate case (`min == max`) * NaN bounds (`min = NaN`, `max = NaN`) * ND shape preservation
79542b7
1 month ago
by besaleli
-0.55%
feat: Make versions less messy (#163) - Pins shared dep versions across workspaces - Ensures that generated encoderfile source code only has **one** dependency Also, refactored entrypoint a bit to make easier
348ac97
1 month ago
by besaleli
+1.1%
feat(tensor): truncate_axis (#164) Adds a function that truncates a Tensor along a specified axis. Especially useful for matryoshka embeddings, where embeddings can be truncated for... reasons.
a4bc6ae
1 month ago
by besaleli
-0.32%
feat(tensor): layer_norm op (#168) Adds layer_norm to tensor ops (no learnable parameters) See https://docs.pytorch.org/docs/stable/generated/torch.nn.functional.layer_norm.html
93100d2
1 month ago
by besaleli
-0.09%
Add rusTLS support via axum-server (#154) It has been tested manually via self signed certs and curl -k. An automated integration test will be added shortly. axum-server is a [separate package](https://github.com/programatik29/axum-server) that is used in [axum examples](https://github.com/tokio-rs/axum/blob/main/examples/tls-rustls/src/main.rs#L17).
fd5e8f7
1 month ago
by javiermtorres
-0.11%
feat: Stronger Types (#172)
b201aa0
1 month ago
by besaleli
+0.09%
feat: Lua transformation generation (#169) Adds a CLI utility for generating transform templates. Usage example: ```bash encoderfile new-transform --model-type embedding > my_transform.lua ``` Will output something like: ```lua ---Generated by Encoderfile ❀️ ---Remember: Lua is 1-indexed! ---Postprocess embeddings ---Must return 3D tensor of shape [batch_size, seq_len, *] ---@input Tensor 3D tensor of shape [batch_size, seq_len, hidden_dim] ---@return Tensor function Postprocess(arr) ---Replace with your logic here return arr end ``` This is our opportunity to remind people of fun Lua idiosyncracies (like 1-based indexing)
c245f24
1 month ago
by besaleli
-0.06%
version: Version Bump πŸš€ 0.2.0 (#174) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.1.2 to 0.2.0. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
98edabb
1 month ago
by github-actions[bot]
+0.08%
ci: fix crates version issue (#175)
6d7f356
1 month ago
by besaleli
+0.26%
fix: update Dockerfile
5da152b
1 month ago
by besaleli
0%
version: Version Bump πŸš€ 0.2.1 (#176) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.2.0 to 0.2.1. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
4120978
1 month ago
by github-actions[bot]
-0.13%
feat: Embedded config (#181) This will eventually be used for things like tokenization padding strategy overrides, etc. Plus, fewer embedded assets!
05b9c67
1 month ago
by besaleli
-0.03%
feat: parse padding settings from tokenizer_config.json (#183)
a96e0bc
12 days ago
by besaleli
-0.17%
fix: remove old pad_token_id field
0887994
12 days ago
by besaleli
+0.23%
version: Version Bump πŸš€ 0.3.0-rc.0 (#186) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.2.1 to 0.3.0-rc.0. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
f2a2995
6 days ago
by github-actions[bot]
-0.12%
fix: Register Tensor as Lua UserType on Lua instantiation (#190)
5a970e4
6 days ago
by besaleli
+0.32%
fix: fmt
455811d
6 days ago
by besaleli
+0.01%
version: Version Bump πŸš€ 0.3.0-rc.1 (#192) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.3.0-rc.0 to 0.3.0-rc.1. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
9131766
6 days ago
by github-actions[bot]
-0.65%
version: Version Bump πŸš€ 0.3.0 (#193) ## πŸŽ‰ Version Bump πŸŽ‰ This PR bumps the version from 0.3.0-rc.1 to 0.3.0. ### πŸ”„ Changes - πŸ“ Updated version in pyproject.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
41f3c51
6 days ago
by github-actions[bot]
+0.27%
feat: simplify releases (#199) Switch from custom Python script to using `cargo-goose`
b0a3c17
4 days ago
by besaleli
+12.5%
feat(format): transition packaging from generated rust project builds to post link binary payloads (#200) ## Description This PR introduces the encoderfile embedded binary format and packaging pipeline. Instead of embedding model artifacts via linker sections or include_bytes!, the runtime binary now has a self-describing payload appended at EOF, located via a fixed-size footer and protobuf manifest. Model artifacts (weights, tokenizer, config, transforms) are streamed from disk using seek-based IO and loaded lazily at runtime, with a single dynamic dispatch on model type followed by fully statically-typed execution. This design avoids platform-specific linker behavior, keeps builds fast, enables inspection and tooling, and cleanly separates compilation from packaging. ### Benefits - No more cargo-in-cargo - Lazy loading of large assets (e.g., model weights) ### Why manually specified file format instead of appended sections? We intentionally avoid embedding artifacts via custom linker sections (.data, extern "C" symbols). While simpler initially, this approach is platform-specific, eagerly loads large blobs into memory, and provides no clear boundary for versioning or inspection. The appended encoderfile container instead offers predictable cross-platform behavior, lazy loading, and a stable, versioned format. ## Testing To test, run: ```bash cargo build --bin encoderfile --release ``` Then run: ```bash cargo run -- build -f test_config.yml --base-binary-path target/release/encoderfile ``` To run encoderfile: ```bash chmod +x ./my-model-2.encoderfile ./my-model-2.encoderfile infer "hello" ``` ## Notes - Tokenizer config is now located in `TokenizerService` instead of `Config` - Base binaries are compiled from `encoderfile-runtime` - Base binary must be explicitly specified until https://github.com/mozilla-ai/encoderfile/issues/204 is closed. For testing, run `cargo build --bin encoderfile --release`, and use `target/release/encoderfile-runtime`. - Dockerfile now uses debian:bookworm-slim as a base image since we no longer need Cargo toolchain. - we're explicitly encoding everything in little-endian, BE is theoretically possible but not a priority given our prioritized arch targets ## Out of Scope - Integration tests. See related issue: https://github.com/mozilla-ai/encoderfile/issues/203 - Pulling base binaries from GH releases. See related issue: https://github.com/mozilla-ai/encoderfile/issues/204 - Docs updates. See related issue: https://github.com/mozilla-ai/encoderfile/issues/205 - Encoderfile image CLI refactor. See related issue: https://github.com/mozilla-ai/encoderfile/issues/206
5166bf6
2 days ago
by besaleli
-12.82%
version: Version Bump πŸš€ 0.4.0-beta.1 (#211) Version bumped from 0.3.0 to 0.4.0-beta.1. ### πŸ”„ Changes - πŸ“ Updated version in Cargo.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
f2dfba5
2 days ago
by github-actions[bot]
+0.69%
version: Version Bump πŸš€ 0.4.0-beta.2 (#212) Version bumped from 0.4.0-beta.1 to 0.4.0-beta.2. ### πŸ”„ Changes - πŸ“ Updated version in Cargo.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
8757a98
2 days ago
by github-actions[bot]
-0.19%
feat(build): pull base binaries from gh releases for encoderfile builds (#213) - Add auto-pulling base binaries from gh releases - Add utils for adding, removing, and listing base binaries in cache - Add logging
378c5c3
2 days ago
by besaleli
+0.01%
version: Version Bump πŸš€ 0.4.0-beta.3 (#214) Version bumped from 0.4.0-beta.2 to 0.4.0-beta.3. ### πŸ”„ Changes - πŸ“ Updated version in Cargo.toml - πŸ”’ Updated Cargo.lock ✨ This PR was automatically generated by the Version Management workflow ✨ ![version bump](https://media0.giphy.com/media/v1.Y2lkPTc5MGI3NjExNjJmOXBxbGh2Z3BiYXM1NnJhMHdtbmNoaTFxN2xjOGZjZnd1ZGhuMiZlcD12MV9pbnRlcm5hbF9naWZfYnlfaWQmY3Q9Zw/3oEjI53nBYOOEQgDcY/giphy.gif) Co-authored-by: besaleli <besaleli@users.noreply.github.com>
89ae444
2 days ago
by github-actions[bot]
Β© 2026 CodSpeed Technology
Home Terms Privacy Docs