No successful run was found on 165-cookbook-serve-matryoshka-embeddings (35c0a06) during the generation of this report, so main (05b9c67) was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
Skipped (20)
These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports. Learn more about archiving benchmarks
bench_seq_cls_softmax[(128, 32)]
encoderfile/benches/benchmark_transforms.rs
Skipped
269.5 µs*
bench_tok_cls_softmax[(128, 256, 32)]
encoderfile/benches/benchmark_transforms.rs
Skipped
27.9 ms*
bench_embedding_l2_normalization[(32, 256, 768)]
encoderfile/benches/benchmark_transforms.rs
Skipped
266.1 ms*
embedding_postprocess[(64, 512, 1024)]
encoderfile/benches/postprocessing.rs
Skipped
311.3 ms*
bench_embedding_l2_normalization[(32, 128, 384)]
encoderfile/benches/benchmark_transforms.rs
Skipped
65.1 ms*
bench_seq_cls_softmax[(16, 2)]
encoderfile/benches/benchmark_transforms.rs
Skipped
127.5 µs*
bench_embedding_l2_normalization[(16, 16, 16)]
encoderfile/benches/benchmark_transforms.rs
Skipped
337 µs*
embedding_postprocess[(8, 16, 384)]
encoderfile/benches/postprocessing.rs
Skipped
4.6 ms*
bench_seq_cls_softmax[(32, 8)]
encoderfile/benches/benchmark_transforms.rs
Skipped
134.7 µs*
sequence_classification_postprocess[16]
encoderfile/benches/postprocessing.rs
Skipped
33.6 µs*
embedding_postprocess[(16, 128, 768)]
encoderfile/benches/postprocessing.rs
Skipped
25.2 ms*
bench_tok_cls_softmax[(32, 128, 8)]
encoderfile/benches/benchmark_transforms.rs
Skipped
1.4 ms*
bench_tok_cls_softmax[(16, 16, 2)]
encoderfile/benches/benchmark_transforms.rs
Skipped
149.2 µs*
bench_l2_normalize[Axis(0)]
encoderfile/benches/l2_norm.rs
Skipped
1.5 ms*
sequence_classification_postprocess[64]
encoderfile/benches/postprocessing.rs
Skipped
47.8 µs*
token_classification_postprocess[(8, 16)]
encoderfile/benches/postprocessing.rs
Skipped
3.6 ms*
token_classification_postprocess[(64, 512)]
encoderfile/benches/postprocessing.rs
Skipped
61.2 ms*
sequence_classification_postprocess[8]
encoderfile/benches/postprocessing.rs
Skipped
11 µs*
token_classification_postprocess[(16, 128)]
encoderfile/benches/postprocessing.rs
Skipped
8.2 ms*
bench_l2_normalize[Axis(1)]
encoderfile/benches/l2_norm.rs
Skipped
3 ms*
Passed
bench_seq_cls_softmax[(16, 2)]
encoderfile-core/benches/benchmark_transforms.rs
+1%
138.3 µs137 µs
bench_tok_cls_softmax[(16, 16, 2)]
encoderfile-core/benches/benchmark_transforms.rs
+1%
183.1 µs182.1 µs
bench_seq_cls_softmax[(32, 8)]
encoderfile-core/benches/benchmark_transforms.rs
+1%
147.7 µs147 µs
bench_seq_cls_softmax[(128, 32)]
encoderfile-core/benches/benchmark_transforms.rs
0%
292.7 µs292 µs
token_classification_postprocess[(64, 512)]
encoderfile-core/benches/postprocessing.rs
0%
61.3 ms61.2 ms
bench_embedding_l2_normalization[(16, 16, 16)]
encoderfile-core/benches/benchmark_transforms.rs
0%
337.8 µs337.4 µs
token_classification_postprocess[(16, 128)]
encoderfile-core/benches/postprocessing.rs
0%
8.2 ms8.2 ms
token_classification_postprocess[(8, 16)]
encoderfile-core/benches/postprocessing.rs
0%
3.6 ms3.6 ms
bench_tok_cls_softmax[(32, 128, 8)]
encoderfile-core/benches/benchmark_transforms.rs
0%
1.8 ms1.8 ms
embedding_postprocess[(8, 16, 384)]
encoderfile-core/benches/postprocessing.rs
0%
4.6 ms4.6 ms
embedding_postprocess[(16, 128, 768)]
encoderfile-core/benches/postprocessing.rs
0%
25.2 ms25.2 ms
bench_l2_normalize[Axis(0)]
encoderfile-core/benches/l2_norm.rs
0%
1.6 ms1.6 ms
bench_tok_cls_softmax[(128, 256, 32)]
encoderfile-core/benches/benchmark_transforms.rs
0%
35.3 ms35.3 ms
embedding_postprocess[(64, 512, 1024)]
encoderfile-core/benches/postprocessing.rs
0%
312.1 ms312.1 ms
bench_l2_normalize[Axis(1)]
encoderfile-core/benches/l2_norm.rs
0%
3 ms3 ms
bench_embedding_l2_normalization[(32, 128, 384)]
encoderfile-core/benches/benchmark_transforms.rs
0%
65.3 ms65.3 ms
bench_embedding_l2_normalization[(32, 256, 768)]
encoderfile-core/benches/benchmark_transforms.rs
0%
267 ms267 ms
sequence_classification_postprocess[64]
encoderfile-core/benches/postprocessing.rs
0%
48.2 µs48.3 µs
sequence_classification_postprocess[8]
encoderfile-core/benches/postprocessing.rs
-1%
10.9 µs11.1 µs
sequence_classification_postprocess[16]
encoderfile-core/benches/postprocessing.rs
-2%
32.4 µs32.9 µs
Commits
Click on a commit to change the comparison range
Base
main
378c5c3
0%
feat: add benchmarking (#18)
Adds:
- Workflow CI for microbenchmarks
- Benchmarks for L2 normalization and postprocessing functions
87512a5
2 months ago
by besaleli
+0.36%
docs: add badges (#19)
973e6d7
2 months ago
by besaleli
-0.8%
docs: add ci badges
a7317f4
2 months ago
by besaleli
+0.62%
ci: add codecov.yaml
30dd104
2 months ago
by besaleli
-0.48%
ci: add codecov.yaml
e1ce59f
2 months ago
by besaleli
+0.01%
test: shared test utils library
eb4d123
2 months ago
by besaleli
+0.69%
test: shared test utils library
64ff21e
2 months ago
by besaleli
-0.82%
ci: fix clippy to check all features in pre-commit
89958d9
2 months ago
by besaleli
+0.82%
ci: update vscode default settings
5815652
2 months ago
by besaleli
-0.75%
docs: update third-party licenses
5137667
2 months ago
by besaleli
+0.02%
test: add test get model
c0ddb7e
2 months ago
by besaleli
+0.71%
test: add test get model
d9ea594
2 months ago
by besaleli
-1.07%
test: add http tests (#20)
a657a1e
2 months ago
by besaleli
+1.34%
test: overhaul grpc tests (#21)
3b1a27b
2 months ago
by besaleli
-0.36%
docs: Add project logo (#23)
ad1f29b
2 months ago
by hasangzl
-0.6%
refactor: Make vendored assets only accessible through AppState::default() (#22)
In my everlasting quest to minimize state
b2db649
2 months ago
by besaleli
+0.36%
fix pre-commit
51ba568
2 months ago
by besaleli
+1.12%
ci: force install cargo-codspeed
2e3d734
2 months ago
by besaleli
-2.25%
docs: Add more instructions with a real example (#26)
7f7b608
2 months ago
by angpt
+1.16%
Add MCP support (#24)
The official Rust MCP SDK
https://github.com/modelcontextprotocol/rust-sdk is used to provide an
MCP interface to encoderfile.
a0aa6fb
2 months ago
by javiermtorres
+35.12%
feat(postprocessing): embeddable lua scripts for postprocessing (#25)
Big feature!
Lua scripts are embedded at compile time to handle embedding/logit
postprocessing. Examples can be found in `transforms/` folder. This will
be extended to custom pooling for sentence transformers.
f6727a3
2 months ago
by besaleli
-35.26%
feat: Refactor protobufs (#33)
Instead of having all services in one encoderfile.proto, keep in
respective embedding.proto, sequence_classification.proto, etc. files
44e24c6
2 months ago
by besaleli
-0.03%
feat: add lua stubs for dsl
246ed9c
2 months ago
by besaleli
+0.3%
docs: Set up mkdocs (#37)
a423e83
2 months ago
by besaleli
+0.06%
ci: fix docs deploy
e706760
2 months ago
by besaleli
-0.31%
ci: fix docs deploy
f3663bf
2 months ago
by besaleli
-0.4%
ci: fix docs deploy
50646a8
2 months ago
by besaleli
+0.58%
docs: fix ci
af4f07a
2 months ago
by besaleli
-0.37%
Add GitHub Actions workflow for GitHub Pages deployment
aa7b4d2
2 months ago
by besaleli
+0.27%
update
7ce2905
2 months ago
by besaleli
-0.14%
docs: add docs ci badge to README
f180b07
2 months ago
by besaleli
+0.45%
docs: update badge name
b0bae5d
2 months ago
by besaleli
-10.78%
docs: add discord to the README
ef43839
2 months ago
by besaleli
+10.49%
ci: replace clippy with check in pre-commit
f8a3ca2
2 months ago
by besaleli
+0.27%
ci: install rust deps for benchmarking
2423bac
2 months ago
by besaleli
-0.74%
ci: update cargo-check name in pre-commit
6aa11a9
2 months ago
by besaleli
+0.52%
ci: add option for stable vs nightly toolchain
8babcd2
2 months ago
by besaleli
-0.24%
ci: fix vscode settings
1cf1337
2 months ago
by besaleli
+0.21%
fix: remove config.ld
c06fe99
2 months ago
by besaleli
-0.17%
ci: use cargo llvm cov
d17cdfa
2 months ago
by besaleli
+0.22%
ci: install clippy
4a97c92
2 months ago
by besaleli
-0.39%
lint: fix clippy errors
2e766e0
2 months ago
by besaleli
+0.4%
lint: fix clippy errors
ef90999
2 months ago
by besaleli
-0.38%
ci: cargo clean if target becomes too large
d6eecc0
2 months ago
by besaleli
+13.59%
feat: remove duplicate logits from protobuf (#43)
3b4a68d
2 months ago
by besaleli
-12.98%
feat: add sentence transformers support (#45)
- Add support for sentence transformers
- Add `mean_pool` tensor operation
1e90b98
2 months ago
by besaleli
-0.59%
ci: only deploy docs when needed
61e424b
2 months ago
by besaleli
+0.47%
update Makefile
426db87
2 months ago
by besaleli
-0.55%
docs: add lua tensor stubs to reference
3b902c0
2 months ago
by besaleli
+0.33%
feat: merge postprocess and pool (#49)
c84d530
2 months ago
by besaleli
-0.32%
refactor: pre-commit
0e87766
2 months ago
by besaleli
+0.49%
refactor: simplify vendor macro
aecc6c7
2 months ago
by besaleli
+0.1%
docs: Adding docs for the CLI (#44)
34d4bb5
2 months ago
by angpt
-0.81%
feat: we do not need torch
0d1ed90
2 months ago
by besaleli
-0.01%
feat: optimize tensor ops (#51)
too many owned tensors :(
e72a224
2 months ago
by besaleli
+0.43%
feat: Revamp Build CLI (#52)
a3855f5
2 months ago
by besaleli
-0.01%
docs: fix stub refs
7daabc0
2 months ago
by besaleli
-0.3%
docs: Add docs for build CLI (#64)
These are autogenerated. Let me know if they're too austere—we can
always write them by hand.
72cf58a
2 months ago
by besaleli
+0.77%
refactor: get rid of old encoderbuild dir
e7ff1ea
2 months ago
by besaleli
-0.48%
chore: update licenses
3f31ff0
2 months ago
by besaleli
+0.03%
chore: switch to cargo about
3d44af0
2 months ago
by besaleli
-0.2%
chore: switch from html to md for third party libraries
659515f
2 months ago
by besaleli
+0.59%
ci: add versioning (#65)
ad696e8
2 months ago
by besaleli
-0.78%
ci: fix version.py
d746b20
2 months ago
by besaleli
+0.54%
ci: fix version.py
1176df4
2 months ago
by besaleli
+0.15%
ci: update cargo lock on version change
02fdfbd
2 months ago
by besaleli
-0.47%
ci: update Cargo.lock for all packages on version bump
007c2c0
2 months ago
by besaleli
+0.21%
ci: only add root pyproject.toml on version bump
8ddc277
2 months ago
by besaleli
-0.1%
version: Version Bump 🚀 0.1.0 → 0.1.0-beta.1 (#66)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0 to 0.1.0-beta.1.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
86b2e33
2 months ago
by github-actions[bot]
+0.32%
ci: do not ever run version management on push
9e51eec
2 months ago
by besaleli
-0.37%
ci: release workflow (#67)
81112bd
2 months ago
by besaleli
+0.48%
ci: fix git bot names
a02813f
2 months ago
by besaleli
-0.62%
ci: add permissions to release workflow
58dbf89
2 months ago
by besaleli
+0.12%
ci: add macos deps for build
0e517e4
2 months ago
by besaleli
+0.35%
ci: fix matrix on release
4c7aa84
2 months ago
by besaleli
-0.26%
ci: fix glibc issue in release
d05a151
2 months ago
by besaleli
-0.13%
ci: fix target issue
cba0703
2 months ago
by besaleli
+0.34%
ci: debug rustup targets
c42248d
2 months ago
by besaleli
-0.24%
ci: we will regroup on cross compilation later
83283c9
2 months ago
by besaleli
+0.44%
chore: remove license-file in cargo.toml
62ba41c
2 months ago
by besaleli
-0.88%
ci: release script (#70)
fdd25cb
2 months ago
by besaleli
+0.67%
ci: releases for encoderfile (#71)
0cfd63e
2 months ago
by besaleli
+0.09%
version: Version Bump 🚀 0.1.0-beta.1 → 0.1.0-beta.2 (#72)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.1 to 0.1.0-beta.2.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
077ef9b
2 months ago
by github-actions[bot]
-0.2%
ci: publish encoderfile-core to crates.io
1c7cac3
2 months ago
by besaleli
-0.1%
version: Version Bump 🚀 0.1.0-beta.2 → 0.1.0-beta.3 (#73)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.2 to 0.1.0-beta.3.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
818449f
2 months ago
by github-actions[bot]
-0.24%
ci: project setup for crates.io release
a968363
2 months ago
by besaleli
+0.33%
ci: project setup for crates.io release but in the right order this time
c13bbd6
2 months ago
by besaleli
+0.04%
ci: description for crate and envs
769b3ee
2 months ago
by besaleli
-0.03%
ci: publish encoderfile core as prereq to release
f9afe6b
2 months ago
by besaleli
-0.22%
version: Version Bump 🚀 0.1.0-beta.3 → 0.1.0-beta.4 (#77)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.3 to 0.1.0-beta.4.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
01b252b
2 months ago
by github-actions[bot]
+0.29%
ci: no more empty release tags?
4bd5ee8
2 months ago
by besaleli
-0.31%
version: Version Bump 🚀 0.1.0-beta.4 → 0.1.0-beta.5 (#78)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.4 to 0.1.0-beta.5.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
501e07b
2 months ago
by github-actions[bot]
+0.21%
ci: fix release naming
6681e9b
2 months ago
by besaleli
-0.01%
version: Version Bump 🚀 0.1.0-beta.5 → 0.1.0-beta.6 (#79)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.5 to 0.1.0-beta.6.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
16228b7
2 months ago
by github-actions[bot]
+0.32%
ci: add run-dev-setup option to action
ec236d9
2 months ago
by besaleli
+0.05%
version: Version Bump 🚀 0.1.0-beta.6 → 0.1.0-beta.7 (#81)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.6 to 0.1.0-beta.7.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
79d7f84
2 months ago
by github-actions[bot]
-0.54%
ci: add outputs to create-tag step in release
4a60e1c
2 months ago
by besaleli
-0.13%
version: Version Bump 🚀 0.1.0-beta.7 → 0.1.0-beta.8 (#82)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.7 to 0.1.0-beta.8.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
3ad1c7f
2 months ago
by github-actions[bot]
+0.48%
ci: generate release notes
1d0f0dc
2 months ago
by besaleli
-0.26%
fix: update output path (#83)
6b2bf8a
2 months ago
by besaleli
+0.22%
docs: fix badges in README
e846030
2 months ago
by besaleli
-0.22%
version: Version Bump 🚀 0.1.0-beta.8 → 0.1.0-beta.9 (#84)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.8 to 0.1.0-beta.9.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
8cd8e9a
2 months ago
by github-actions[bot]
-0.08%
fix: remove local deps bug (#86)
2dc0b4f
2 months ago
by besaleli
+0.25%
docs: update test config
35756ea
2 months ago
by besaleli
-0.22%
feat: no unwrap in hot paths
8f53011
2 months ago
by besaleli
+0.44%
feat: Build dockerfile (#88)
828b3d2
2 months ago
by besaleli
-0.42%
feat: add docker release workflow
2e9103a
2 months ago
by besaleli
+0.16%
ci: rename docker release workflow
70ebeb6
2 months ago
by besaleli
+0.1%
version: Version Bump 🚀 0.1.0-beta.9 → 0.1.0-rc.1 (#90)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-beta.9 to 0.1.0-rc.1.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
11b991c
2 months ago
by github-actions[bot]
-0.2%
feat: merge release file
d8a979a
2 months ago
by besaleli
-0.04%
ci: optimize docker builds
444c7d0
2 months ago
by besaleli
+0.09%
version: Version Bump 🚀 0.1.0-rc.1 → 0.1.0-rc.2 (#91)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.1 to 0.1.0-rc.2.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
19b1272
2 months ago
by github-actions[bot]
+0.15%
ci: fix release
92e740b
2 months ago
by besaleli
-0.59%
version: Version Bump 🚀 0.1.0-rc.2 → 0.1.0-rc.3 (#93)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.2 to 0.1.0-rc.3.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
7952987
2 months ago
by github-actions[bot]
+0.96%
ci: add create-tag as dep of docker-build for release
e905c90
2 months ago
by besaleli
-0.9%
version: Version Bump 🚀 0.1.0-rc.3 → 0.1.0-rc.4 (#94)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.3 to 0.1.0-rc.4.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
d874fae
2 months ago
by github-actions[bot]
+0.61%
version: Version Bump 🚀 0.1.0-rc.4 → 0.1.0-rc.5 (#95)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.4 to 0.1.0-rc.5.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
efec31c
2 months ago
by github-actions[bot]
-0.24%
ci: fix dockerfile workdir
18a3a39
2 months ago
by besaleli
-0.04%
version: Version Bump 🚀 0.1.0-rc.5 → 0.1.0-rc.6 (#97)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.5 to 0.1.0-rc.6.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
fe1ca76
2 months ago
by github-actions[bot]
-0.12%
ci: fix arm64 build
4e307cc
2 months ago
by besaleli
0%
version: Version Bump 🚀 0.1.0-rc.6 → 0.1.0-rc.7 (#99)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.6 to 0.1.0-rc.7.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
eac742d
2 months ago
by github-actions[bot]
+0.42%
ci: add qemu for docker builds
7830e25
2 months ago
by besaleli
-0.12%
version: Version Bump 🚀 0.1.0-rc.7 → 0.1.0-rc.8 (#100)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.7 to 0.1.0-rc.8.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
c6b669c
2 months ago
by github-actions[bot]
-0.46%
ci: use native runners for docker builds
807939e
2 months ago
by besaleli
+0.75%
version: Version Bump 🚀 0.1.0-rc.8 → 0.1.0-rc.9 (#101)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.8 to 0.1.0-rc.9.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
b363ad7
2 months ago
by github-actions[bot]
-0.63%
fix: update Dockerfile
cfb7a07
2 months ago
by besaleli
+0.27%
style: format
b34c1cf
2 months ago
by besaleli
-0.07%
version: Version Bump 🚀 0.1.0-rc.9 → 0.1.0-rc.10 (#102)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.9 to 0.1.0-rc.10.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
bab5e5e
2 months ago
by github-actions[bot]
+0.34%
ci: only tag docker image as latest if not prerelease
cc3927e
2 months ago
by besaleli
-0.64%
version: Version Bump 🚀 0.1.0-rc.10 → 0.1.0-rc.11 (#103)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.10 to 0.1.0-rc.11.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
168d951
2 months ago
by github-actions[bot]
+0.4%
ci: fix lock step
43f2374
2 months ago
by besaleli
-21.92%
feat: feature gates for encoderfile-core (#126)
2daccea
2 months ago
by besaleli
+11.59%
docs: update badges
43f7516
2 months ago
by besaleli
+10.36%
docs: update badges
9970908
2 months ago
by besaleli
+0.01%
Refactor diagram phases and update labels (#127)
1e47694
2 months ago
by angpt
-0.05%
version: Version Bump 🚀 0.1.0-rc.23 → 0.1.0-rc.24 (#128)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.23 to 0.1.0-rc.24.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
1578b6f
2 months ago
by github-actions[bot]
-0.08%
version: Version Bump 🚀 0.1.0-rc.24 → 0.1.0 (#129)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0-rc.24 to 0.1.0.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
77a0788
2 months ago
by github-actions[bot]
+0.26%
ci: add release to actions
6f8c6e2
2 months ago
by besaleli
-12.4%
docs: copy readme in homepage
0157c1e
2 months ago
by besaleli
+12.55%
ci: update docs workflow
c1a755f
2 months ago
by besaleli
-0.56%
ci: update versioning script
4b588d4
2 months ago
by besaleli
-0.1%
version: Version Bump 🚀 0.1.0 → 0.1.1 (#130)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.0 to 0.1.1.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
a2e4fd4
2 months ago
by github-actions[bot]
+0.59%
docs: add pymd superfences
26d0e33
2 months ago
by besaleli
-0.7%
docs: fix links in readme (#132)
These were not pointing to anything since the building guide is in the
docs. I've linked it directly to our deployed docs.
86d20ee
2 months ago
by besaleli
+0.88%
docs: Updating index.md (#133)
2be28bb
2 months ago
by angpt
-0.58%
version: Version Bump 🚀 0.1.2-rc.1 (#143)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.2-rc.0 to 0.1.2-rc.1.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
fe27806
2 months ago
by github-actions[bot]
-0.05%
version: Version Bump 🚀 0.1.2 (#144)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.2-rc.1 to 0.1.2.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
7604809
2 months ago
by github-actions[bot]
+0.43%
feat: MCP integration tests (#131)
A single MCP integration test is provided, through the same use of the
rmcp library. A client is started, and a request is done to a local
server on localhost. Using an in-memory transport channel would be more
interesting; alternatives include a unix socket, which seems to be
supported in both
[reqwest](https://docs.rs/reqwest/latest/reqwest/trait.UnixSocketProvider.html)
and [hyper (through hyperlocal)](https://lib.rs/crates/hyperlocal).
f179b4b
2 months ago
by javiermtorres
-0.65%
docs: remove versioned docs (#149)
ef6c587
1 month ago
by besaleli
+1.75%
feat: validate transforms on compile (#151)
- Adds compile-time checks for transforms during encoderfile build stage
- DRY mean pooling code a little
Scope creep:
- remove old config docs generation
- new makefile commands
dedca60
1 month ago
by besaleli
-1.64%
feat(tensor): clamp (#157)
## Add `Tensor:clamp` with PyTorch-style semantics + Rust specialization
This PR introduces a `clamp` method for `Tensor`, matching PyTorch’s
behavior:
* `clamp(min, max)` applies both bounds
* `clamp(min, nil)` applies only the lower bound
* `clamp(nil, max)` applies only the upper bound
* `clamp(nil, nil)` returns an identity copy
* bounds may be `f32::NAN`, and NaN is treated as a valid bound
* `(Some(NaN), Some(NaN))` produces an all-NaN output, mirroring
IEEE-754 rules
### Implementation details
* Works on `ArrayD<f32>` and returns a new tensor (input remains
immutable).
* Requires arrays to be contiguous; non-contiguous inputs return an
error.
* Loop specialization is used to avoid per-element `Option` checks:
* four fast paths: `(min,max)`, `(min)`, `(max)`, `(none)`
* allows LLVM to fully optimize and auto-vectorize the clamp loop
* identity case uses `copy_from_slice` instead of a manual loop
* NaN semantics follow raw IEEE-754 float operations (`max`, `min`) with
no extra filtering.
### Tests
* Basic clamp behavior
* Lower-bound-only / upper-bound-only
* Identity case
* Degenerate case (`min == max`)
* NaN bounds (`min = NaN`, `max = NaN`)
* ND shape preservation
79542b7
1 month ago
by besaleli
-0.55%
feat: Make versions less messy (#163)
- Pins shared dep versions across workspaces
- Ensures that generated encoderfile source code only has **one**
dependency
Also, refactored entrypoint a bit to make easier
348ac97
1 month ago
by besaleli
+1.1%
feat(tensor): truncate_axis (#164)
Adds a function that truncates a Tensor along a specified axis.
Especially useful for matryoshka embeddings, where embeddings can be
truncated for... reasons.
a4bc6ae
1 month ago
by besaleli
-0.32%
feat(tensor): layer_norm op (#168)
Adds layer_norm to tensor ops (no learnable parameters)
See
https://docs.pytorch.org/docs/stable/generated/torch.nn.functional.layer_norm.html
93100d2
1 month ago
by besaleli
-0.09%
Add rusTLS support via axum-server (#154)
It has been tested manually via self signed certs and curl -k. An
automated integration test will be added shortly.
axum-server is a [separate
package](https://github.com/programatik29/axum-server) that is used in
[axum
examples](https://github.com/tokio-rs/axum/blob/main/examples/tls-rustls/src/main.rs#L17).
fd5e8f7
1 month ago
by javiermtorres
-0.11%
feat: Stronger Types (#172)
b201aa0
1 month ago
by besaleli
+0.09%
feat: Lua transformation generation (#169)
Adds a CLI utility for generating transform templates.
Usage example:
```bash
encoderfile new-transform --model-type embedding > my_transform.lua
```
Will output something like:
```lua
---Generated by Encoderfile ❤️
---Remember: Lua is 1-indexed!
---Postprocess embeddings
---Must return 3D tensor of shape [batch_size, seq_len, *]
---@input Tensor 3D tensor of shape [batch_size, seq_len, hidden_dim]
---@return Tensor
function Postprocess(arr)
---Replace with your logic here
return arr
end
```
This is our opportunity to remind people of fun Lua idiosyncracies (like
1-based indexing)
c245f24
1 month ago
by besaleli
-0.06%
version: Version Bump 🚀 0.2.0 (#174)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.1.2 to 0.2.0.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
98edabb
1 month ago
by github-actions[bot]
+0.08%
ci: fix crates version issue (#175)
6d7f356
1 month ago
by besaleli
+0.26%
fix: update Dockerfile
5da152b
1 month ago
by besaleli
0%
version: Version Bump 🚀 0.2.1 (#176)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.2.0 to 0.2.1.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
4120978
1 month ago
by github-actions[bot]
-0.13%
feat: Embedded config (#181)
This will eventually be used for things like tokenization padding
strategy overrides, etc.
Plus, fewer embedded assets!
05b9c67
1 month ago
by besaleli
-0.03%
feat: parse padding settings from tokenizer_config.json (#183)
a96e0bc
12 days ago
by besaleli
-0.17%
fix: remove old pad_token_id field
0887994
12 days ago
by besaleli
+0.23%
version: Version Bump 🚀 0.3.0-rc.0 (#186)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.2.1 to 0.3.0-rc.0.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
f2a2995
6 days ago
by github-actions[bot]
-0.12%
fix: Register Tensor as Lua UserType on Lua instantiation (#190)
5a970e4
6 days ago
by besaleli
+0.32%
fix: fmt
455811d
6 days ago
by besaleli
+0.01%
version: Version Bump 🚀 0.3.0-rc.1 (#192)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.3.0-rc.0 to 0.3.0-rc.1.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
9131766
6 days ago
by github-actions[bot]
-0.65%
version: Version Bump 🚀 0.3.0 (#193)
## 🎉 Version Bump 🎉
This PR bumps the version from 0.3.0-rc.1 to 0.3.0.
### 🔄 Changes
- 📝 Updated version in pyproject.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
41f3c51
6 days ago
by github-actions[bot]
+0.27%
feat: simplify releases (#199)
Switch from custom Python script to using `cargo-goose`
b0a3c17
4 days ago
by besaleli
+12.5%
feat(format): transition packaging from generated rust project builds to post link binary payloads (#200)
## Description
This PR introduces the encoderfile embedded binary format and packaging
pipeline. Instead of embedding model artifacts via linker sections or
include_bytes!, the runtime binary now has a self-describing payload
appended at EOF, located via a fixed-size footer and protobuf manifest.
Model artifacts (weights, tokenizer, config, transforms) are streamed
from disk using seek-based IO and loaded lazily at runtime, with a
single dynamic dispatch on model type followed by fully statically-typed
execution. This design avoids platform-specific linker behavior, keeps
builds fast, enables inspection and tooling, and cleanly separates
compilation from packaging.
### Benefits
- No more cargo-in-cargo
- Lazy loading of large assets (e.g., model weights)
### Why manually specified file format instead of appended sections?
We intentionally avoid embedding artifacts via custom linker sections
(.data, extern "C" symbols). While simpler initially, this approach is
platform-specific, eagerly loads large blobs into memory, and provides
no clear boundary for versioning or inspection. The appended encoderfile
container instead offers predictable cross-platform behavior, lazy
loading, and a stable, versioned format.
## Testing
To test, run:
```bash
cargo build --bin encoderfile --release
```
Then run:
```bash
cargo run -- build -f test_config.yml --base-binary-path target/release/encoderfile
```
To run encoderfile:
```bash
chmod +x ./my-model-2.encoderfile
./my-model-2.encoderfile infer "hello"
```
## Notes
- Tokenizer config is now located in `TokenizerService` instead of
`Config`
- Base binaries are compiled from `encoderfile-runtime`
- Base binary must be explicitly specified until
https://github.com/mozilla-ai/encoderfile/issues/204 is closed. For
testing, run `cargo build --bin encoderfile --release`, and use
`target/release/encoderfile-runtime`.
- Dockerfile now uses debian:bookworm-slim as a base image since we no
longer need Cargo toolchain.
- we're explicitly encoding everything in little-endian, BE is
theoretically possible but not a priority given our prioritized arch
targets
## Out of Scope
- Integration tests. See related issue:
https://github.com/mozilla-ai/encoderfile/issues/203
- Pulling base binaries from GH releases. See related issue:
https://github.com/mozilla-ai/encoderfile/issues/204
- Docs updates. See related issue:
https://github.com/mozilla-ai/encoderfile/issues/205
- Encoderfile image CLI refactor. See related issue:
https://github.com/mozilla-ai/encoderfile/issues/206
5166bf6
2 days ago
by besaleli
-12.82%
version: Version Bump 🚀 0.4.0-beta.1 (#211)
Version bumped from 0.3.0
to 0.4.0-beta.1.
### 🔄 Changes
- 📝 Updated version in Cargo.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
f2dfba5
2 days ago
by github-actions[bot]
+0.69%
version: Version Bump 🚀 0.4.0-beta.2 (#212)
Version bumped from 0.4.0-beta.1
to 0.4.0-beta.2.
### 🔄 Changes
- 📝 Updated version in Cargo.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>
8757a98
2 days ago
by github-actions[bot]
-0.19%
feat(build): pull base binaries from gh releases for encoderfile builds (#213)
- Add auto-pulling base binaries from gh releases
- Add utils for adding, removing, and listing base binaries in cache
- Add logging
378c5c3
2 days ago
by besaleli
+0.01%
version: Version Bump 🚀 0.4.0-beta.3 (#214)
Version bumped from 0.4.0-beta.2
to 0.4.0-beta.3.
### 🔄 Changes
- 📝 Updated version in Cargo.toml
- 🔒 Updated Cargo.lock
✨ This PR was automatically generated by the Version Management workflow
✨
Co-authored-by: besaleli <besaleli@users.noreply.github.com>