← Neonix Labsopen-source Rust LLM toolstack

Stacks

The open stack Neonix Labs builds on. Standard tools, a standard architecture — Neonix Labs thinks intelligence is not parameter brute force. An optimized standard architecture plus clean data, and it can start computing on your own machine.

Language & core

RustPythonWASMserderayonmemmap2anyhowtokio

Training

burncubeclCUDAbf16 mixed precisionAdamWcosine LRsafetensors

Architecture

decoder-only TransformerattentionRoPESwiGLURMSNormbyte-level BPEtokenizers

Inference

candlecandle-transformersNdArray (CPU)ONNXGGUFllama.cpportquantization

Vectors & retrieval

embeddingsvector databaseQdrantFaissLanceDBpgvectorChromacosine similarity

Decentralization & federation

NostrMatrixActivityPubAT Protocollibp2pIPFSed25519DIDsrelaysPolygon

Interop & ecosystem

PyTorchTransformersdatasetshf-hubOllamavLLMDeepSpeed

Engine & tooling

Neonix Labs StonescargojustGitHub ActionsGitHub PagesHugoMIT