Efficient Intelligence
Achieving strong capabilities with smaller, more efficient models — more intelligence per parameter and per FLOP.
The research and innovation initiative of Abhilash Construction Company — studying efficient, accessible, and intelligent AI systems.
We are studying how much capability can be achieved with small, efficient models under strict parameter and compute constraints — and how to run useful AI on local and edge hardware. This is early-stage research; we report only what we have actually measured.
Directions we are actively studying. Early-stage work is labelled Experimental.
Achieving strong capabilities with smaller, more efficient models — more intelligence per parameter and per FLOP.
Highly parameter-efficient language models. A long-term interest is exploring models around the ~10M-parameter range to understand how much intelligence is possible at very small sizes.
Models designed to run efficiently on local and edge hardware, without cloud dependence.
Parameter-efficient fine-tuning (LoRA, QLoRA), quantization, distillation, and efficient architectures for cheaper training.
Early exploration of Indian languages, local deployment, and AI systems optimized for Indian use cases.
Early-stage research programs. We report only results we have actually measured.
Saffron-v1 — our own efficient ~100M model with a custom byte-level tokenizer and curriculum data: an English foundation built toward Indian-language coverage. A first Preliminary checkpoint is trained and published, plus an Experimental instruction-tuned chat variant.
Compact, efficient SLMs designed to run on edge devices with limited compute and power — bringing capable AI directly on-device.
Systematic head-to-head evaluation of different LLM architectures on our in-house benchmarks to learn what truly works — and why.
Fix the best architecture, train it on different datasets of equal token budget, and cross-evaluate to see which data trains the most capable model.
Building rigorous, reproducible benchmarks to measure LLM capability, safety, and efficiency — the yardsticks the field needs.
Original synthetic instruction datasets we built — programmatically generated with verifiable answers (question → reasoning → answer). Not a benchmark; no third-party LLM used.
~5,000 arithmetic, algebra, word-problem, and geometry questions, each with a step-by-step worked solution and a computed, verifiable answer.
~5,000 logic and verbal-reasoning problems — syllogisms, sequences, analogies, coding-decoding — with worked reasoning and answers correct by construction.
~5,000 grammar, vocabulary, and usage exercises — articles, plurals, tenses, agreement, comparatives — from authored rule tables with explained answers.
Our open code is live on GitHub — the Architecture Comparison and Dataset Comparison harnesses (shared pure-PyTorch models). More code and models will follow as projects mature; we don't publish results until they're measured.
We're open to research collaboration, compute sponsorship, and technical discussion.