You can deploy this model and start earning money today!

Anticloud/
camus-17-configurable-inference

Views

No views yet

We externalize 10 inference parameters to a JSON config file — hot-reloadable settings for diverse hardware.

Configurable Inference Settings via File-Based Configuration

The Problem

Hard-coded inference parameters make the system inflexible. Different hardware and tasks need different settings.

What We Built

JSON-based configuration file (camus.json) storing all user-settable parameters: n_ctx, n_threads, temperature, top_p, max_tokens, show_bars… See the full description on the dataset page: https://huggingface.co/datasets/Anticloud/camus-17-configurable-inference.