Views
No views yet
25M2111.| Item | Value |
|---|---|
| Base model | Qwen/Qwen3.5-4B |
| Compressed artifact | r13_short_b_m3l4a8e8_body_token_zlib.ptz |
| Exact size | 1,626,481,790 bytes |
| SHA256 | 2b63ba3af765f54baf78536c0b46b4a8ccf9f6ac2b294001b7653e9069410091 |
| Recorded checkpoint accuracy | 0.879 on 560 problems |
| GitHub | https://github.com/safffrron/CS6013/tree/main/25M2111/Week01/Track1_20/Submission01 |
| Hugging Face | https://huggingface.co/safffrron/25M2111-Week01-Track1-20-Submission01 |
Submission01 directory. The compressed artifact is restored first; do not
pass the .ptz file directly to Transformers or vLLM.1git clone https://github.com/safffrron/CS6013.git
2cd CS6013/25M2111/Week01/Track1_20/Submission01
3python -m venv .venv
4source .venv/bin/activate
5python --version
6python -m pip install -e '.[eval]'1mkdir -p hf_checkpoint
2hf download safffrron/25M2111-Week01-Track1-20-Submission01 \
3 r13_short_b_m3l4a8e8_body_token_zlib.ptz \
4 r13_short_b_m3l4a8e8_body_token_zlib.ptz.json \
5 r13_short_b_m3l4a8e8_body_token_zlib.ptz.keep_ids.json \
6 --local-dir hf_checkpoint
7sha256sum hf_checkpoint/r13_short_b_m3l4a8e8_body_token_zlib.ptz1python dequantize_to_bf16.py \
2 Qwen/Qwen3.5-4B \
3 hf_checkpoint/r13_short_b_m3l4a8e8_body_token_zlib.ptz \
4 restored_hfrestored_hf/submission_report.json records the
restoration details.1python inference/smoke.py restored_hf
2./evaluation/run_public_eval.sh \
3 restored_hf \
4 0 \
5 hf_checkpoint/r13_short_b_m3l4a8e8_body_token_zlib.ptz.keep_ids.json0 is the physical GPU id. Multiple GPUs may be supplied as 0,1. The
evaluation script clears any inherited CUDA mask, runs the checkpoint suite
with max_new_tokens=65536 and repetition penalty 1.20, then merges shards.
The keep_ids file is required because this submission evaluates logits over
the 30,000 retained original output-token ids.code.py provides both required functions:convert_from_hf_checkpoint(model_name, output_path, sparsity)convert_to_hf_checkpoint(model_name, checkpoint_path, output_path)sparsity argument is accepted only for compatibility with the supplied
course evaluator and is ignored by this compression method.convert_from_hf_checkpoint.py and
dequantize_to_bf16.py. Evaluating the uploaded artifact requires only the
dequantization wrapper. Rebuilding the artifact from the base model is the
longer optional process below.1python -m pip install -e '.[compress,eval]'
2./training/reproduce_source.sh data/traces.jsonl 0 work/short2500
3./compression/reproduce_gptq.sh \
4 work/short2500 data/traces.jsonl 0 work/b20
5export EAIMATH_B20_GPTQ_SOURCE="$PWD/work/b20/gptq_m3l4a8e8"
6export EAIMATH_VOCAB_CORPUS="$PWD/data/traces.jsonl"
7export EAIMATH_PREDICTOR_DEVICE=cuda:0
8python convert_from_hf_checkpoint.py \
9 Qwen/Qwen3.5-4B reproduced.ptzreproduced.ptz.json and
reproduced.ptz.keep_ids.json.configs/ and
results/ in this GitHub submission.