This is a Qualcomm QNN (Qualcomm Neural Network) conversion of apple/Sharp for on-device inference on Android devices with Snapdragon processors. The models run on the Hexagon Tensor Processor (HTP) DSP via the QNN SDK, enabling fully offline, single-image 3D Gaussian Splatting reconstruction directly on a smartphone.
Models are available in multiple precision variants under dlc/:
This software project accompanies the research paper: Sharp Monocular View Synthesis in Less Than a Second
by Lars Mescheder, Wei Dong, Shiwei Li, Xuyang Bai, Marcel Santos, Peiyun Hu, Bruno Lecouat, Mingmin Zhen, Amaël Delaunoy,
Tian Fang, Yanghai Tsin, Stephan Richter and Vladlen Koltun.
We present SHARP, an approach to photorealistic view synthesis from a single image. Given a single photograph, SHARP regresses the parameters of a 3D Gaussian representation of the depicted scene. This is done in less than a second on a standard GPU via a single feedforward pass through a neural network. The 3D Gaussian representation produced by SHARP can then be rendered in real time, yielding high-resolution photorealistic images for nearby views. The representation is metric, with absolute scale, supporting metric camera movements. Experimental results demonstrate that SHARP delivers robust zero-shot generalization across datasets. It sets a new state of the art on multiple datasets, reducing LPIPS by 25–34% and DISTS by 21–43% versus the best prior model, while lowering the synthesis time by three orders of magnitude.
Getting started
Please, follow the steps in the code repository to set up your environment. Then you can download the checkpoint from the Files and versions tab above, or use the huggingface-hub CLI:
The results will be 3D gaussian splats (3DGS) in the output folder. The 3DGS .ply files are compatible to various public 3DGS renderers. We follow the OpenCV coordinate convention (x right, y down, z forward). The 3DGS scene center is roughly at (0, 0, +z). When dealing with 3rdparty renderers, please scale and rotate to re-center the scene accordingly.
Rendering trajectories (CUDA GPU only)
Additionally you can render videos with a camera trajectory. While the gaussians prediction works for all CPU, CUDA, and MPS, rendering videos via the --render option currently requires a CUDA GPU. The gsplat renderer takes a while to initialize at the first launch.
sharp predict -i /path/to/input/images -o /path/to/output/gaussians --render -c sharp_2572gikvuh.pt
# Or from the intermediate gaussians:
sharp render -i /path/to/output/gaussians -o /path/to/output/renderings -c sharp_2572gikvuh.pt
Evaluation
Please refer to the paper for both quantitative and qualitative evaluations.
Additionally, please check out this qualitative examples page containing several video comparisons against related work.
Citation
If you find our work useful, please cite the following paper:
bibtex
1@inproceedings{Sharp2025:arxiv,
2 title = {Sharp Monocular View Synthesis in Less Than a Second},
3 author = {Lars Mescheder and Wei Dong and Shiwei Li and Xuyang Bai and Marcel Santos and Peiyun Hu and Bruno Lecouat and Mingmin Zhen and Ama\"{e}l Delaunoy and Tian Fang and Yanghai Tsin and Stephan R. Richter and Vladlen Koltun},
4 journal = {arXiv preprint arXiv:2512.10685},
5 year = {2025},
6 url = {https://arxiv.org/abs/2512.10685},
7}
Acknowledgements
Our codebase is built using multiple opensource contributions, please see ACKNOWLEDGEMENTS for more details.
The app will auto-detect and import them on the Models screen
On first use, each DLC will be compiled to a device-specific HTP Context Binary (.bin); subsequent runs use the compiled binary directly
Alternatively, you can import the models through the app's UI by selecting each .dlc file.
Hardware Requirements
Snapdragon 8 Gen 2 or newer (HTP V73+)
Android 12+
Supported SoCs: Snapdragon 8 Gen 2, 8 Gen 3, 8 Elite, and newer models
Tested on HTP V79 (Snapdragon 8 Elite)
~8 GB RAM recommended (the pipeline peaks at ~2 GB during REST inference)
The app uses QNN SDK libraries bundled in the APK; no additional setup is required
Conversion Notes
The original PyTorch checkpoint (sharp_2572gikvuh.pt) was converted to ONNX, then to QNN DLC (.dlc) using QNN SDK 2.48.0.260626.
DLC files are cross-architecture — the app compiles them to device-specific HTP Context Binary (.bin) on first run.
The app supports both importing pre-compiled .bin files and compiling .dlc files on-device; this repository provides the DLC format for maximum portability.
Quantization: Multiple precision variants available. Quantization parameters (scale/offset) are embedded in the DLC and auto-detected at runtime.
The non-neural-network parts of the pipeline (image preprocessing, patch splitting, feature merging, unprojection, PLY export) were ported from the original Python code to C++ and run on the CPU.
All 5 models must be from the same precision variant; mixing different precision models will produce incorrect results.
