YOLOv8m detection model for handheld workshop tools, trained on synthetic rendered data and fine-tuned on real annotated images.
Intended to give a UR5 robot arm (5 kg payload, ~850 mm reach) tool identity and bounding-box location for pick-and-place tasks.
1from ultralytics import YOLO
2from huggingface_hub import hf_hub_download
3
4weights = hf_hub_download(repo_id="x-not/tool-detector", filename="best.pt")
5model = YOLO(weights)
6
7results = model("your_image.jpg", conf=0.3)
8results[0].show()
1huggingface-cli download x-not/tool-detector best.pt --local-dir models/
2yolo detect predict model=models/best.pt source=your_image.jpg conf=0.3
Synthetic data generated with BlenderProc (Blender + Cycles): tools rendered as RGBA sprites at randomized pose/lighting, composited onto workshop background photos.
Fine-tuned on real images annotated in Label Studio.
Source code and full training pipeline:
github.com/NikolaasBender/Tool-Detector