Skip to content

QuantumDrizzy/KINECT-NIR

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation


2. KINECT-NIR (Actualizado)

# KINECT-NIR

**Real-time infrared overhead object detection and tracking pipeline.**

CUDA-accelerated CA-CFAR detection with spatiotemporal deep learning and multi-sensor fusion.

### Key Results
- Real-time processing at **30 Hz** with Kalman tracking and TLE catalog cross-matching
- MobileViT-XT model exported to **TensorRT INT8**
- 5-class classification using KineticMCO v6.0 (catalogued, uncatalogued, aircraft, debris, anomalous)
- Full hardware bridge to Arduino Mega for servo slew-to-cue on anomalous detections

### What it does
KINECT-NIR is an end-to-end pipeline for real-time detection, tracking, and classification of objects in overhead infrared imagery. It combines classical signal processing (CA-CFAR) with a lightweight spatiotemporal neural network and classical tracking, while maintaining compatibility with real-time hardware deployment.

### Stack
- **Languages**: C++17, CUDA, Python
- **Key Technologies**: OpenCV, PyTorch, ONNX, TensorRT, FastAPI, Skyfield, Arduino
- **Target**: Real-time IR object detection and tracking

### Architecture
- CUDA CA-CFAR kernel for blob detection
- MobileViT-XT with factorized spatiotemporal attention (exported to TensorRT INT8)
- Kalman filter with Mahalanobis gating
- TLE catalog cross-match via Celestrak
- KineticMCO v6.0 classifier (5 classes)
- FastAPI + WebSocket dashboard at 30 Hz
- Arduino hardware bridge for servo control

### Build
```bash
# Windows
build.bat

# Linux / WSL2
make

---

Training & Export
Bashpython dataset_generator.py
python train.py
python export.py
TensorRT engine generation:
Bashtrtexec --onnx=NIGHTWATCH_MOBILEVIT_XT.onnx --int8 --saveEngine=NIGHTWATCH_MOBILEVIT_XT.engine
Run Dashboard
Bashpython nightwatch_dashboard.py

About

Real-time IR object detection pipeline with CUDA CA-CFAR, TensorRT INT8 and Kalman tracking.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors