Skip to content

Latest commit

Β 

History

23 Commits

Folders and files

NameName
Last commit message
Last commit date
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

3D Spritesheet Studio

Convert 3D models and real-time webcam face captures into customizable 2D spritesheets, texture atlases, PNG sequences, and animated GIFs with MediaPipe 3D face mesh tracking, background removal, and live interactive cursor look-at simulation.

3D Spritesheet Studio React Three.js MediaPipe Tailwind CSS


Screenshot 2026-08-07 at 03-34-28 3D Spritesheet Studio

🌟 Key Features

🧊 3D Model Studio & Interactive Viewport

  • Procedural Sample Models: Includes ready-to-use 3D sample assets (G-Man Head, Cyber Robot Head, Sci-Fi Helmet, Cute Alien Creature, Crystal Gem).
  • Custom 3D File Upload: Supports importing 3D model formats including .glb, .gltf, .obj, .stl, and .ply.
  • Real-Time Orbit Control: Smooth rotation, panning, and zoom controls powered by @react-three/fiber and @react-three/drei.
  • PBR & Environment Reflection: Real-time HDR environment reflections (city, apartment, dawn, night, studio, park) with material overrides (Claymation, Chrome Metal, Stylized Toon, Wireframe, or Default).

πŸ“· Webcam Face Studio & MediaPipe Tracking

  • 468 3D Landmark FaceMesh Tracking: Real-time facial pitch, yaw, and roll orientation estimation powered by MediaPipe FaceMesh.
  • Pose-Guided Capture HUD: Visual grid overlay with Amber Ghost Silhouette guide indicating exact head tilt angles (UP/DOWN/LEFT/RIGHT).
  • In-Browser Background Removal: Real-time background removal powered by MediaPipe SelfieSegmentation and smart alpha feathering.
  • Manual & Automatic Snap: [SPACEBAR] tap-to-snap capture workflow with shutter sound effects and automated target pose progression.

πŸ“ Spritesheet & Atlas Baking Engine

  • Flexible Grid Arrangements: Render as 2D Matrix Atlases, Horizontal Rows, or Vertical Columns.
  • Custom Frame Resolutions: Choose cell sizes from 64x64px, 128x128px, 256x256px, up to 512x512px.
  • Multi-Axis Capture Mode: Simultaneously capture Pitch (X-axis look up/down) and Yaw (Y-axis look left/right) for dynamic 2D cursor look-at avatars.
  • Single-Axis 360Β° Spin Mode: Clean rotational captures around X, Y, or Z axes over custom angle spans.

🎯 Live Cursor Look-At Simulator & Code Exporter

  • Interactive Test Canvas: Test mouse-cursor tracking live on generated 2D spritesheets before exporting.
  • Tuning Controls: Adjustable tracking radius, sensitivity multiplier, and axis inversion toggles (Invert X/Y).
  • Developer Code Embed Generator: Generates copy-paste code snippets for both React (JSX) and Vanilla HTML/JavaScript.

πŸ“¦ Export & Package Options

  • PNG Texture Atlas: Single consolidated high-resolution PNG spritesheet.
  • Animated GIF: Export smooth loopable GIFs generated via gifshot.
  • ZIP Frame Pack: Uncompressed archive of individual frame PNG files powered by jszip.
  • JSON Metadata: Standard texture atlas JSON format containing frame coordinates and rotation angles.

πŸš€ Getting Started

Prerequisites

  • Node.js: v18.x or higher
  • npm or bun

Installation

  1. Clone the repository:
git clone https://github.com/your-username/3d-spritesheet-studio.git
cd 3d-spritesheet-studio
  1. Install dependencies:
npm install
  1. Start the development server:
npm run dev
  1. Open http://localhost:3000 in your browser.

πŸ› οΈ Tech Stack


πŸ“œ License

Distributed under the GPL-3.0-only License. See LICENSE for more information.

About

Convert 3D models and real-time webcam face captures into customizable 2D spritesheets, texture atlases, PNG sequences, and animated GIFs with MediaPipe 3D face mesh tracking, background removal, and live interactive cursor look-at simulation.

Topics

Resources

Stars

2 stars

Watchers

0 watching

Forks

Releases

Sponsor this project

Packages

Contributors

Languages