Conversation
…ator and streamline debug handling
…rity and parameter naming
…auto-download functionality
…e-tuned and stock modes
- Deleted `graph_utils.py`, which contained functions for adjacency matrix creation and normalization. - Removed `lifter3d.py`, which included keypoint processing, 3D triangulation, and visualization functions. - Eliminated `mocap_dataset.py`, which defined the `MocapDataset` class for handling motion capture data.
… root path accordingly
…uperAnimalEstimator
…uperAnimalEstimator
… and reuse across images, improving efficiency and clarity.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds first-class support for the fine-tuned SuperAnimal-Quadruped 2D pose model used by the animal pipeline, enabling direct 26-joint Animal3D keypoint prediction and automatic checkpoint download from Hugging Face. It also improves the out-of-the-box demo/install path, fixes CPU fallback for the human HRNet demo, and removes unused legacy code/assets.
Changes
sa_finetune_hrnet_w32.ptfor 2D animal posefmpose3d_animals.pthfor the 3D lifteranimals/demo/vis_animals.pyto build the 2D estimator and 3D lifter once, then reuse them across images.SuperAnimalConfigoptions for fine-tuned checkpoints, detector overrides, and lazy Hugging Face resolution.map_locationand moving inputs to the model device.torch>=2.4.1,<2.5andtorchvision>=0.19.1,<0.20, and document the PyTorch/CUDA behavior in the README.>=3.10,<3.13; README recommends Python 3.10 because install/demo paths were tested there.motto the codespell ignore list.Validation
Ran install, test, and demo checks locally:
python3 -m pip install -e '.[animals,viz]' --dry-run python3 -m pytest tests/test_demo_human.py tests/fmpose3d_api/test_fmpose3d.py -q python3 -m pytest tests/test_model.py tests/test_training_pipeline.py -q bash demo/vis_in_the_wild.sh bash animals/demo/vis_animals.shResults
78 passedfor human demo/API tests,8 passedfor model/training smoke tests.