safe-rlhf

Here are 4 public repositories matching this topic...

PKU-Alignment / safe-rlhf

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

Updated Nov 24, 2025
Python

PKU-Alignment / beavertails

BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).

safety llama gpt datasets language-model beaver ai-safety human-feedback-data llm llms human-feedback rlhf large-language-model safe-rlhf

Updated Oct 27, 2023
Makefile

PKU-Alignment / llms-resist-alignment

Star

[ACL2025 Best Paper] Language Models Resist Alignment

alignment llama safe alpaca ai-safety vicuna llm llms rlhf safe-rlhf llama2 llama3

Updated Jun 11, 2025
Python

Dylsimple60 / RLHF_learn

Star

🤖 Enhance reinforcement learning stability and efficiency with advanced algorithms like TRPO, PPO, DPO, GRPO, DAPO, and GSPO for optimized policy training.

Updated Sep 13, 2026
Python

Add this topic to your repo

To associate your repository with the safe-rlhf topic, visit your repo's landing page and select "manage topics."

Learn more