Acfoley / hf_AC /README.md
ZJUCQR
Add hf_AC audio generation demo
e2bca25

A newer version of the Gradio SDK is available: 6.1.0

Upgrade

hf_AC

Environment Setup

  • Python 3.9+
  • PyTorch 2.5.1+ and corresponding torchvision/torchaudio (pick your CUDA version https://pytorch.org/, pip install recommended)
pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118 --upgrade
git clone https://github.com/ff2416/hf_AC.git
cd hf_AC
pip install -e .

Model Installation

https://huggingface.co/FF2416/AC-Foley/blob/main/model.pth

Inference

python inf.py \
  --model_path <model path> \
  --duration 8 \
  --prompt <prompt> \
  --video_dir <videos directory or video path> \
  --audio_path <audio path> \
  --output <output path>