bitsandbytes
accelerate
torch 
transformers
huggingface_hub
bitsandbytes
peft
fastapi
uvicorn
pydantic
typing