Petal is a decentralized platform that loads small parts of a large language model like Bloom-176b for single-batch inference and fine-tuning, with flexible PyTorch API.
No comments...
Petal is a decentralized platform that loads small parts of a large language model like Bloom-176b for single-batch inference and fine-tuning, with flexible PyTorch API.
Collection time:
2024-09-01
