About Goliath 120B
A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.
Credits to - [@chargoddard](https://huggingface.co/chargoddard) for developing the framework used to merge the model - [mergekit](https://github.com/cg123/mergekit). - [@Undi95](https://huggingface.co/Undi95) for helping with the merge ratios.
#merge
Specifications
- Provider
- Alpindale
- Context Length
- 6,144 tokens
- Input Types
- text
- Output Types
- text
- Category
- Llama2
- Added
- 11/10/2023