Legion-V2.1-LLaMa-70B

Maintained By
Tarek07

Legion-V2.1-LLaMa-70B

PropertyValue
Base ArchitectureLLaMA 70B
Merge MethodDARE TIES
Model URLHugging Face
Recommended SettingsTemperature: 1.0, Min P: 0.02

What is Legion-V2.1-LLaMa-70B?

Legion-V2.1-LLaMa-70B is an ambitious merge of 20 carefully selected language models, created by Tarek07. The model represents a sophisticated approach to combining different specialized capabilities into a single, powerful language model. The architecture is built upon five distinct specialized models, each focusing on specific aspects: uncensored base functionality, high intelligence (based on UGI benchmarks), descriptive writing, roleplay capabilities, and unrestricted generation.

Implementation Details

The model utilizes the DARE TIES merge methodology with TareksLab/L-BASE-V1 as its foundation. The implementation features equal weight distribution (0.20) across all component models with a consistent density of 0.5. The model employs the llama3 chat template and uses bfloat16 as its output data type.

  • Merged using mergekit with specialized weight configurations
  • Incorporates 20 different pre-trained models including specialized variants
  • Utilizes normalized weight distribution across components
  • Implements advanced merge techniques for optimal performance

Core Capabilities

  • Uncensored text generation with sophisticated control
  • Enhanced creative writing and natural prose generation
  • Specialized roleplay capabilities from multiple RP-focused models
  • High intelligence scores based on UGI benchmarks
  • Versatile text generation across multiple domains

Frequently Asked Questions

Q: What makes this model unique?

Legion-V2.1 stands out due to its comprehensive merge of 20 specially curated models, each contributing specific capabilities. The model's architecture ensures a balance between intelligence, creativity, and unrestricted generation, while maintaining high-quality output across various use cases.

Q: What are the recommended use cases?

The model excels in creative writing, roleplay scenarios, and general text generation tasks. It's particularly suited for applications requiring both intelligence and creativity, with the ability to generate uncensored content when appropriate.

🍰 Interesting in building your own agents?
PromptLayer provides Huggingface integration tools to manage and monitor prompts with your whole team. Get started here.