Skip to main content
Set the AI preset in your Zylon configuration file using the ai.preset property. The default configuration uses a 24GB setup.

​
Base Presets

Base presets provide standard configurations optimized for general-purpose AI workloads.

​
Configuration Example

Choose the preset that matches your GPU memory capacity. Always select a preset that matches or is lower than your available VRAM.

​
Alternative Presets

Zylon provides alternative presets that offer specialized configurations by trading certain capabilities for others. These are optional and should only be used when you have specific requirements that differ from the standard presets.

​
Throughput-Optimized Alternative

This preset uses a smaller, lighter model that generates tokens significantly faster. While it may not match the standard model in quality and reasoning depth, it delivers noticeably faster responses in return. When to use:
  • You primarily handle simple or straightforward queries
  • You have a high number of concurrent users and need fast response times
  • Generation speed matters more than peak response quality

​
Large Model Alternative

This preset uses a larger, more capable model with greater intrinsic knowledge. The trade-off is a reduced context window. When to use:
  • You need stronger performance on complex or specialized tasks
  • The model’s intrinsic knowledge is a priority
  • You can work with a smaller context window

​
Configuration Example

Each alternative preset involves a trade-off. Consider your specific use case — user volume, query complexity, and context needs — before switching from the standard preset.

​
Experimental Presets

Experimental presets are under active development and may not be stable. Use only in testing environments.
Experimental presets provide access to cutting-edge models and configurations that are being evaluated for future releases. These presets may have different performance characteristics or stability compared to baseline presets. Configuration Example:

​
Important Notes About Experimental Presets

  • Experimental presets may be removed or significantly changed between versions
  • Performance and stability are not guaranteed
  • Not recommended for production environments
  • May require additional configuration parameters
  • Support may be limited

​
Deprecated Presets

Deprecated presets are maintained for backward compatibility only and will not receive updates.
For customers that require older configurations, deprecated presets are available but not recommended for new installations.

​
Migration from Deprecated Presets

If you’re using a deprecated preset, we strongly recommend migrating to current baseline or alternative presets:
  1. Review the base presets to find an equivalent configuration
  2. Test the new preset in a staging environment
  3. Update your production configuration
  4. Monitor performance and adjust if needed
Migration provides access to improved models, better performance, and ongoing support.