LLM CONFIGURATION

Related Concept

• Sampling Parameters
  • Temperature
  • Top-K
  • Top-P
• Output Control
  • Max Tokens
  • Stop Sequences
• Repetition Penalties
  • Frequency Penalty
  • Presence Penalty
• Structured Outputs