Interface ModelMetrics

Hierarchy

  • ModelMetrics

Properties

latencyMs?: number
loadTime?: number
memoryUsageMb?: number
tokensPerSecond?: number

Generated using TypeDoc