merlin package¶

Subpackages¶

Submodules¶

merlin.autoscaling module¶

class merlin.autoscaling.AutoscalingPolicy(metrics_type: MetricsType, target_value: float)[source]¶

Bases: object

Autoscaling policy to be used for a deployment.

property metrics_type: MetricsType¶: Metrics type to be used for the autoscaling :return: MetricsType

property target_value: float¶: Target metrics value when autoscaling should be performed :return: target value

class merlin.autoscaling.MetricsType(value)[source]¶

Bases: Enum

Metrics type to be used for AutoscalingPolicy.

CONCURRENCY: number of concurrent request handled. CPU_UTILIZATION: percentage of CPU utilization. MEMORY_UTILIZATION: percentage of Memory utilization. RPS: throughput in request per second.

CONCURRENCY = 'concurrency'¶

CPU_UTILIZATION = 'cpu_utilization'¶

MEMORY_UTILIZATION = 'memory_utilization'¶

RPS = 'rps'¶

merlin package¶

Subpackages¶

Submodules¶

merlin.autoscaling module¶

merlin.client module¶

merlin.deployment_mode module¶

merlin.endpoint module¶

merlin.environment module¶

merlin.fluent module¶

merlin.logger module¶

merlin.merlin module¶

merlin.model module¶

merlin.protocol module¶

merlin.pyfunc module¶

merlin.resource_request module¶

merlin.transformer module¶

merlin.util module¶

merlin.validation module¶

merlin.version module¶