Metrics and logs

Overview

Monitoring Stack

Metrics collection (Prometheus/VictoriaMetrics)
Log aggregation (Loki)
Metrics server for resource metrics
Kube-state-metrics for cluster state

Key Benefits

Complete observability
Performance monitoring
Resource tracking
Centralized logging

Deployment options

VictoriaMetrics + Loki Setup

Install VictoriaMetrics

helm upgrade --install victoria-metrics victoria-metrics-single \
  --repo https://victoriametrics.github.io/helm-charts/ \
  --namespace observability \
  --create-namespace \
  --set server.scrape.enabled=true

Install Loki and Promtail

helm install loki loki \
  --repo https://grafana.github.io/helm-charts \
  --namespace observability \
  --create-namespace \
  --set loki.auth_enabled=false \
  --set loki.commonConfig.replication_factor=1 \
  --set loki.storage.type=filesystem

Install kube-state-metrics

helm install kube-state-metrics kube-state-metrics \
  --repo https://prometheus-community.github.io/helm-charts \
  --namespace observability \
  --create-namespace

Benefits

Efficient resource usage
Simple maintenance
Sufficient monitoring capabilities
Easy scalability

Requirements

Minimum Specifications

Storage for metrics retention
Storage for log retention
Network access from platform
Basic authentication

Optional Features

Long-term storage
Alerting setup
Dashboard configuration
High availability

Information collection

Required values for platform installation

Metrics endpoint URL
Logs endpoint URL
Authentication details (if enabled)

features:
  observability:
    metrics:
      enabled: true
      apiUrl: "http://victoria-metrics-victoria-metrics-single-server.observability.svc.cluster.local:8428/prometheus/api/v1"
    logs:
      enabled: true
      apiUrl: "http://loki-gateway.observability.svc.cluster.local/loki/api/v1"

Validation

Check VictoriaMetrics

curl -f "http://victoria-metrics:8428/health"

Check loki

curl -f "http://loki:3100/ready"

Verify kube-state-metrics

kubectl get --raw /metrics

Troubleshooting

Metrics Not Collecting

Verify service endpoints
Check scrape configurations
Review service monitors
Validate permissions

Log Issues

Check Loki status
Verify storage configuration
Review retention settings
Check network policies

Need help? Contact [email protected] if you encounter any issues.

Metrics and logs

On this page