Elasticsearch

Centralized Logging and Observability

I have proven experience architecting and managing the ELK stack to build robust, centralized logging platforms. At Carousell Group, I led the design and implementation of a new logging system from the ground up, providing engineers with unified, queryable access to log data from all services and infrastructure.

This project involved deploying the complete ELK stack (Elasticsearch, Logstash, Kibana), configuring data ingestion pipelines, and creating intuitive Kibana dashboards to provide critical visibility into system health and application behavior.

Modernization and Migration

As part of a broader modernization effort, I successfully migrated the entire Elasticsearch cluster from a legacy VM-based deployment to a more resilient and scalable architecture running on a Kubernetes cluster. This strategic migration improved system availability and manageability while optimizing operational costs.

Key Competencies

• ELK Stack Administration: Deploying, configuring, and managing the full Elasticsearch, Logstash, and Kibana stack.
• Kubernetes Deployment: Managing and scaling Elasticsearch clusters within Kubernetes environments.
• Log Ingestion: Configuring agents like Fluentd or Filebeat to collect and forward logs from diverse sources.
• Data Visualization: Building insightful dashboards in Kibana for log analysis and system monitoring.
• Performance & Scalability: Understanding of Elasticsearch cluster management, including scaling, tuning, and optimization.