Observability Splunk Senior Engineer

The Eye Candy Solutions is seeking a highly experienced Observability Engineer to lead the evolution, implementation and continuous improvement of observability practices for a major international client. This position is critical to ensuring high availability, performance and traceability across complex distributed systems, with a particular focus on Splunk, cloud infrastructure, and Python-based automation.

This is a strategic technical role requiring a deep understanding of infrastructure monitoring, cloud platforms (AWS/Azure), and data observability at scale.

The selected candidate will act as a central technical enabler for engineering, infrastructure and operations teams, supporting the delivery of resilient, scalable observability capabilities across the enterprise.

They will lead the development and maintenance of observability platforms, with a focus on Splunk (including ITSI) and integrations across hybrid infrastructure environments.

Core responsibilities include:

• Driving the design and optimisation of dashboards, alerts, and visualisations that serve both technical teams and business stakeholders.
• Ensuring data quality, integrity and continuity across telemetry pipelines and monitoring layers.
• Executing advanced Splunk administrative tasks, including data onboarding, indexing strategies, and performance optimisation.
• Championing observability-by-design, collaborating closely with development, infrastructure and DevOps teams to embed monitoring into CI/CD workflows and system architectures.
• Enabling platform reliability and operational excellence through automation, infrastructure-as-code, and effective use of cloud-native services (Azure and/or AWS).
• Defining and maintaining monitoring standards, SLOs/SLIs, and incident response models aligned with business and technical objectives.
• Acting as a technical mentor and coach, supporting capability uplift across product and engineering teams.

​⚠️ Only candidates currently residing in Spain or Portugal will be considered. Applications from other locations will not be processed. ⚠️

✒️ Requirements:

• 5+ years of hands-on experience managing Splunk platforms, including both administrative and architectural responsibilities.
• Proven track record working with cloud infrastructure—specifically AWS and/or Azure—in production-grade environments.
• Advanced proficiency in Python, with strong skills in automation, API integration, and custom scripting.
• Working knowledge of JavaScript, particularly for dashboard creation and visual layer enhancements.
  Solid understanding of modern infrastructure components, such as containers, orchestration tools (e.g. Kubernetes), and CI/CD pipelines.
• Strong communication skills with the ability to interact effectively across technical and business domains.
• Structured, self-driven, and capable of independently managing initiatives with minimal supervision.

Required Splunk certifications: Splunk Core Certified Power User or Advanced Power User
Splunk (Cloud) Admin
 
🔧 Preferred Qualifications:

• Exposure to Java (optional, but advantageous for integration scenarios).
• Familiarity with DevOps/SRE practices, observability standards, and operational excellence frameworks.
• Experience with complementary observability tools, such as Prometheus, Grafana, Datadog, or the ELK stack.
• Understanding of monitoring-as-code approaches and integration within CI/CD pipelines.
• Knowledge of data security, compliance, and telemetry governance in cloud-native environments.
• Experience with Terraform, Bash, or Azure CLI for automation and environment provisioning is a plus.

🎓 Bachelor’s in Computer Science, Information Technology, Engineering or equivalent professional experience.
🌐 English mandatory.
📍 Location: Spain.
💻 Work: Remote (Occasional international travel may be required).

Benefits