Location: Costa Rica – Remote
Contractor: Avantti Tecnologia
Level: Senior
Language: Advanced English (required)
Avantti Tecnologia is seeking a Senior Data Engineer to join strategic, high-complexity projects involving modern data architectures, large-scale data processing, and cloud environments. We are looking for a highly skilled professional with strong technical expertise, architectural vision, and solid experience building scalable platforms and pipelines.
Requirements
Technical Requirements
Advanced English for reading, communication, and participation in international meetings.
Cloud: Experience developing data systems in AWS, GCP, or Azure.
Data Architecture: Practical experience building data lakes, lakehouses, and data hubs.
Ingestion: Experience with Kafka, AWS Glue, and formats such as Iceberg and Parquet.
Streaming: Experience with Kafka, Flink, or similar tools.
Modeling & Orchestration: Strong skills in SQL, dbt, Airflow, Glue, including SCDs and schema evolution.
Spark: Proficiency in transformations, streaming, performance tuning, and Spark UI debugging.
Programming: Advanced Python, Java, and/or Scala; strong SQL skills.
DevOps: Experience with CI/CD, code repositories, and deployment best practices.
Governance: Knowledge of data quality, privacy, and security frameworks.
Responsibilities
Design and evolve modern data architectures (data lakes, lakehouses, data hubs).
Build and maintain large-scale ingestion and processing pipelines, including streaming solutions.
Work on critical initiatives involving data modeling, transformation, and governance.
Implement cloud solutions using native AWS, GCP, or Azure services.
Ensure data quality, security, traceability, and reliability throughout the data lifecycle.
Contribute to DevOps practices, including automated testing, versioning, and CI/CD workflows.
Perform advanced troubleshooting and optimization of Spark pipelines and jobs.
Collaborate with architects, engineers, and business teams to deliver scalable and efficient solutions.
Participate in global technical meetings and discussions in English.