
Senior Data Engineer
- Porto
- Permanente
- Horário completo
- Build, administer, and scale data processing pipelines
- Improve scalability, stability, accuracy, speed, and efficiency of our existing data systems
- Support data scientists to make prototypes production-ready
- Design and implement robust data workflows using Databricks, with strong Spark and SQL skills for transformation, optimization, and analytics
- Ensure ways to enhance data quality and reliability
- Bachelors, Masters, or Ph.D. in Computer Science, Engineering, or a related field 5+ years of experience in data engineering or backend software development, with a track record of delivering production-grade systems.
- Experience with Spark is a must
- Hands-on experience with Databricks and strong proficiency in SQL for data transformation, performance tuning, and analytics
- Experience working with relational databases, particularly PostgreSQL
- Experience with cloud platforms, preferably Azure.
- Strong coding skills in Python and/or Scala
- A good understanding of the best practices for developing software (version control, CI/CD, automation, pair programming, documentation, testing, )
- Deep knowledge of distributed data processing frameworks, especially Apache Spark Solid understanding of CI/CD pipelines, containerization (Docker), and orchestration tools (Kubernetes)
- Knowledge of the microservice architecture, Docker, Kubernetes is a plus
- Excellent problem-solving, analytical skills, communication, and leadership skills
- Spark (Scala, Python)
- SQL (Postgres, DuckDB)
- Databricks, Docker, Kubernetes, Azure
- Cassandra
- Competitive salaries and comprehensive benefits 22 days of paid time off, plus major national holidays in Portugal
- Enjoy 20 days of "Work From Anywhere" flexibility each year Respectful, innovative, and diverse team