The Role

My client are seeking a talented Data Engineer to join their growing team. You will play a key role in designing, building, and maintaining our data pipelines and infrastructure. This role requires a strong understanding of PostgreSQL databases and experience working with cloud platforms.

Responsibilities

Design, develop, and implement data pipelines for ingesting, transforming, and loading data from various sources into our data warehouse.

Optimize PostgreSQL databases for performance and scalability.

Develop and maintain SQL queries for data extraction, transformation, and analysis.

Work with cloud platforms (AWS preferred) to provision and manage data storage, compute resources, and containerized applications.

Write code in scripting languages (e.g., Python, Bash) to automate data engineering tasks.

Collaborate with data analysts, data scientists, and software engineers to ensure data quality and accessibility.

Document data pipelines, schemas, and procedures.

Stay up-to-date on the latest data engineering and cloud technologies.

Qualifications

Strong expertise in PostgreSQL, including database design, administration, performance tuning, and security.

Proficiency in SQL for data extraction, transformation, and analysis.

Experience with cloud platforms (AWS preferred) for data storage, compute resources, and services (e.g., S3, DynamoDB, Redshift, Aurora, Athena).

Experience with scripting languages (e.g., Python, Bash).

Excellent problem-solving and analytical skills.

Strong communication and collaboration skills.

Ability to work independently and as part of a team.

Ability to manage complex projects and interact effectively with other teams.

Bonus Points

Interest in working on providing solutions to environmental sustainability.

Experience with database change management systems like Liquibase, Flyway etc

Experience with big data technologies (e.g., Hadoop, Spark, Kafka).

Experience with data warehousing concepts (e.g., dimensional modelling, slowly changing dimensions etc).

Certifications in cloud platforms or data engineering tools (e.g., AWS Certified Data Engineer).