Data DevOps Engineer

<h2><strong>The Wow</strong></h2> <p>This role will design and implement the automation of our data platform. The focus will be on enabling and optimizing the data lifecycle by applying DevOps practices, such as <em>Infrastructure as Code (IaC)</em>, <em>CI/CD</em>, and <em>GitOps</em>, to ensure the efficiency, reliability, and speed of our data deliveries.</p> <p> </p> <h2><strong>A taster of what you will be involved with: </strong></h2> <ul> <li>Develop and maintain the data platform's infrastructure using <strong>Terraform</strong>.</li> <li>Implement and manage CI/CD pipelines for the automation of data and ai processes and pipelines.</li> <li>Automate the provisioning, configuration, and monitoring of resources in <strong>AWS</strong>.</li> <li>Apply <strong>GitOps</strong>principles to manage configurations and deployments.</li> <li>Ensure the security, scalability, and resilience of the infrastructure through automation.</li> <li>Collaborate with Data Engineers to optimize the data development lifecycle (DDLC).</li> <li>Own the automation and infrastructure of orchestration tools like <strong>Airflow</strong>.</li> <li>Document the automation architecture and deployment processes.</li> </ul> <p> </p> <h2><strong>Must haves:</strong></h2> <ul> <li>Solid experience with <em>Infrastructure as Code (IaC)</em> tools, especially Terraform<strong>.</strong></li> <li>Experience in creating and managing<strong> CI/CD</strong> pipelines (e.g., Github Action, AWS CodePipeline).</li> <li>Deep knowledge of version control tools and workflows with<strong> GIT.</strong></li> <li>Experience in automation scripting with<strong> Python, AWS CLI, Spark.</strong></li> <li>Knowledge of<strong> </strong>AWS services automation and management.|</li> </ul> <p> </p> <h2><strong>Nice to haves:</strong></h2> <ul> <li>Familiarity with the AWS data ecosystem (<strong>S3, Glue, Lambda, Redshift, Snowflake</strong>).</li> <li>Familiarity with orchestrators like <strong>Airflow</strong>.</li> <li>Familiarity with data streaming technologies such as <strong>Kafka</strong>.</li> <li>Knowledge of monitoring and visualization tools (<strong>Prometheus, Grafana, CloudWatch</strong>).</li> <li>Basic