Lead / Senior Software Engineer, Data Programme

About the role

You will build and maintain data platform infrastructure for government agencies, including APIs, data connectors and integration tools. You will develop the central data discovery and access request platform, with user interfaces for data catalogue browsing and request workflows. You will design and implement standardised data delivery APIs and microservices, plus authentication and monitoring systems. You will also manage data pipelines, cloud deployments, DevOps automation and continuous integration and deployment pipelines.

Requirements

• Excellent problem solving and methodical troubleshooting skills
• Strong knowledge and experience in DevOps automation, containerization and orchestration using tools eg. Ansible, Airflow, Docker, Kubernetes, Terraform, Artifactory/Nexus Sonatype
• Cloud computing deployment and management experience in AWS, GCP
• Strong scripting skills e.g. Python, Bash, JavaScript, Scala, Rust, Go
• Strong understanding of Apache Spark/Flink, Hadoop, distributed file systems and resource scaling/scheduling, streaming message queues (RabbitMQ, Kafka)
• Strong understanding of virtualization and networking concepts

Benefits

• Leave benefits to meet your work-life needs
• Employee wellness programs
• Flexible work arrangements (subject to job role)