Data Software Engineer

What you’ll do:

Shaping the architecture of data products designed for data analytics and data science, specifically focusing on use cases like forecasting, feature engineering,  and integration of new data sources.

Leading the way in data transformation by setting up best practices in areas like Data modelling, performance optimisation, Data Governance etc, ensuring that the data used within Prima is consistent, available and reliable.

Build reusable technology that enables teams to ingest, store, transform, and serve their own data products.

Engaging with data scientists and machine learning engineers to explore the product landscape and refine data requirements for enhanced data infrastructure.

Embrace continuous learning and experimentation to stay updated on emerging technologies, from testing open source tools to engaging in community-building activities like Meetups. Your passion for staying at the forefront of the field will drive your journey.

Raise the bar of the data quality standards, performing continuous assessment of data quality with stakeholders

What we’re looking for:

Expert in batch, distributed data processing and near real-time streaming data pipelines with technologies like Kafka, Spark etc.

Experience in Databricks is a plus.

Experience in Big Data Analytics platform implementation with cloud based solution; AWS preferred.

Proficient in Python programming and software engineering best practices.

Expertise with RDBMS, Data Warehousing, Data Modelling with relational SQL (Redshift, PostgreSQL) and NoSQL databases.

Proficiency in DevOps, CI/CD pipeline management, and expertise in infrastructure as Code (IaC) deployment industry-best practices.

Nice-to-Have:

Hands-on experience in Data Quality and Data Governance techniques.