Data Engineer

As a Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure and pipelines, enabling efficient and reliable data processing and analysis.

Key responsibilities:

• Design, develop, and maintain scalable and robust data pipelines and ETL processes.
• Implement data integration solutions to consolidate and transform data from various sources.
• Ensure data quality, integrity, and security across the data architecture.
• Optimise data structures and storage systems for performance and scalability.
• Collaborate with cross-functional teams to understand data requirements and develop data models.
• Work closely with data analysts and scientists to support their data needs.
• Troubleshoot and resolve data-related issues and performance bottlenecks.
• Continuously evaluate and recommend improvements to data engineering processes and technologies.

Typical requirements: 

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Knowledge of data modelling and schema design principles.
• Experience with data integration tools and technologies (e.g., Apache Kafka, Apache Airflow).
• Familiarity with cloud-based data platforms (e.g., AWS, Azure, Google Cloud).
• Understanding of distributed computing frameworks and Big Data platforms (e.g., Hadoop, Spark).
• Solid understanding of data warehousing and data architecture principles.
• Strong problem-solving and analytical skills with attention to detail.
• Excellent communication and collaboration skills.