SMMT Job Vacancies

Data Engineer

19 January 2024 #SMMT Job Vacancies

A new vacancy exists for an Data Engineer in the SMMT Data Intelligence team.

PURPOSE OF POST:

  • To design and implement scalable and efficient data models, databases, and processing systems
  • To build robust, fault-tolerant data pipelines for ingesting, processing and transforming large volumes of
    data
  • To administer and optimise databases for performance, scalability, and reliability
  • To work with IT and DevOps teams to set up and maintain the necessary infrastructure for data storage
    and processing
  • To collaborate with cross-functional teams, including data scientists, analysts, and business
    stakeholders, to understand their data requirements and provide solutions

QUALIFICATIONS / SKILLS / ATTRIBUTES REQUIRED BY JOB HOLDER:

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or similar role.
  • Proficiency with SQL
  • A thorough understanding of data modelling in a NoSQL environment
  • A thorough understanding of data modelling in a traditional Relational Database environment
  • Proficiency in programming languages such as Python, Java, or Scala.
  • Strong knowledge of databases (e.g., SQL, NoSQL), data warehousing, and big data technologies.
  • Experience with cloud platforms (e.g., AWS, Azure, GCP).
  • Familiarity with data modelling tools and techniques.
  • Excellent problem-solving and communication skills

MAIN DUTIES INCLUDE:

Data Architecture Design:

  • Design and implement scalable and efficient data models, databases, and processing systems.
  • Develop and maintain conceptual, logical, and physical data models.

Data Pipeline Development:

  • Build robust, fault-tolerant data pipelines for ingesting, processing, and transforming large volumes
    of data.
  • Integrate data from various sources and ensure data quality and consistency.

Database Management:

  • Administer and optimise databases for performance, scalability, and reliability.
  • Implement and manage ETL (Extract, Transform, Load) processes.

Infrastructure Management:

  • Work with IT and DevOps teams to set up and maintain the necessary infrastructure for data storage
    and processing.
  • Ensure data security, compliance, and privacy.

Collaboration:

  • Collaborate with cross-functional teams, including data scientists, analysts, and business
    stakeholders, to understand their data requirements and provide solutions.

Performance Optimisation:

  • Identify and resolve performance bottlenecks in data systems.
  • Monitor and tune data processing systems for optimal performance.

Documentation:

  • Create and maintain comprehensive documentation for data infrProspect Joinery Prospect Joinery
    astructure, processes, and workflows.

Prospective candidates should contact hr@smmt.co.uk with a CV and covering letter.

Update Newsletter