Data Engineering Manager

Overview

As the Data Engineering Manager, you will play a crucial role in managing and leading a team of skilled data engineers. You will be responsible for overseeing the design, development, and maintenance of our data infrastructure, ensuring it is robust, scalable, and efficient. Your work will enable data-driven decision-making and support various business functions across the organization.

Responsibilities

• You will build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Your ultimate goal is to make data accessible for organizations to optimize performance.
• Work closely with PMs, and business analysts to build and improvise data pipelines, and identify and model business objects.
• Write scripts implementing data transformation, data structures, and metadata for bringing structure to partially unstructured data and improving the quality of data.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL.
• Own data pipelines - Monitoring, testing, validating and ensuring meaningful data exists in a data warehouse with a high level of quality.
• Leading, mentoring and motivating a team of engineers with a focus on long-term data architecture while solving short-term business needs.
• Responsible for end-to-end stability, performance and cost of the data platform infrastructure and the accuracy of data for downstream systems and reports. What we look for in the candidate:
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
• Create long-term and short-term design solutions through collaboration with colleagues.
• Proactive to experiment with new tools.
• Experience in building data platforms preferably for the retail domain.
• Experience in representing and owning deliverables from a team of engineers.
• Strong programming skills in Python
• Skillset: Python, Pandas, SQL, ETL frameworks, PySpark.
• Strong communication and interpersonal skills to interact with senior-level management regarding the implementation of features.
• Willingness to learn and eagerness to contribute to projects.
• Designing Dataware house and the most appropriate DB schema for the data product.
• Positive attitude and proactive problem-solving mindset.
• Experience in leading a team of data engineers towards better architecture, development practices and quality of code.
• Experience in building data pipelines and connectors.
• Knowledge of AWS cloud services would be preferred. What we look for in a person:
• Kindness
• Willingness to learn and eagerness to contribute to challenging projects.
• Positive attitude and proactive problem-solving mindset