Data Engineer

Essential functions

• Core Data Platform Development:

• Develop and maintain scalable data pipelines and integrations to manage increasing data volume and complexity.

• Design and implement data contracts to streamline communication and dependencies between teams.

• Build pipelines from scratch and on templates, utilizing modern tools and techniques.

• Collaboration & Quality:

• Work with analytics and business teams to improve data models feeding business intelligence tools, fostering data-driven decision-making.

• Implement and monitor systems ensuring data quality, governance, and accuracy for all production data.

• Data Infrastructure Management:

• Manage and enhance the data platform, incorporating technologies like Airflow, Glue Jobs, and data mesh principles.

• Design data integrations and establish a data quality framework.

• Define company data assets, document transformations, and maintain engineering wikis.

• Operations & Compliance:

• Collaborate with engineering, product, and analytics teams to develop and maintain strategies for long-term data platform architecture.

• Troubleshoot and resolve data-related issues in production environments.

Qualifications

• Expertise in AWS services, especially Glue, Athena,  MWAA

• Proficiency in Python and SQL

• Experience with streaming platforms (Kafka or Firehose)

• Experience with third-party solutions and APIs

Would be a plus

• Proficiency in data modelling techniques and best practices

• Experience in implementing data contracts

• Experience in applying data governance policies

• Experience with data quality frameworks (Great expectations, Soda)

• Familiarity with the data mesh architecture and its principles

We offer

• Opportunity to work on bleeding-edge projects

• Work with a highly motivated and dedicated team

• Competitive salary

• Flexible schedule

• Benefits package - medical insurance, sports

• Corporate social events

• Professional development opportunitieS

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.