Big Data Engineer

Essential functions

·      Building Azkaban tasks.

·      Developing Spark jobs using Scala.

·      Adding additional datasets for new brands into the existing Extract, Transform, and Load (ETL) pipelines.

·      Identifying and resolving issues, as well as verifying the functionality of established ETL pipelines.

·      Executing SQL statements.

·      Analyzing and handling extensive datasets using the Amazon Web Services (AWS) infrastructure.

·      Collaborating with SRE teams.

·      Provide assistance to the Quality Assurance team.

·      Setting up and maintaining Continuous Integration/Continuous Deployment (CI/CD) workflows.

·      Various locations—job may allow for remote work; job may involve relocation to anticipated or unanticipated locations across the United States, including client sites and Grid Dynamics’ offices throughout the United States and/or company headquarters located in San Ramon, CA.

Qualifications

·      Bachelor of Science degree in Computer Engineering, Computer Science, or a closely related field. 

 ·      At least ONE (1) year of experience in the job offered or at least ONE (1) year of experience in the following:

1. Working with data analytics and data engineering, including data cleaning and preprocessing, data analysis and dashboard development

2. Scala & Python

3. Apache Hadoop, Apache Spark, Apache Kafka

4. AWS

5. ETL orchestration and workflow management tools: Airflow and Azkaban

We offer

·      Opportunity to work on bleeding-edge projects

·      Wage range: $116,000.00—136,000.00 per year

·      Work with a highly motivated and dedicated team

·      Competitive salary

·       Flexible schedule

·      Medical insurance

·      Benefits program

·      Social package - medical insurance, sports

·      Corporate social events

·      Professional development opportunities

About us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.