Lead Data Engineer

Department: Engineering
Specialization: Data Engineer
Experience: Lead
Technologies: Apache Spark
Locations: Argentina
Client: Indeed
Special referral bonus: No
Hot position?: Hot
Engineering technical flow: Data Engineer / Apache Spark
Non-engineering technical flow: none
  • What you will do

  • Migrate Indeed search index builders from old framework to Apache Spark and AWS;
  • Providing Apache Spark best practices and mentoring;
  • Producing high-quality code;
  • Communication with Engineering & Product management;
  • Alignment with existing development teams.
  • Must haves

  • 4+ years experience in software development in preferably Big Data Projects like Hadoop eco-systems;
  • Should have experience with Kafka, Spark;
  • Practical experience implementing Apache Spark jobs: knowing its features on partitioning, grouping, joins, importing the data into the cluster, exporting the data from the cluster;
  • BS in Computer Science or equivalent practical experience;
  • Practical experience with Java (ideally 2+ years);
  • A plus if one has experience working with AWS, specifically AWS EMR (or ability to pick it up fast), although not mandatory;
  • Upper-intermediate English level.
  • Nice to haves

  • Apache Hive;
  • Apache Airflow.

AgileEngine is one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.

If you like a challenging environment where you’re working with the best and are encouraged to learn and experiment every day, there’s no better place — guaranteed! 🙂

About the project

The benefits of joining us

Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps

Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities

A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands

Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.

Your AgileEngine journey starts here

1

Test task

We will review your CV and send you a test task via email

2

Intro Call

Our recruitment team will reach you to discuss available opportunities

WFH or a comfy office? Why not both?

International Projects

3

Technical Interview

You will have an interview with your future team lead

Our geography

UTC-5
WASHINGTON DC USA
UTC-5
MIAMI USA
UTC-6
MEXICOMexico
UTC-5
ColombiaColombia
UTC-3
BrazilBrazil
UTC-3
ArgentinaArgentina
UTC+2
UkraineEurope
UTC+1
PolandEurope
UTC+0
PortugalPortugal
UTC+5:30
IndiaIndia

About AgileEngine

Founded as a dev tool vendor with a 2-person team

2010

Opened a dev center in Ukraine

2012

Pivoted into outsourced product development

2014

Launched mobile and UI labs

2015

Got our first Inc. 5000 award

2016

Opened a dev center in Argentina

2017

Became a top-3 ranked custom software developer in DC, Ukraine, and Argentina

2019

Became the #1 software development company to hire in 2020

2020

Opened new dev centers in Mexico and Colombia, counting 500+ experts

2021

How we lead

A company where experts grow, hone their skills, and do what they love, AgileEngine is guided by these principles:

Stay agile and embrace changes

Thrive in a results-driven culture with individual autonomy

Innovate with fellow experts in a no-blame environment

Learn from mistakes and move on

Foster mutual trust and support

Our geography

UTC-5
WASHINGTON DC USA
UTC-5
MIAMI USA
UTC-6
MEXICOMexico
UTC-5
ColombiaColombia
UTC-3
BrazilBrazil
UTC-3
ArgentinaArgentina
UTC+2
UkraineEurope
UTC+1
PolandEurope
UTC+0
PortugalPortugal
UTC+5:30
IndiaIndia

Apply for this position

Allowed Type(s): .pdf, .doc, .docx