Sr. Databricks Engineer

Milestone Technologies, Inc.


In this vital role you will be responsible for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building, and optimizing our data pipelines and platforms in a SAFE Agile product team.

  • Chip in to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
  • Deliver for data pipeline projects from development to deployment, managing, timelines, and risks.
  • Ensure data quality and integrity through meticulous testing and monitoring.
  • Leverage cloud platforms (AWS, Databricks) to build scalable and efficient data solutions.
  • Work closely with product team, and key collaborators to understand data requirements.
  • Enforce to data engineering industry standards and standards.
  • Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
  • Familiarity with code versioning using GIT and code migration tools.
  • Familiarity with JIRA.
  • Stay up to date with the latest data technologies and trends

What we expect of you

Basic Qualifications:

  • Doctorate degree OR
  • Master’s degree and 4 to 6 years of Information Systems experience OR
  • Bachelor’s degree and 6 to 8 years of Information Systems experience OR
  • Diploma and 10 to 12 years of Information Systems experience.
  • Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP)
  • Proficiency in Python, PySpark, SQL.
  • Development knowledge in Databricks.
  • Good analytical and problem-solving skills to address sophisticated data challenges.

Preferred Qualifications:

  • Experienced with data modeling
  • Experienced working with ETL orchestration technologies
  • Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and DevOps
  • Familiarity with SQL/NOSQL database

Soft Skills:

  • Skilled in breaking down problems, documenting problem statements, and estimating efforts.
  • Effective communication and interpersonal skills to collaborate with multi-functional teams.
  • Excellent analytical and problem solving skills.
  • Strong verbal and written communication skills
  • Ability to work successfully with global teams
  • High degree of initiative and self-motivation.
  • Team-oriented, with a focus on achieving team goals

Apply now
To help us track our recruitment effort, please indicate in your cover/motivation letter where (skilledworkerjobs.com) you saw this job posting.