AWS/Azure Data Engineer – Bangalore – 6 to 11 Years Experience

Cloud Security
Mumbai, Bangalore
12 August 2024
Full Time
Urgent

Job Overview

  • Date Posted
    12 August 2024
  • Location
    Mumbai, Bangalore
  • Expiration date
    16 October 2024
  • Experience
    6 Year
  • Gender
    Any

Job Description

We have an urgent opening for an experienced AWS/Azure Data Engineer. This role requires a deep understanding of data engineering and cloud technologies, particularly within AWS and Azure environments.

Responsibilities:
  • Design, build, and maintain scalable data pipelines.
  • Work with large and complex data sets, ensuring data integrity and quality.
  • Collaborate with cross-functional teams to gather and process data from various sources.
  • Deploy and maintain data pipelines on cloud clusters (AWS/Azure).
  • Perform unit testing to ensure code quality and data accuracy.
  • Optimize data processing workflows for performance and scalability.
Job Requirements

• Experience: 6+ years of total experience in data engineering.
• PySpark: Minimum 3 years of experience.
• Azure Data Bricks: At least 1 year of experience.
• SQL: 4+ years, with strong knowledge of complex windowing functions and joins.
• Data Pipelines: 2+ years of experience in deploying and maintaining data pipelines on cloud clusters (AWS/Azure).
• Unit Testing: Proficiency in unit testing (Experience with Pytest preferred, but manual testing is acceptable).

Preferred Qualifications

• Experience handling large-scale data (GB, TB) on a daily basis.
• Strong problem-solving skills and attention to detail.
• Ability to work independently and as part of a team.

About the Company

FirstMile IT Services Inc is a leading IT services company specializing in providing innovative technology solutions. With a focus on excellence and customer satisfaction, we help businesses harness the power of data to drive their success.

Related Jobs