Lead Azure Data Engineer (Tech Lead)
United States••October 10, 2024
This position is based in New York office, where you will work closely with cross-functional teams and clients. Working from the office four days a week is mandatory to ensure seamless communication and delivery. Fully remote work is not an option for this role, as we value the collaborative environment and face-to-face interactions that drive innovation and success.Overview We are seeking a highly skilled Lead Azure Data Engineer (Tech Lead) with 10+ years of experience to join our dynamic team of technology professionals. In this role, you will be at the forefront of helping our clients manage modern Data Solutions at scale. As a seasoned technologist, you will leverage your deep technical expertise and strong leadership abilities to guide internal teams and clients in achieving their business goals through robust database engineering and cloud migration strategies.You will be responsible for overseeing the end-to-end lifecycle of modern Data platform on Azure, from initial design and planning to ongoing optimization and support. A critical aspect of your role , You will serve as a key technical liaison, ensuring seamless collaboration and effective delivery between our clients and offshore 24x7 teams for Dataops. Your ability to take ownership of delivery, manage cross-functional collaboration, and maintain open lines of communication across time zones is essential to the success of our projects.This version emphasizes the importance of collaboration and delivery ownership with offshore teams, highlighting it as a key component of the role.
Key Responsibilities:
- Lead and manage a team of data engineers, providing guidance and mentorship in implementing Azure data solutions. Set technical direction, define architectural standards, and drive the adoption of best practices for data engineering on Azure. Ensure that project timelines and deliverables are met while maintaining high-quality standards.
- Lead and mentor a team of offshore data engineers to meet program requirements.
- Serve as the technical liaison between customers and offshore 24x7 teams.
- Design and develop robust, scalable, and secure data pipelines and data integration solutions using Azure Data Factory, Azure Databricks, Snowflake, pyramid Analytics.
- Oversee the design, configuration, monitoring, and automation of Cloud Data Platfrom
- Lead database migrations, including planning, execution, and optimization for Azure Cloud.
- Develop and maintain Standard Operating Procedures (SOPs) and ensure the technical viability of production deployments.
- Provide advanced troubleshooting and resolution of day to day Data operations.
- Creating & maintaining documentation, on-boarding procedures & conduct training sessions on DataOps process
- Monitor pipelines for failures and diagnose/resolve problems.
- Mentoring and Training: Provide guidance and support to Level 1 and Level 2 Data Engineers, sharing knowledge and expertise to foster their professional growth.
- Engage, Consult and Deliver based on interactive customer communications in streamlining project deliverables and scope of work.
- Automate repetitive tasks to enhance efficiency and reduce human error.
- Participate in 24x7 production support for Cloud Data Platform.
Required Skills:-
- Expertise in Azure Data services, Snowflake, and Pyramid Analytics.
- Experience in DataOps
- Extensive experience in cloud-enabled data migrations and administration (On-prem to cloud, Cloud to cloud).
- Strong leadership and communication skills, with the ability to guide and influence both technical and business stakeholders.
- Proficient in traditional Datawarehousing , ETL along with modern Cloud Data Stack
- Strong written and verbal communication skills with the ability to effectively convey technical information to non-technical stakeholders.
- Ability to communicate technical info and ideas so others will understand.
- Ability to apply varying leadership skills and traits that create solutions and results to unexpected situations.
- Familiarity with industry best practices for Azure Data, Snowflake, and Pyramid Analytics, including development, configuration settings, maintenance tasks, and disaster recovery strategies.
- Ability to manage multiple demands with a sense of urgency and lead change successfully
- Should be able to establish end to end continuous integration and continuous deployment and guide the team on best practices and help them release product/application fast.· Provide 24x7 support as required for releases & maintenance
Education Requirements List:-
- Bachelor’s degree in computer science, Computer Information Systems, Management Information Systems, or a directly related field
Certifications List:-
- Azure DP- 203
- Snowpro Core
- Snowpro Data Engineer
Travel:-
- This position is based in New York office, where you will work closely with cross-functional teams and clients.
- Working from the office four days a week is mandatory to ensure seamless communication and project delivery.
- Fully remote work is not an option for this role, as we value the collaborative environment and face-to-face interactions that drive innovation and success.