Senior Big Data Engineer
NGDATA
This job is no longer accepting applications
See open jobs at NGDATA.See open jobs similar to "Senior Big Data Engineer" Smartfin.Data Science
Chennai, Tamil Nadu, India · Mumbai, Maharashtra, India · Pune, Maharashtra, India · Mumbai, Maharashtra, India · Chennai, Tamil Nadu, India · India
Posted on Aug 21, 2024
The Senior Big Data Engineer will play a critical role in the architecture, implementation, and optimization of NGDATA's Customer Data Platform solutions within cloud environments, specifically AWS and GCP. This role is crucial for enhancing data ingestion, transformation, and integration capabilities using Apache NiFi, thereby driving operational efficiencies and enabling advanced customer insights. The successful candidate will be expected to deliver scalable data solutions that align with client needs and business objectives, ensuring robust system performance and innovation in data processing.
Tasks and Responsibilities
Main responsibilities
Additional / occasional tasks
Competence Profile
Language Requirements
Tasks and Responsibilities
Main responsibilities
- Design and implement scalable data processing pipelines using Apache NiFi in AWS/GCP environments (50%)
- Collaborate with cross-functional teams to integrate CDP capabilities into client environments (20%)
- Develop and optimize ETL processes and data models for complex analytics and data integration (15%)
- Drive technical innovation and efficiency improvements within CDP implementations (10%)
- Lead troubleshooting efforts and resolve technical issues to ensure system reliability (5%)
Additional / occasional tasks
- Mentor junior engineers and provide technical guidance
- Stay updated with emerging technologies and best practices in big data and cloud computing
Leadership Workload
- This role includes 20% leadership tasks such as mentoring and guiding less experienced team members, combined with 80% operational tasks focused on technical design and implementation.
Competence Profile
Background / Education Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field
- Advanced degree preferred
Experience / Skill Requirements
- Minimum 7 years of experience as a Big Data Engineer
- Expertise in Apache NiFi and cloud environments (AWS/GCP)
- Proficiency in ETL tools, data modeling, and integration
- Experience in leading technical projects and implementing large-scale data platforms
Personal Competences
Personal Competences
- Strategic Thinking: Ability to design scalable data architectures that align with long-term business goals.
- Problem-Solving: Strong aptitude for troubleshooting complex data issues and finding effective solutions.
- Leadership: Capability to mentor and inspire technical teams to achieve high performance.
- Communication Skills: Proficiency in conveying complex technical concepts to diverse stakeholders.
- Adaptability: Flexibility to thrive in a remote, collaborative environment and adapt to changing project requirements.
Language Requirements
- English: Fluent (both written and oral)
This job is no longer accepting applications
See open jobs at NGDATA.See open jobs similar to "Senior Big Data Engineer" Smartfin.