Role – Data Engineer
Location -India
Years of experience- 5 to 10 Years
Skill - Apache Airflow, PySpark, and Python
Description:
We are seeking a highly skilled and motivated Data Engineer to join our dynamic technology team. The ideal candidate will have deep expertise in data engineering tools and platforms, particularly Apache Airflow, PySpark, and Python, with hands-on experience in Cloudera Data Platform (CDP). A strong understanding of DevOps practices and exposure to AI/ML and Generative AI use cases is highly desirable.
Key Responsibilities:
1. Design, build, and maintain scalable data pipelines using Python, PySpark and Airflow.
2. Develop and optimize ETL workflows on Cloudera Data Platform (CDP).
3. Implement data quality checks, monitoring, and alerting mechanisms.
4. Ensure data security, governance, and compliance across all pipelines.
5.Work closely with cross-functional teams to understand data requirements and deliver solutions.
6. Troubleshoot and resolve issues in production data pipelines.
7. Contribute to the architecture and design of the data platform.
8. Collaborate with engineering teams and analysts to work on AI/ML and Gen AI use cases.
9. Automate deployment and monitoring of data workflows using DevOps tools and practices.
10. Stay updated with the latest trends in data engineering, AI/ML, and Gen AI technologies. costing, Element entry management
Join a leading financial institution that is investing heavily in its digital transformation journey. This is a critical leadership role where you will drive the quality of our core banking systems, impacting millions of customers and ensuring regulatory adherence. We offer a challenging yet rewarding work environment, opportunities for continuous learning, competitive compensation, and a chance to build a legacy in the evolving FinTech landscape.
Yethi is a boutique QA product and solutions company for BFS Domain. We are building next generation AI/BOT driven automation tools and solutions to improve the best-in-class Quality Assurance solutions that are adopted by large fortune 500 BFSI enterprises. Founded by seasoned fin-tech professionals with deep domain expertise and executive leadership with large technology companies.
We are a software solutions firm invested in building the next generation of tools and solutions to improve the quality of digital technologies being adopted within the BFSI industry. Founded by seasoned senior Fintech professionals, we bring years of domain expertise and global experiences to play. Our clients currently span across India, Southeast Asia, Europe, Africa and the Middle-East. Our close partnerships with clients, unique methodology, subject matter expertise, global experience and unique set of tools help us deliver innovative, effective and executable solutions. Our entrepreneurial spirit helps us to continually discover better ways to address our clients//' needs.
Specialties
Software Product, Testing Automation, Core Banking, Testing, FinTech, BankTech, Quality Assurance, Automation, robotic test automation, banking, BFSI, Software Testing, Temenos, Digital Banking, Finacle, FLEXCUBE, Finastra, and Origination Software.
workplace
Yethi has offices in 4 cities (Bangalore, Mumbai, Chennai, Jaipur) and clients across 22 countries.
More info logon to www.yethi.in
You’re currently accessing MegaHiring United States. If you’re looking for opportunities or advice in India, click the button below.