Job Information
IBM Data Engineer-Data Platforms-AWS in Pune, India
Introduction
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe. You'll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio
Your role and responsibilities
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
Your primary responsibilities include:
Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
Strive for continuous improvements by testing the build solution and working under an agile framework.
Discover and implement the latest technologies trends to maximize and build creative solutions
Required technical and professional expertise
Design and Develop Data Solutions, Design and implement efficient data processing pipelines using AWS services like AWS Glue, AWS Lambda, Amazon S3, and Amazon Redshift.
Develop and manage ETL (Extract, Transform, Load) workflows to clean, transform, and load data into structured and unstructured storage systems.
Build scalable data models and storage solutions in Amazon Redshift, DynamoDB, and other AWS services.
Data Integration: Integrate data from multiple sources including relational databases, third-party APIs, and internal systems to create a unified data ecosystem.
Work with data engineers to optimize data workflows and ensure data consistency, reliability, and performance. Automation and Optimization: Automate data pipeline processes to ensure efficiency
Preferred technical and professional experience
Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
Good to have detection and prevention tools for Company products and Platform and customer-facing