Job Information
Nielsen Senior Data Engineer in Bengaluru, India
At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.
ABOUT THIS JOB:
Around here we’re all numbers people, but it’s the 1s and 0s behind our data that make what we do possible. Software engineers strike a balance between precision and disruption, between reliability and innovation. Nielsen is a tech company backed by nearly a century of forward momentum to show the world what’s next—and we couldn’t have done it without our engineers.
In this role, you will be working alongside data scientists and engineers within Nielsen’s Marketing Effectiveness business, to build a data platform on AWS to ingest data from external sources and perform ETL tasks. The role requires you to have experience working with large datasets with complex schemas, a can-do approach towards automation, with an emphasis on the implementation of best practice cloud security principles.
RESPONSIBILITIES
Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability
Collaborate with product and technology teams to design and validate the capabilities of the data platform
Develop, implement and maintain good programming standards and practices across the ecosystem
Experience building and optimizing data pipelines in a distributed environment
Experience supporting and working with cross-functional teams
Excellent communication skills and the ability to present complex ideas in a clear and concise manner to a variety of audiences
QUALIFICATIONS
4+ years of experience programming in Python and SQL
4+ years of experience with using a broad range of AWS technologies - e.g. S3, Lambda, Glue, Athena, IAM, SQS, CloudWatch, CloudFormation
2+ years working knowledge of Apache Superset or Tableau, Spark, Hive and Hadoop
Ability to implement application components without detailed guidance
Proficiency working in Linux environment
Experience using tools such as: Git, Gitlab and Jira
The training to back your work: a master’s degree, bachelor’s degree, or, as we recognize there isn’t one formula for success, equivalent work experience