Job Information
Insight Global Senior Data Engineer in New York, New York
Job Description
1. Experience in creating scalable and secure data pipelines that enable the ingestion, transformation, and transfer of large quantities of structured and unstructured data from various databases and sources.
2. Experience in building complex database logic and APIs to automatically fetch and store data in various forms.
3. Extensive experience with programming languages (Python or related), ETL tools and their administration, as well as relational and non-relational databases.
4. Experience in architecting and developing efficient and reusable modularized components that drive complex applications.
5. Experience in implementing data quality, security, and governance standards and best practices across different cloud environments.
6. Experience in the design and build of the integration between data management tools.
7. Experience in the design, development, and maintenance of data solutions across different cloud platforms, such as AWS, Azure, or Google Cloud.
8. Extensive understanding of data structures, algorithms, and software architecture as well as the design, detailed testing, and documentation of complex systems.
9. Experience with the secure movement and storage of PHI, PII, and PCI data.
10. Experience with scaling up or increasing application resiliency and assuring that code meets required performance standards.
11. Ability to work and collaborate with data analysts, data scientists and IT operations to install and build tools transforming data to be used in building a new generation of data and artificial intelligence products.
12. Experience in providing technical leadership for development projects and providing consultation and guidance to other team members.
13. Ability to provide innovative solutions when presented with complex business or production issues.
14. Experience with modern DevSecOps practices and tools.
15. Experience with Agile methodologies and tools (i.e. Jira, Scrum, Kanban).
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
-Bachelors degree in Computer Science, Information Systems, or related field, Masters preferred
-7+ years of experience as a Data Engineer
-Experience with Python
-Experience building/enhancing ETL pipelines
-SQL experience or querying
-Database knowledge
-AWS, GCP for cloud exposure -Experience in directing a team of data engineers and analysts in the creation of complex software and data pipelines.
-Experience with data governance processes.
-Experience with data classification and taxonomy tools. null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.