Senior Data Engineer – $140,000 + Benefits – New York

Job Description

As a Senior Data Engineer, you will be responsible for architecting, building, and optimizing scalable data pipelines and systems to support the organization's data needs.

You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to ensure seamless data integration, processing, and delivery.

Leveraging your expertise in big data technologies, you will drive the evolution of our data architecture, ensuring reliability, scalability, and performance.

Qualifications

• 8+ years of experience in data engineering, with a proven track record of designing and implementing complex data solutions.
• Proficiency in programming languages such as Python or Scala, with experience in data processing frameworks like Spark or Presto.
• Hands-on experience with platforms like Airflow or similar orchestration tools
• Hands-on Experience with Amazon Redshift or the equivalent
• Hands-on Experience with Databricks or equivalent
• Hands-on experience with cloud platforms such as AWS, Azure, Google Cloud or.
• Strong understanding of relational and NoSQL databases, data modeling, and SQL query optimization.
• Excellent problem-solving skills, with the ability to troubleshoot and debug complex data issues.
• Effective communication skills, with the ability to collaborate with cross-functional teams and present technical concepts to non-technical stakeholders.
• Understanding of data formats like Avro, Parquet, Delta, ORC.
• Experience with stream processing technologies (e.g., Kafka, Flink) and real-time data processing pipelines is a plus

Key Responsibilities:

• Design, develop, and maintain robust, scalable data pipelines and ETL processes to extract, transform, and load data into any data storage.
• Collaborate with stakeholders to understand data requirements and translate them into technical solutions, ensuring alignment with business objectives.
• Architect data models and schemas for efficient storage, retrieval, and analysis of structured and unstructured data.
• Implement best practices for data quality, governance, and security to maintain the integrity and confidentiality of data assets.
• Optimize performance and scalability of data infrastructure, leveraging cloud services and distributed computing technologies.
• Evaluate and implement new tools, frameworks, and technologies to enhance the capabilities of our data platform.
• Mentor junior members of the team, providing guidance on technical design, coding standards, and best practices.
• Stay current with industry trends and advancements in data engineering, contributing to continuous improvement and innovation within the organization.

How do you apply?

If you are interested in the Senior Data Engineer role and want to find out more, apply via the link at the bottom of this page or contact Digital Republic Talent by email ([email protected]) or call +1 737 2567409. Check our Job Vacancies page for more job opportunities.