Note: The job is a remote job and is open to candidates in USA. TechTriad is seeking a highly motivated and experienced Senior Data Engineer to join their Data Org. In this role, you will be responsible for designing and developing data processing pipelines, data warehousing solutions, and real-time data ingestion systems, collaborating closely with data scientists, analysts, and other stakeholders to meet business needs.
Responsibilities
- Develop and maintain high-performance, scalable, and fault-tolerant data processing systems using Spark, Flink, Druid, or the like
- Collaborate with cross-functional teams to integrate data from multiple sources and ensure data accuracy and consistency
- Write complex SQL queries to support data analysis and reporting
- Develop and maintain data models and ETL processes
- Optimize data pipelines and system performance to ensure efficient data processing and analysis
- Build and maintain data infrastructure, including data storage and data access systems
- Stay up-to-date with the latest developments in data engineering technologies and best practices
Skills
- Bachelor's degree in Computer Science, Engineering, or a related field
- 5+ years of experience in Data Engineering
- Expertise in Spark and Python
- Strong understanding of distributed systems, data modeling, and ETL processes
- Hands-on experience with cloud-based data warehousing solutions (e.g., AWS Redshift, Snowflake, Teradata)
- Excellent problem-solving skills and attention to detail
- Strong written and verbal communication skills
- Ability to work independently and as part of a team
- Experience with Scala is a bonus
- Experience with Databricks is a bonus
Company Overview