Note: The job is a remote job and is open to candidates in USA. Redolent, Inc is actively looking for a Data Engineer in Sunnyvale, CA or remote. The role involves building and maintaining robust data pipelines, managing workflow orchestration, and implementing scalable data solutions on Google Cloud Platform.
Responsibilities
- 7+ years of experience in Data engineering build, and maintain robust data pipelines using Apache Spark and Python
- Develop and manage workflow orchestration using Apache Airflow
- Implement scalable data solutions on Google Cloud Platform (GCP) using services like BigQuery, Cloud Storage, Dataflow, and Vertex AI
- Collaborate with data scientists to embed machine learning models into production-grade data pipelines
- Ensure high performance, reliability, and scalability of data systems
- Monitor, troubleshoot, and optimize data workflows and ML model performance
- Maintain documentation and follow best practices for version control, testing, and deployment
Skills
- 7+ years of experience in Data engineering build, and maintain robust data pipelines using Apache Spark and Python
- Develop and manage workflow orchestration using Apache Airflow
- Implement scalable data solutions on Google Cloud Platform (GCP) using services like BigQuery, Cloud Storage, Dataflow, and Vertex AI
- Collaborate with data scientists to embed machine learning models into production-grade data pipelines
- Ensure high performance, reliability, and scalability of data systems
- Monitor, troubleshoot, and optimize data workflows and ML model performance
- Maintain documentation and follow best practices for version control, testing, and deployment
Company Overview