Note: The job is a remote job and is open to candidates in USA. Da Vinci is seeking a GCP/Linux Data Engineer to support an engineering team in building a research data platform. The role involves creating and maintaining data pipelines, validation scripts, and user documentation while ensuring data integrity and accessibility.
Responsibilities
- Create, verify, and maintain data replication scripts
- Create, verify, and maintain data validation, processing, and ingestion pipelines
- Deploy and automate the execution of data replication scripts and data pipelines in cloud infrastructure
- Create and maintain data catalogs that describe datasets and their contents (i.e. files, file types, tables/views, columns, fields, etc.)
- Create, verify, and maintain dashboards and reports that characterize ingested datasets
- Create, verify, and maintain data validation scripts/APIs that verify the production dataset contains the correct number of samples/records, expects values/fields/columns are populated, and values are of the correct data type, format, and range
- Deploy and automate the execution of data validation scripts/APIs
- Create and maintain user documentation (dataset descriptions, tutorials, code examples, etc.)
- Define entitlements, user groups, roles, and permissions utilized to grant access to datasets
Skills
- Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experience
- Strong GCP
- Linux system administration and scripting
- Pro Desk API
- In-depth knowledge of software engineering with experience coding applications or services in a high-level language (C, C++, Golang, Java, C# etc.)
- Demonstrated problem solving and time management skills
- Strong technical aptitude for designing and implementing software solutions
- Experience with modern application development frameworks
- Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
- Deep hands-on technical expertise
- Excellent verbal and written communication skills
- Experience with Agile software development techniques
Benefits
- Fully Remote
- W2 Candidates Only
Company Overview