Job title: Associate Data Engineer (Spark)
Department: Engineering
Reporting to: Engineering Manager
Location: Canada East (Remote)
What you will be doing
- Own and improve our big data pipelines in AWS Spark.
- Assemble large, complex data sets that meet business requirements, with engineering best practices in mind.
- Build scalable and resilient data infrastructure, as well as tools to extract and transform data used by stakeholders and customers.
- Work closely with our data scientists and our data engineers in the US East Coast to create and evolve products that measure market dynamics in the Telecommunication space that drive our customers short term marketing campaign tactics and their longer-term customer acquisition and retention strategies.
Tech stack
- Spark, Scala, SQL, Redshift, Athena, S3, Airflow, EMR
We're looking for:
- 1+ years of experience with building and optimizing big data pipelines in Apache Spark
- 1+ years of experience with Scala
- Advanced with relational SQL databases and SQL
- 1+ years of experience with one of DB: MSSQL, Postgres, AWS Athena (Presto), Redshift
- 1+ years of experience in writing unit tests
- Experience with AWS cloud services like EC2, S3, EMR or equivalent
- Strong analytic skills in working with unstructured datasets.
- Experience in root cause analysis of data when asked to answer specific business questions
- Experience working with cross-functional teams
- Strong communication and collaboration skills
- Bachelor’s degree
It'd be nice to have:
- Python or Java coding experience
- Experience with data pipeline / workflow tools i.e. Apache Airflow
- Experience in AWS solution architecture
- Experience in implementing complex clustering and classification models on large datasets to support new product development
About Us
Opensignal is the leading global provider of independent insight and data into network experience and market performance. Our user-centric approach allows communication providers to constantly improve their network and maximize commercial performance. Leading analysts, investors and financial institutions place a high value on our independent analysis and we are regular contributors to their reports.
Real network experience is our focus and ultimately that’s what influences customer choice. Our mission is to advance connectivity for all and here at Opensignal, the team is leading the industry in enabling operators to link their network experience and market performance in a way that has never before been possible.
With offices in London, Boston, and Victoria, British Columbia, we are truly global, with employees working across four continents and representing over 25 nationalities. We are an equal opportunity employer dedicated to building an inclusive and diverse workforce.
Benefits
We believe we are stronger when we not only celebrate our many differences, values, and voices but include them in everyday practice. Having a diverse and inclusive culture is essential, which is why we offer a flexible approach to work-life balance, operating in a remote-hybrid way. We’ll help you get set up with the essentials you need to work from home or the office. We also offer an attractive range of additional benefits, including:
- Competitive compensation packages including a long-term equity program
- Comprehensive group benefits package and company sponsored retirement savings plan (details depend on your country of work)
- Professional development opportunities: education reimbursement, learning allowance, company-sponsored workshops, and more!
- Generous holiday allowance, sick leave, parental leave, flexibility including Flex Fridays, and the opportunity to work from abroad
- Charity matching and paid time off for community volunteering and DE&I program/committees
- Regular virtual and in-person events and socials
Originally posted on Himalayas
Apply Now