Tasks/Responsibilities
The Lead Data Engineer will be responsible for improving the data lake and the processes put in place for the different product lines of a multinational.
MORE PRECISELY
- Understand business priorities and design the optimal data solutions
- Lead the design of data platform architecture and create automated pipelines
- Supervise 3 Data Engineer who each manages different product lines
- Work in collaboration with Data Architects, BI/ETL developers, and Data Scientists
- Work with GCP Services (Big Query, Dataflow, Cloud Functions, Cloud Run, etc.) and in an environment on Apache Spark, PySpark, Python and SQL
PROFILE
- 5+ years of experience as a Data Engineer
- Professional experience with Google Cloud Platform (GCP), strong asset
- Knowledge in a Python and Apache Spark environment
- Experience in a manufacturing environment, strong asset
- BAC in computer science or equivalent
- English required
