Task title: Data & Risk infrastructure
Location:
Role objective:
Help risk & data team by advising how to improve filesystems and orchestrate data pipelines. Review the infrastructure and recommend next steps related to supporting new processes that will have to build in near future.
Task objectives:
- Review orchestration of data pipelines
- Review data & risk infrastructure and recommend improvements
- Review Cloud architecture and recommend best practices
Task steps:
- Review data flow, recommend how to improve filesystem and orchestrate data pipelines
- Review the infrastructure and recommend next steps related to supporting new processes
Task deliverables & milestones:
- Review of risk & data infrastructure
- Review data flow, recommend how to improve filesystem and orchestrate data pipelines
Desired experience:
- Experience with cloud infrastructure, especially GCP
- Experience with data engineering
- Good knowledge of Python
- Knowledge of Kubernetes
