For one of our multiyear projects we are looking for a Cloud DevOps Engineer out of New York City, NYC.
Basic Qualifications (Legislative Requirement):
• 5+ years of experience in Spark/Hadoop
• 5+ years of experience programming in Java/Scala
• 5+ years of experience in Docker(Swarm/Kubernetes)
• 5+ years of experience with Python/Shell Scripting
• Proficient understanding of distributed computing principles
• Proficient understanding of networking principles
• Proficient understanding of performance computing principles
• Experience with NoSQL/Graph databases, such as MongoDB, Ignite, and Druid
• Experience with Hadoop, Docker, Kubernetes, and ELK Stack a plus
• Experience with Hive
PRINCIPAL RESPONSIBILITIES:
• Take ownership of component(s) of the workflows supported within our data ecosystem
• Interact with CM development teams across RBC and understand their application requirements, data access patterns, and assist them with expediting onboarding to various platforms from a engineering and development aspect.
• Design and develop systems that meet our latency, volume, storage and scale expectations to enhance KPI metrics, and monitoring capabilities for use across multiple teams
• Participate in meetings to help influence architectural, engineering, and development decisions
• Follow our Agile software development process with daily scrums and monthly Sprints
• Ability to work collaboratively on a cross-functional team with a wide range of experience levels
• Define best practices for spark usage; work with teams to influence their architecture
• Provide expertise in Spark Performance tuning
• Perform knowledge sharing, conduction education workshops, and train other employees is expected
• Keep pace with emerging technology by researching and evaluating products
AUTHORITIES, IMPACT, RISK
• Recognized Big Data & Cloud DevOps Engineer who can helps build components, drive best practices & standards, and provide guidance/insight to partnering Architecture, Development, Engineering, and Operations Team(s) across QTS
KEY RELATIONSHIPS:
• QTS Application Development Team(s)
• QTS Architecture and Engineering Team(s)
• QTS Engineering and Operations Team(s)
WORKING CONDITIONS:
• Office Environment.
• Fast Paced.
• Some Overtime & Weekend work.
