• Develop web applications and tools for the effective management and operation of big data platform
• Analyze and improve stability, efficiency, and scalability of the platform
• Work closely with Architects, lead engineers and business on product design and features.
• Mentor and coach junior engineers on various design and development aspects of big data platform.
• Prototype ideas quickly using cutting edge technologies
Qualifications and Requirements
• Bachelors or Master’s degree or equivalent in computer science or related field with minimum of 5 years of directly related work experience.
• Experience of developing large distributed systems using core Java and/or Scala Experience in at least one scripting language such as Python or Ruby.
• Experience in applications to process large amounts of structured and unstructured data using big data technologies like Hadoop, Hive, Spark, Storm etc.
• Knowledge and experience working with various data sources like web services (rest, soap), unstructured data files, flat files, message queues, and xml based events, databases.
• Experience with UNIX/ Linux and shell scripting
• Firsthand experience handling petabytes of data is highly preferred.
• Excellent verbal and written communication skills.
• Proven track record on delivering results, especially in the area of writing high-performance, reliable and maintainable code.
• Ability to adapt to new development environments, changing business requirements and learning new systems highly desired.
• Experience with large distributed services is a plus as is building/operating highly available systems
• Ability to work well in a team environment and be able to effectively drive cross-team solutions that have complex dependencies and requirements in a fast-paced environment
• Strong technical vision, presentation and technology leadership skills.
• Ability to coach and mentor fellow team members
