The Amazon Publisher Monetization (APM) team is shaping the future of monetization for Amazon's advertising supported publishers (e.g., Prime Video, Freevee , Twitch, Onsite). Our mission is to build earth's most customer-centric advertising services. The APM Analytics team is seeking an exceptional Sr. Data Engineer to join our dynamic team. If you are passionate about Big Data technologies, building scalable real-time analytical solutions, relentless in ensuring data quality and reliability, and feel comfortable communicating at different levels of leadership, you are the candidate we are looking for!
This role requires deep expertise in the design, creation, management, and business use of large datasets across a variety of data platforms. You should have excellent business and interpersonal skills to work with business owners to understand data requirements and build ETL processes to ingest data into the data lake. You should be an authority at crafting, implementing, and operating stable, scalable, low-cost solutions to flow data from production systems into the data lake. Above all, you should be passionate about working with huge data sets and love bringing datasets together to answer business questions and drive growth.
In this role, you will envision, design, and develop data solutions to scale APM data. You will be responsible for designing and implementing scalable data/ETL pipelines leveraging big data technologies and modern BI products to effectively meet the rapidly growing and dynamic demands of rich data. You will help the organization move towards a data-as-a-service model to improve influence on day-to-day business decisions. You will influence and guide other data engineers, business intelligence engineers, tech team members, and leaders to make informed data decisions.
Key job responsibilities
* Design, implement, and support data warehouse infrastructure using Apache ecosystem technologies (e.g., Hadoop, Spark, Hive) and AWS services (e.g., Redshift, EMR, Glue).
* Create and optimize ETL processes to extract data from various operational systems and create a unified dimensional or star schema data model for analytics and reporting.
* Implement real-time data streaming solutions using technologies like Apache Kafka or AWS Kinesis.
* Develop a deep understanding of our vast data sources and know exactly how, when, and which data to use to solve particular business problems.
* Design and implement data quality checks and data governance processes to ensure data integrity and compliance.
* Support the development of performance dashboards that encompass key metrics to be reviewed with senior leadership and sales management.
* Work with Product Managers, Business Analysts, and a growing global team to help in analyzing data and derive new insights that drive Amazon's consumer marketing global success.
* Manage numerous requests concurrently and strategically, prioritizing when necessary.
* Stay up-to-date with the latest trends and technologies in big data and data engineering, proposing and implementing innovative solutions to improve data processing and analysis capabilities.
* Collaborate with cross-functional teams to identify and implement data-driven solutions for business challenges.
* Mentor junior data engineers and contribute to the team's knowledge sharing and best practices.
- 5+ years of data engineering experience
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with SQL
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Experience mentoring team members on best practices
- AWS certifications (e.g., AWS Certified Data Analytics - Specialty) are a plus.
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Experience operating large data warehouses
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.
Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $139,100/year in our lowest geographic market up to $240,500/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. This position will remain posted until filled. Applicants should apply via our internal or external career site.
