Description

Are you seeking an environment where you can drive innovation? Do you want to be at the forefront of applying machine learning to solve real world problems? Do you want to play a key role in the future of Amazon's Stores business? Come and join us!

The Supply Chain Optimization Technologies (SCOT) group is seeking a Principal Applied Scientist to join our Reinforcement Learning team. Our research team, which includes Sham Kakade and Dean Foster, has published research in top journals and conferences and has a significant impact on the field. Through the launch of several Deep RL models into production, our work also affects decision making in the real world.

Key job responsibilities

Key job responsibilities include:

• Design, implement and evaluate models, agents and software prototypes

• Technical leadership for a group of highly motivated and talented scientists

• Engage key business stakeholders and scientists to surface opportunities for improvement and identify business requirements.

• Work closely with partner teams to develop solutions to ambiguous business problems and integrate novel methodology into our team and business.

• Work closely with a senior science advisor, collaborate with other scientists and engineers, and be part of Amazon’s vibrant and diverse global science community.

• Raise the bar of scientific research by innovating and publishing

About the team

Supply Chain Optimization Technologies (SCOT) owns Amazon’s global inventory planning systems. We decide what, when, where, and how much we should buy to meet Amazon’s business goals and to make our customers happy. We decide how to place and move inventory within Amazon’s fulfillment network. We do this for hundreds of millions of items and hundreds of product lines worth billions of dollars of world-wide. Venturing beyond traditional operations research methods for sequential decision-making in inventory planning, the Reinforcement Learning team is pioneering the application of reinforcement learning techniques for these applications. The team combines empirical research and real world testing, backed by a robust theoretical foundation. Some research publications include:

• Deep Inventory Management [https://arxiv.org/abs/2210.03137, NeurIPS 2022 Workshop Presentation]

• Learning an Inventory Control Policy with General Inventory Arrival Dynamics [https://arxiv.org/abs/2310.17168]

• Meta-Analysis of Randomized Experiments with Applications to Heavy-Tailed Response Data [https://arxiv.org/abs/2112.07602]

• What are the Statistical Limits of Offline RL with Linear Function Approximation? [https://arxiv.org/abs/2010.11895, NeurIPS 2021 Workshop Presentation]

• A Study on the Calibration of In-context Learning [https://arxiv.org/abs/2312.04021]

We encourage collaboration across teammates and recognizes the need to take chances and try new ideas that may fail. Furthermore, our builder culture means that Scientists and Software Development Engineers work closely together to invent and construct at a massive scale.

We are open to hiring candidates to work out of one of the following locations:

New York, NY, USA

Basic Qualifications

• PhD in one of the following disciplines: Computer Science, Machine Learning, Statistics, Applied Math or a related quantitative field

• 10+ years of relevant, broad research experience after PhD

• Publications at top-tier peer-reviewed conferences or journals in one of these areas: reinforcement learning, deep learning, and machine learning

• Fluency in Python, SQL or similar scripting languages and skilled at Java, C++, or other programing languages.

• Strong algorithm development experience

• Depth and breadth in state-of-the-art machine learning technologies

• Strong prior experience with mentorship and/or management of senior scientists and engineers.

Preferred Qualifications

• Deep expertise in Reinforcement Learning or Machine Learning

• Knowledge of the latest trends in related areas in Machine Learning.

• Proven track record of innovation in creating novel algorithms and advancing the state of the art

Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status. For individuals with disabilities who would like to request an accommodation, please visit https://www.amazon.jobs/en/disability/us.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $159,100/year in our lowest geographic market up to $309,400/year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and/or other benefits. For more information, please visit https://www.aboutamazon.com/workplace/employee-benefits. Applicants should apply via our internal or external career site.