Neuron Collectives Software Engineer, Amazon
Trainium Collectives
$165.2-223.6k
+ Sign-on payments and restricted stock units
Office located in Cupertino, CA
The largest online retailer and technology provider
Open for applications
The largest online retailer and technology provider
1001+ employees
Open for applications
$165.2-223.6k
+ Sign-on payments and restricted stock units
Office located in Cupertino, CA
1001+ employees
Company mission
To be Earth's most customer-centric company.
Role
Who you are
- 3+ years of non-internship professional software development experience
- 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience programming with at least one software programming language
Desirable
- 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
What the job involves
- Enhance collective algorithms and topologies for optimal training performance
- Use tools like Neuron Explorer to identify bottlenecks in compute and bus bandwidth utilization
- Monitor and analyze processor, DMA, firmware, and workload metrics
- Optimize collective operations to scale AI compute across the data center
- Work closely with the hardware team to co-optimize software and Trainium silicon
- Develop and optimize C/C++ implementations of collective communication patterns
- Investigate and implement improvements for specific training topologies used by modern LLMs
- Build and maintain analysis frameworks and automation solutions
- The role offers opportunities to work on cutting-edge AI training hardware while contributing to one of Amazon's most critical initiative
- Annapurna Labs, a crucial part of AWS, is responsible for developing hardware and software components for EC2 infrastructure
- Our team focuses on building networking solutions that for Machine Learning (ML) and High-Performance Computing (HPC) workloads on AWS
- We have mixed discipline orgs, you’d be working side by side with infrastructure experts, hardware engineers, RTL engineers, scientists & architects
- Our workforce spans the globe and is truly international, you’ll find yourself working side by side with individuals from numerous countries
- We take mentorship seriously, you can both expect senior mentorship and will be expected to mentor new and junior engineers
- The pace is fast as we work on the latest advancements of AI/ML, but we take the time to bond as a team and enjoy the successes
- We offer flexibility in working hours, and respect WLB as a core org tenet
- The team enjoys working with numerous principal-level engineers and closely with directors, career growth opportunities are certainly available
- This is a role where you will always be encouraged to keep learning, the AI/ML field is fast moving and constantly evolving
Our take
Amazon is the world's largest online retailer, and is well-known for its disruption of well-established industries. The company is present in numerous verticals, including cloud computing with Amazon Web Services, AI with its range of Alexa devices and a global marketplace more commonly referred to as 'the everything store'. Acquisitions include Ring, Twitch, Whole Foods Market, and IMDb.
More recently, Amazon has been focused on leading the "third wave in digital advertising". Many businesses are now shifting ad dollars to retailers, which before would have been spent with online media platforms. Amazon's seen great success in the space, with its revenue from advertising now higher than its Amazon Prime membership scheme, audiobooks and digital music combined. This growth is particularly impressive considering its digital ad rivals (like Snap, Alphabet, and Meta) have suffered declines due to wider macroeconomic factors and Apple's iOS privacy changes.
Despite its dominant market position, Amazon will continue to be challenged over the next decade, including sustaining AWS's cloud dominance in the face of Google and Microsoft. On top of this, the company's e-commerce division is facing profitability problems despite its 2023 post-IPO debt funding of 8 billion. It will need to find new ways to stay above their competitors.
Steph
Company Specialist at Welcome to the Jungle
Insights
16% employee growth in 12 months
Company
Company HQ
South Lake Union, Seattle, WA
Leadership
Jeff Bezos
(Founder & Executive Chairman)Jeff is an American business magnate, media proprietor, and investor. As well as founding Amazon, Jeff founded Blue Origin, an aerospace manufacturer and sub-orbital spaceflight services company and also owns The Washington Post.
Andy Jassy
(President & CEO)Joined Amazon as a Marketing Manager in 1997. Developed AWS with Jeff Bezos, and became CEO of Amazon in 2021.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 201 more jobs at Amazon