Staff Product Manager - AI Performance and Benchmarking
2 days ago
Sunnyvale
Job Description CoreWeave is the AI Hyperscaler™, delivering a cloud platform of cutting edge services powering the next wave of AI. Our technology provides enterprises and leading AI labs with the most performant, efficient and resilient solutions for accelerated computing. Since 2017, CoreWeave has operated a growing footprint of data centers covering every region of the US and across Europe. CoreWeave was ranked as one of the TIME100 most influential companies of 2024. As the leader in the industry, we thrive in an environment where adaptability and resilience are key. Our culture offers career-defining opportunities for those who excel amid change and challenge. If you're someone who thrives in a dynamic environment, enjoys solving complex problems, and is eager to make a significant impact, CoreWeave is the place for you. Join us, and be part of a team solving some of the most exciting challenges in the industry. CoreWeave powers the creation and delivery of the intelligence that drives innovation. What You'll Do:We are looking for a Staff Product Manager for AI Platform Services to lead performance optimization and benchmarking for foundation model training and inference on CoreWeave. In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You'll have a direct impact on shaping the future of AI infrastructure and services. About The Role: The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud-native technologies, and low-level constructs such as CUDA, NCCL, and kernels. You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler. Key Responsibilities: • Product Strategy: Define and evolve CoreWeave's strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads., • Performance & Benchmarking: Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf., • Model Development & Customization: Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware., • Cross-Functional Collaboration: Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution., • Customer Success: Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale., • Market Analysis: Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation., • Pricing Strategy & Execution: Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value., • Performance Monitoring: Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions., • Go-to-Market Strategy: Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events.Who You Are:, • Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged., • Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL., • Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations., • Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments., • Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills., • Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions., • Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders., • Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space., • Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations., • Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus.Wondering if you're a good fit? We believe in investing in our people, and value candidates who can bring their own diversified experiences to our teams – even if you aren't a 100% skill or experience match. Here are a few qualities we've found compatible with our team. If some of this describes you, we'd love to talk., • You love to build technology solutions that power innovations., • You're curious about the future of AI development with emerging technologies., • Be Curious at Your Core, • Act Like an Owner, • Empower Employees, • Deliver Best-in-Class Client Experiences The range we've posted represents the typical compensation range for this role. To determine actual compensation, we review the market rate for each candidate which can include a variety of factors. These include qualifications, experience, interview performance, and location. In addition to a competitive salary, we offer a variety of benefits to support your needs, including: • Medical, dental, and vision insurance - 100% paid for by CoreWeave, • Company-paid Life Insurance, • Voluntary supplemental life insurance, • Short and long-term disability insurance, • Flexible Spending Account, • Health Savings Account, • Tuition Reimbursement, • Ability to Participate in Employee Stock Purchase Program (ESPP), • Mental Wellness Benefits through Spring Health, • Family-Forming support provided by Carrot, • Paid Parental Leave, • Flexible, full-service childcare support with Kinside, • 401(k) with a generous employer match, • Flexible PTO, • Catered lunch each day in our office and data center locations, • A casual work environment While we prioritize a hybrid work environment, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration California Consumer Privacy Act - California applicants only CoreWeave is an equal opportunity employer, committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information. As part of this commitment and consistent with the Americans with Disabilities Act (ADA), CoreWeave will ensure that qualified applicants and candidates with disabilities are provided reasonable accommodations for the hiring process, unless such accommodation would cause an undue hardship. If reasonable accommodation is needed, please contact: . Export Control Compliance This position requires access to export controlled information. To conform to U.S. Government export regulations applicable to that information, applicant must either be (A) a U.S. person, defined as a (i) U.S. citizen or national, (ii) U.S. lawful permanent resident (green card holder), (iii) refugee under 8 U.S.C. § 1157, or (iv) asylee under 8 U.S.C. § 1158, (B) eligible to access the export controlled information without a required export authorization, or (C) eligible and reasonably likely to obtain the required export authorization from the applicable U.S. government agency. CoreWeave may, for legitimate business reasons, decline to pursue any export licensing process.