Job Information
Meta Production Systems Engineer, Fleet AI Systems in Bellevue, Washington
Summary:
Meta is seeking a Production Systems Engineer to join our Release to Production (RTP) team. Our servers and data centers are the foundation upon which our rapidly scaling infrastructure operates efficiently to deliver our innovative services. The RTP team is responsible for the Hardware Lifecycle of all Meta servers including pre-production hands-on system and hardware debugging and stress testing, enabling production-ready system monitoring, automated provisioning and automated remediation of issues.RTP Engineers work closely with hardware designers, system manufacturers, component vendors, capacity engineering, production engineering, Facebook services, and data center operations teams to test systems before release to our production data centers, and to track the health and lifecycle of servers in production.
Required Skills:
Production Systems Engineer, Fleet AI Systems Responsibilities:
Interface with external vendors and internal partners, including but not limited to hardware, mechanical, power, thermal, manufacturing, and software engineers, to understand system architecture, to develop, and to execute test suites for various architectures.
Proactively create experiments and tooling to detect and diagnose hardware, firmware, and software issues with system health.
Develop test framework for large-scale test automation inside the fleet, during product development and after mass production.
Implement remediation across software and hardware stacks, according to plans, while keeping a thorough procedural record and data log.
Develop and publish updates on resolutions and communicate findings internally.
Troubleshoot, diagnose and root cause system failures. Isolate the components and failure scenarios while working with internal and external stakeholders.
Develop visibility through data visualization and implement systemic solutions to hardware systems health issues.
Drive necessary discussion with external and internal teams on test specification and methodologies, to improve test quality continuously.
Minimum Qualifications:
Minimum Qualifications:
Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.
2+ years of experience in hardware server system support, troubleshooting server architecture and components, analyzing, triaging, and solving systems level issues.
Expertise with Linux and scripting (Python or similar).
2+ years of experience in changing system configurations and measuring change impact, working through full lifecycle progressions of computer systems products.
Preferred Qualifications:
Preferred Qualifications:
4+ years of experience in production support at scale (e.g. 10K storage servers and over 100K HDD), working through full system technologies.
3+ years of experience in hyperscale post-production environments, delivering solutions to complex systems issues.
2+ years of experience supporting AI or HPC systems and/or related systems, at scale.
Experience working in a matrix organization.
Public Compensation:
$104,000/year to $155,000/year + bonus + equity + benefits
Industry: Internet
Equal Opportunity:
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.
Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.