Development Operations (DevOps) Engineer

Join us and make YOUR mark on the World!

Lawrence Livermore National Laboratory (LLNL) has turned bold ideas into world-changing impact advancing science and technology to strengthen U.S. security and promote global stability.

Our mission spans four critical national security areas nuclear deterrence, threat preparedness, energy security, and multi-domain defense empowering teams to take on the toughest challenges of today and tomorrow. With a culture built on innovation and operational excellence, LLNL is a place where your expertise can make a real impact.

We have an opening for a DevOps engineer to join Livermore Computing’s Platform Services Team responsible for a robust, scalable, infrastructure that combines HPC and cloud-related approaches. You will support and develop tools and services for LC users on a variety of hardware platforms. The goal is to support state of the art tools for developers and scientists, including LC’s on-premises services described at   hpc.llnl.gov ↗ (e.g. Persistent Data Services, containers, object storage, and workflow tools). This position is in the Livermore Computing Division within the Computing Directorate.

Business needs require that this position have an on-site presence multiple days a week. Telecommuting options will be limited.

You will

• Build, deploy, support, and enhance containerized applications and software stacks in LC OpenShift/Kubernetes clusters using established tools, processes, and practices.

• Identify and communicate technical issues and contribute to solutions using established DevOps practices.

• Perform software engineering using established development practices, tools, and processes for achieving robust software quality; including testing, configuration management, change management, and documentation.

• Collaborate closely with other technical teams/developers to ensure solutions are secure and integrated with other services as appropriate.

• Provide timely, customer-focused support and guidance to HPC users of assigned tools and services..

• Assist with administration and maintenance of OpenShift/Kubernetes infrastructure in Linux environments, following established operational, development, and security requirements.

• Assist with evaluating, deploying, and maintaining monitoring, alerting, and logging tools for assigned DevOps infrastructure. Support and improve automating deployments of infrastructure services and applications with the design principles of high availability and zero downtime updates.

• Work with users, LC/LLNL security, and other DevOps engineers regarding use of on-premises and third-party, cloud-based AI offerings, while understanding what is available, what LC users want to use, and whether it satisfies LC security.

• Perform other duties as assigned.

• Ability to obtain and maintain a U.S. DOE Q-level security clearance which requires U.S. Citizenship.

• Bachelor’s degree in computer science, computer engineering, or a related field, or the equivalent combination of education and related experience.

• Familiarity with deploying web applications and/or micro-services in a containerized environment (e.g., Docker, Podman, Kubernetes, OpenShift).

• Familiarity with Python, Bash, JavaScript, or similar scripting languages.

• Familiarity with software testing and implementing continuous integration pipelines.

• Fundamental written and verbal communication skills necessary to collaborate effectively in a multi-disciplinary team environment, as well as the ability to work effectively with minimal guidance and as part of a team.

• Familiarity with CI pipelines that automate builds, tests, workflows, tasks or other processes.

• Fundamental knowledge of the Git version control system, including push/pull, rebase, cherry pick, branching.

• Ability to apply established technical methods to well-defined assignments.

• Ability to manage assigned priorities and resolve problems of limited complexity with guidance as needed.

Qualifications We Desire

• Experience with configuration management systems such as Ansible, Puppet, Chef or Salt.

• Familiarity with LC LlamaMe, a Large Language Model inference software stack, and/or familiarity with LC LaunchIT, a full-stack web service provisioning platform.

• Familiarity with OpenShift/Kubernetes GPU device plugins, the Kubernetes scheduler to manage GPU resource allocation, and configuring or supporting LLM workloads on GPU-based systems..

• Familiarity with HPC schedulers such as Slurm and Flux.

Pay Range

$121,830 - $154,500 annually

This is the lowest to highest salary we in good faith believe we would pay for this role at the time of this posting; pay will not be below any applicable local minimum wage.  An employee’s position within the salary range will be based on several factors including, but not limited to, specific competencies, relevant education, qualifications, certifications, experience, skills, seniority, geographic location, performance, and business or organizational needs.