Sr DevOps Engineer – Hadoop/Cloudera

Key Responsibilities

• Design, develop, test, document, and debug infrastructure as code and configuration management patterns.

• Create and maintain comprehensive documentation and technical policies that outline best practices for implemented configurations.

• Analyze requirements and design models for infrastructure and application workflows.

• Participate in design meetings to gather technical requirements and translate them into functional specifications.

• Evaluate and implement new technologies to improve system performance, simplify operations, and enhance security.

• Analyze bugs and system failures, diagnose root causes, and continuously optimize automation pipelines.

• Troubleshoot and resolve hardware issues (e.g., disk failures, CPU/memory faults) and escalate when necessary.

• Collaborate with end users to refine, test, and debug systems based on their needs.

• Proactively monitor environment health and implement enhancements to performance and reliability.

• Mentor and coach team members on internal procedures, patterns, and best practices.

• Contribute to product maintenance and feature enhancements.

• Participate in change management procedures and ensure compliance.

• Uphold risk management protocols and safeguard data integrity and confidentiality.

Minimum Qualifications

• Bachelor’s degree in Computer Science or equivalent professional certifications.

• 7+ years of relevant experience in DevOps, software engineering, or infrastructure roles.

• Experience designing modern application architectures and working across multiple projects.

• Proficiency in Linux system administration and scripting (e.g., Bash).

• Hands-on experience with automation and configuration tools such as Chef, Ansible, or Puppet.

• Working knowledge of Infrastructure as Code tools (Terraform), containerization (Docker), and orchestration (Kubernetes).

• Familiarity with at least one major cloud provider (AWS, GCP, or Azure).

• Experience with encryption and security protocols.

• Availability to participate in on-call rotations and work varied schedules.

• Strong communication skills and ability to lead technical design sessions.

Preferred Qualifications

• Experience architecting and managing Hadoop clusters both on-premises and in the cloud.

• Expertise with NoSQL technologies like HBase, Aerospike, SOLR, and Redshift.

• Implementation of security controls for distributed systems in compliance with PCI standards.

• Proficient in using Infrastructure as Code tools (Terraform, Ansible) for building and supporting data platforms.

• Familiarity with Kafka and related big data tools.

Work Environment & Physical Requirements

• This role is primarily office-based with standard working hours and may involve extended computer usage.

• Occasional standing, walking, or lifting of items up to 10 pounds may be required.

• The position requires visual acuity and communication skills necessary for a professional work environment.

• Reasonable accommodations will be provided as needed.

Compensation

• Phoenix, AZ / Chicago, IL: $130,000 – $145,000 annually

• New York, NY / San Francisco, CA: $145,000 – $165,000 annually

• Remote: $130,000 – $165,000 annually (depending on location and experience)

Final compensation will be determined based on location, experience, education, internal equity, and market factors. Candidates may also be eligible for discretionary bonuses and other incentives.

Benefits & Perks

• Health & Wellness: Comprehensive medical (PPO/HDHP), dental, and vision coverage. Company HSA contributions and FSAs for healthcare, dependent care, and commuting expenses.

• Retirement: 401(k) plan with competitive company match.