Skip to main contentA logo with &quat;the muse&quat; in dark blue text.

Software Observability Engineer - Elasticsearch/Kibana

AT HRL Laboratories
HRL Laboratories

Software Observability Engineer - Elasticsearch/Kibana

Malibu, CA

General Description:
We're looking for an Observability Engineer skilled in Elasticsearch, Kibana, and Python to manage and optimize our on-prem observability stack. You'll build dashboards, set up alerts, automate workflows, and ensure Elastic Stack performance (including APM). Experience with Grafana, NoSQL, and relational databases is key. Your work will support internal teams advancing quantum physics research.

Essential Duties:
Manage and optimize on-prem Elasticsearch clusters for performance, scalability, and reliability.
Design and implement Kibana and Grafana dashboards and visualizations for monitoring, alerting, and analysis of key metrics
Integrate and configure APM solutions within the Elastic Stack to monitor application performance.

Want more jobs like this?

Get Science and Engineering jobs in Malibu, CA delivered to your inbox every week.

By signing up, you agree to our Terms of Service & Privacy Policy.

Set up and maintain alerting systems in Kibana and Grafana to proactively monitor system health and performance.
Automate tasks and integrate systems using Python scripts.
Troubleshoot and resolve issues within Elasticsearch, Kibana, and observability tools.

Required Skills:
5+ years of experience with Elasticsearch and Kibana in production environments, or similar stack (DataDog, Splunk, Humio, etc.).
Proficiency in Python for automation, scripting, and system integration.
Experience configuring and managing APM solutions within the Elastic Stack, or similar.
Strong experience with Grafana for visualizing metrics and monitoring system health.
Expertise in setting up and managing alerting systems within Kibana, or similar.
Strong knowledge of Elasticsearch indexing, query optimization, and cluster management.
Hands-on experience building and maintaining Kibana dashboards for observability and alerting.
Familiarity with observability tools and best practices for monitoring application and infrastructure performance.
Working knowledge of NoSQL and relational databases (e.g., MongoDB, PostgreSQL, MySQL)
Experience with other Elastic Stack tools like Logstash, Beats, or Elastic Agent.
Experience with distributed systems and large-scale data processing.
Understanding of data security, compliance, and access control.
Familiarity with Gitlab CI/CD pipelines
Experience interfacing with hardware devices and embedded systems (e.g., RS-232, serial protocols, telemetry extraction)

Required Education:
Bachelor's degree in Computer Science, Engineering, a related technical field, or equivalent practical experience.

Special Requirements:
US Citizenship Required
The ability to obtain and maintain a US Government Security Clearance is required.

Compensation:
The base salary range for this full-time position is $132,765 - $165,983 + bonus + benefits.
Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range during the hiring process. Please note that the compensation details listed reflect the base salary only, and do not include potential bonus or benefits.

Client-provided location(s): Malibu, CA, USA
Job ID: HRL_Labs-77c94e06-b27a-4b05-bdfe-05b0b3d641fc
Employment Type: Other

Perks and Benefits

  • Health and Wellness

    • Health Insurance
    • Dental Insurance
    • Vision Insurance
    • Life Insurance
    • Short-Term Disability
    • Long-Term Disability
    • HSA
    • HSA With Employer Contribution
    • Fitness Subsidies
    • On-Site Gym
    • Mental Health Benefits
    • FSA
  • Parental Benefits

    • Birth Parent or Maternity Leave
    • Non-Birth Parent or Paternity Leave
    • Family Support Resources
  • Work Flexibility

    • Hybrid Work Opportunities
    • Flexible Work Hours
    • Four-Day Work Week
  • Office Life and Perks

    • Commuter Benefits Program
    • Casual Dress
    • Happy Hours
    • Snacks
    • Some Meals Provided
    • Company Outings
    • On-Site Cafeteria
    • Holiday Events
  • Vacation and Time Off

    • Paid Vacation
    • Paid Holidays
    • Personal/Sick Days
    • Leave of Absence
  • Financial and Retirement

    • 401(K)
    • 401(K) With Company Matching
    • Performance Bonus
    • Relocation Assistance
    • Financial Counseling
  • Professional Development

    • Tuition Reimbursement
    • Learning and Development Stipend
    • Promote From Within
    • Lunch and Learns
    • Internship Program
    • Leadership Training Program
    • Professional Coaching
    • Mentor Program
    • Shadowing Opportunities
    • Access to Online Courses
  • Diversity and Inclusion

    • Employee Resource Groups (ERG)
    • Unconscious Bias Training
    • Diversity, Equity, and Inclusion Program