Big Data Infrastructure Engineer(EKS/Databricks) Job at Insight Global, Glendale, CA

Z2t5eXBaZm1odDY1SDhRNENvMkpHc0hzdXc9PQ==
  • Insight Global
  • Glendale, CA

Job Description

Job Description The Ad Infrastructure team is looking for a seasoned Data Software Engineer to help build and scale our data processing platforms. Project Outline: Moving Data from AWS/EKS(Kubernetes) into Databricks platform. What Youll Do: - Design, build, and maintain infrastructure automation and tooling that enables developers to deploy and operate cloud-native applications. - Implement best practices for secure, scalable, and cost-efficient cloud operations across AWS. - Contribute to and maintain a robust library of shared Terraform modules and infrastructure-as-code standards. - Participate in root cause analyses (RCAs) and postmortems to continuously improve reliability and operational practices. - Support container orchestration and workload scaling on Kubernetes (EKS) for Spark and Flink jobs. - Collaborate with development teams to ensure seamless onboarding and operational support for infrastructure tooling and platforms. - Participate in on-call rotations and own uptime and reliability of key systems. - Drive adoption of DevOps practices, including CI/CD workflows, observability, and incident management We are a company committed to creating inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity employer that believes everyone matters. Qualified candidates will receive consideration for employment opportunities without regard to race, religion, sex, age, marital status, national origin, sexual orientation, citizenship status, disability, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to Human Resources Request Form ( . The EEOC "Know Your Rights" Poster is available here ( . To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: . Skills and Requirements - 7 plus years of experience in infrastructure engineering, DevOps, or cloud-native software engineering. - 4 plus years of hands-on experience with Kubernetes, preferably on Amazon EKS. - 3 plus years of experience with Python or Go for infrastructure automation. - 3 plus years working with data processing frameworks such as Apache Airflow, Spark, or Flink. - 2 plus years designing and operating Databricks environments at scale on AWS, including performance tuning and securing workloads. - Expertise in AWS services (EC2, S3, IAM, VPC, etc.), infrastructure automation, and Terraform. - Experience with container technologies (Docker) and CI/CD tools like Spinnaker. - Strong communication skills and a collaborative mindset for working across engineering teams. - Hybrid to a local Disney hub: Glendale, SF, Seattle, - AWS Certifications (e.g., Solutions Architect, DevOps Engineer). - Familiarity with all three: Airflow, Spark, and Flink. - Experience operating service mesh technologies like Istio. - Experience running Spark or Flink workloads on Databricks. null We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.

Job Tags

Local area,

Similar Jobs

The Love.

Busser Job at The Love.

 ...Affiliated with STARR Restaurants, The Love , a bilevel sanctuary features a one-of-a-kind beverage program inspired by personal travels...  ...beloved Talulas Garden and Talulas Daily is now seeking Busser s who have a passion for great food, wine, and hospitality.... 

Aspen Windows

Entry Level Sales-Canvassing Job at Aspen Windows

Door To Door Canvasser: THIS IS IMPORTANT If you want to feel valued and appreciated , live with purpose, and refuse to settle for mediocrity, then your search is overyouve found what youre looking for! WHO WE NEED Our focus isnt on just hiring...

Actalent

Gas Technician Job at Actalent

Job Title: Gas TechnicianJob DescriptionAs a Gas Technician, you will work on projects related to landfill gas collection and control systems. You will monitor and maintain gas extraction systems to ensure compliance with environmental regulations and prevent the release... 

Burgess Construction

Construction Assistant Job at Burgess Construction

Join the crew that builds backyards people love.At Burgess Construction, we specialize in custom decks and outdoor living spaces that...  ...who want to kick-start a hands-on career in construction. No experience in deck building? No problem. If you show up ready to learn and... 

Adelphi Staffing, LLC

Neurologist Job at Adelphi Staffing, LLC

JOB OVERVIEW Job Title: Physician Neurology Job Type: Permanent (W-2) Location: Shreveport, LA Service Setting: Inpatient and Outpatient Coverage Type: Clinical + Call Coverage Period: Ongoing PATIENT INFORMATION Patient Demographics...