Collibra Data Lineage Automation Engineer Job at Alignity Solutions, Mc Lean, IL

aVVxd3A1TGpoZEs5R3NJNUJvaUlIY0hzdnc9PQ==
  • Alignity Solutions
  • Mc Lean, IL

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the   meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Collibra  Data Lineage Automation Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title:  Collibra  Data Lineage Automation Engineer

Location: Onsite – 5 days/week in McLean, VA

Work Type: 1099 / C2C / W2

Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra  Data Lineage Automation Engineer   to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI/ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

  • Lead the implementation of automated lineage across diverse systems:

    • Cloud platforms (e.g., Snowflake, AWS )

    • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

    • NoSQL databases (e.g., MongoDB)

    • BI/reporting tools (e.g., Tableau, Power BI)

  • Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

  • Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

  • Integrate lineage with metadata/governance platforms ( Collibra, Alation ) to ensure usability and traceability.

  • Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

  • Develop reusable lineage components and promote automation-first, reusable design principles.

  • Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

  • Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

  • Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

  • Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

  • Strong AI/ML background , with experience in:

    • Metadata intelligence

    • NLP-based code parsing

    • Pattern detection in lineage gaps

  • Programming expertise in Python, Scala, or Java .

  • Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

  • Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

  • Hands-on experience with commercial lineage tools (evaluation or implementation).

  • Background in regulated industries (finance, healthcare, insurance).

  • Familiarity with event-driven architectures for real-time lineage propagation.

  • Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

  • Has successfully delivered automated lineage at enterprise scale .

  • Operates at the intersection of data engineering, metadata management, and AI innovation .

  • Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

  • Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at  . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message:   Click Here

Clients Testimonial:   Click Here

Job Tags

Contract work, H1b,

Similar Jobs