Data Engineer

TestYantra Software SolutionsKraków, Lesser PolandOn-siteContractListed 1 hour ago

Apply now

About this role

We’re looking for a Data Engineer to build the data model and pipelines that underpin Client’s enterprise Knowledge Catalogue and Knowledge Manager experience. You’ll organise and connect information about domains, sub-domains, Knowledge Stewards, projects, sources, ownership, overlaps, status and lifecycle, making it easier for users and approved applications to discover, understand and consume trusted knowledge.

What you’ll do

• Design and build the Knowledge Catalogue data model covering domains, sub-domains, Stewards, projects, sources, ownership, overlaps, status and lifecycle.

• Develop reliable pipelines to ingest, transform, enrich and maintain catalogue information from approved platform and BGI sources.

• Integrate catalogue data with Knowledge Manager, metadata, ontology, quality, publication, search and retrieval services.

• Implement data-quality, lineage, provenance, access and lifecycle controls to keep catalogue information trusted and current.

• Enable catalogue capabilities for browsing, semantic discovery, knowledge context, feedback and knowledge-health insights.

• Work with Knowledge Source Analysts, Knowledge Stewards, architects, engineers and BGI project teams to agree data requirements and resolve quality or ownership issues.

• Contribute to APIs, testing, monitoring, documentation and operational processes for catalogue data services.

What you need to have to succeed in this role

• Proven experience as a Data Engineer or in a similar role delivering production-grade data models and pipelines.

• Strong experience with SQL, Python and data-processing technologies, including structured and semi-structured data.

• Experience designing data models and pipelines for catalogues, metadata, data governance, knowledge management or enterprise platforms.

• Practical understanding of data quality, lineage, provenance, ownership, access controls and lifecycle management.

• Experience integrating data through APIs, databases, event streams or cloud data platforms.

• Familiarity with knowledge graphs, ontologies, semantic search, graph databases or vector platforms is advantageous.

• Experience with data catalogues, search platforms, workflow tools or enterprise information systems is desirable.

• Strong collaboration and communication skills, with the ability to work across product, architecture, engineering, Knowledge Steward and BGI teams.