About this role
About the Role:
Triunity Software is looking for a talented and passionate AI/ML Engineer to join our growing team in New Jersey! This is an exciting opportunity to work on cutting-edge artificial intelligence and machine learning solutions that drive real-world impact. If you thrive in a fast-paced, innovative environment and love turning complex data into intelligent systems, we want to hear from you.
Key Technical Requirements
• Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
• Hands-on experience with LLM/Generative AI application development.
• Strong experience in Retrieval-Augmented Generation (RAG), embedding models, indexing strategies, and retrieval optimization.
• Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
• Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
• Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
• Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
• Exposure to enterprise security, compliance, and governance requirements.
Preferred Technical Skills
• FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
• AgentCore and Agentic AI.
• Kubernetes, Helm, Terraform, and CI/CD.
• Apache Kafka and event-driven architecture.
• Datadog and OpenTelemetry.
• Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
• Experience in financial services, insurance, healthcare, or other regulated industries.
Experience Requirements
• Minimum 5+ years of overall software engineering experience.
• Minimum 2+ years of hands-on LLM/Generative AI development experience.
• Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
• Exposure to enterprise security and compliance reviews.