About this role
Title: AI Python Developer Experience: 4+ Years Location: Hyderabad
## About the Role
P99Soft is looking for a skilled AI Python Developer with strong expertise in Python development, Generative AI, and LLM testing. The ideal candidate should have hands-on experience with agentic AI applications, Retrieval-Augmented Generation (RAG), prompt testing, and validating LLM outputs using AWS services and modern AI frameworks.
## Key Responsibilities
- Develop and test agentic AI applications and Generative AI solutions using Python.
- Validate LLM outputs, prompts, and RAG pipelines for accuracy, relevance, and reliability.
- Use Amazon Bedrock and AWS SDK for Python (boto3) to test and evaluate LLM responses.
- Work with frameworks such as LangChain and Strands to develop and validate AI workflows.
- Use evaluation libraries such as Ragas and Deepchecks to assess GenAI application quality.
- Ensure stable deployment of AI applications on Amazon ECS/EKS using Docker.
- Monitor application performance, errors, and operational metrics using Amazon CloudWatch.
- Work with AWS services, including SageMaker and Lambda, to support AI application development and deployment.
- Collaborate with development teams to improve AI application quality, reliability, and performance.
Required Skills & Qualifications
- 4+ years of hands-on Python development experience.
- Minimum 2 years of experience testing Generative AI applications and LLMs using Python.
- Strong expertise in AWS Bedrock, SageMaker, Lambda, and boto3.
- Experience with LangChain, Strands, or similar AI frameworks.
- Hands-on experience testing RAG pipelines, prompts, and LLM outputs.
- Experience with Docker and deployment environments such as Amazon ECS/EKS.
- Knowledge of Amazon CloudWatch for monitoring application performance.
Good to Have
- UI development experience.
- Experience with GenAI evaluation frameworks such as Ragas and Deepchecks.
- Exposure to agentic workflows and AI application observability.
Preferred Candidate: A hands-on Python developer with strong GenAI testing experience who can evaluate LLM-based applications, validate agentic workflows, and help ensure reliable deployment and operation of AI solutions on AWS. Benefits: Competitive salary and performance-based bonuses. Comprehensive health insurance. Paid time off and flexible working hours. Professional development opportunities and support for continuing education. Udemy Learning Licenses to enhance skills and stay up-to-date with the latest technology. P99soft is an equal-opportunity employer P99soft is an equal-opportunity employer. At P99soft, we are committed to providing equal employment opportunities regardless of job history, disability, gender identity, religion, race, color, caste, marital/parental status, veteran status, or any other special status. We stand against the discrimination of employees and individuals and are proud to be an equitable workplace that welcomes individuals from all walks of life if they fit the designated roles and responsibilities. Life@P99soft At P99soft, we believe in creating a work environment that balances professional excellence with personal well-being. Our vibrant office culture is built on mutual respect, inclusivity, and a shared passion for innovation. We host regular team-building activities, workshops, and social events to foster a sense of community and collaboration among our employees. Join us and be part of a team that values your contributions and supports your growth About Us P99soft is a leading IT Services and IT Consulting company dedicated to making our customers' business operations seamless by providing them with digital services and applications using the latest technologies. We are committed to bringing excellence to all our creations. We need passion, empathy, and being customer-focused to achieve technical excellence. We believe in transparency through open communication and work with honesty and integrity while dealing with our customers and partners. Our Vision: “To lead digital transformation for our customers, delighting them at every step, while empowering our employees and fostering success.” Our Mission: “To attain our objectives within a framework of integrity, transparency, and respect for our clients, employees, partners, and the community, fostering mutual trust and sustainable growth.” Journey towards digital transformations begins here. Our talented teams help you make informed decisions, enhance operation efficiencies, create state-of-the-art visual interfaces, and design dynamic workflows to bring a better customer experience. Our engineering teams take complete ownership of assigning the right talent and architecting solutions using the latest technologies.
