About this role
About Ascendion India Pvt. Ltd.
- Ascendion India Pvt. Ltd. is a leading technology company specializing in innovative solutions and services. We are committed to delivering excellence and driving digital transformation for our clients worldwide.
- Our offices are located in Bangalore, Pune, Chennai, and Hyderabad, offering a dynamic work environment and opportunities for growth.
Job Title: Data/ETL Engineer
- Design, build, and maintain scalable data pipelines for AI/ML applications.
- Develop ETL/ELT workflows to ingest data from databases, APIs, files, and streaming systems.
- Prepare, clean, transform, and validate data for machine learning and Generative AI use cases.
- Build data platforms and pipelines using Python, SQL, Spark, and cloud technologies.
- Work with structured and unstructured data, including documents, text, logs, and embeddings.
- Build and maintain data lakes, data warehouses, and lakehouse architectures.
- Develop data pipelines for LLM/RAG applications, including document ingestion, chunking, metadata extraction, embedding generation, and vector storage.
- Integrate AI/ML models and APIs into production data workflows.
- Implement data quality, governance, security, lineage, and monitoring.
- Optimize pipeline performance, storage, and cloud costs.
- Collaborate with Data Scientists, ML Engineers, Software Engineers, and business teams.
- Deploy and monitor production data/AI pipelines using CI/CD and DevOps practices.
Required Skills: 1. Programming
- Python — mandatory
- SQL — advanced
- Bash/Linux
- Familiarity with REST APIs and JSON
2. Data Engineering
- ETL/ELT pipeline development
- Apache Spark / PySpark
- Apache Airflow or similar orchestration tools
- Kafka or other streaming technologies
- Data modeling
- Data quality and validation
- Batch and real-time processing
3. Databases & Storage
- PostgreSQL / MySQL
- NoSQL databases such as MongoDB
- Data warehouses: Snowflake, BigQuery, Redshift, or Databricks
- Data lakes: S3, ADLS, or GCS
- Parquet and other data formats