Platform Admin

Job Requirements

The Platform Admin is responsible for managing and maintaining the Hadoop infrastructure, ensuring optimal performance, scalability, and reliability of the data platform. This role involves capacity planning, cluster deployment, performance tuning, and coordination with internal and external teams to ensure smooth service delivery. The admin also plays a key role in monitoring, troubleshooting, and securing the Hadoop ecosystem.

Key Responsibilities

Primary Responsibilities

- Deploy and manage Hadoop clusters (preferably CDH/CDP), including adding/removing nodes and configuring NameNode HA.
- Monitor cluster health, track jobs, and schedule/configure backups.
- Perform capacity planning and estimate requirements for scaling the Hadoop cluster.
- Troubleshoot system issues and understand system capacity, bottlenecks, and performance metrics across memory, CPU, OS, storage, and networks.
- Administer Hadoop stack components such as Hive, Impala, HBase, NiFi, etc.
- Ensure Linux proficiency for managing Hadoop environments.
- Use open-source configuration and deployment tools like Jenkins, Puppet/Chef, and Linux scripting.
- Implement and maintain Hadoop infrastructure and align with engineering teams to propose and deploy required environments.
- Set up new Hadoop users, including Linux user creation, Kerberos principal setup, and service testing.
- Perform cluster maintenance using Cloudera Manager.
- Tune performance for Hadoop clusters and MapReduce routines.
- Monitor cluster connectivity and security, manage logs and storage.
- Collaborate with infrastructure, network, database, application, and BI teams to ensure high data availability.

Secondary Responsibilities

- Software installation and configuration.
- Database backup and recovery.
- Database connectivity and security.
- Performance monitoring and tuning.
- Disk space management.

What We Are Looking For

Education

- Bachelor’s or master’s degree in computer science or Engineering or Statistics or Economics

Experience

- 2 to 5 years of relevant experience in platform administration or Hadoop infrastructure management.

Skills and Attributes

- Strong expertise in Hadoop ecosystem and Linux administration.
- Proficiency in cluster deployment, monitoring, and performance tuning.
- Familiarity with scripting and automation tools.
- Excellent troubleshooting and problem-solving skills.
- Effective communication and coordination abilities.
- Understanding of data security, governance, and compliance.

Key Success Metrics

- Timely and successful delivery of platform-related projects.
- High-quality, error-free infrastructure management.
- Effective resolution of data and system issues.

###