Job Description
Candidate should have handson Hadoop admin knowledge in CDHand/or CDP environment (Cloudera Distribution) and hands-on experience withCDH-CDP Upgrade or any other upgrade from lower version to higher version inCloudera Distribution
Candidate should have knowledge in below ecosystem
? Hive
? Impala
? Spark
Should able to perform below activities :-
- Collaborating with application teams for Hadoop updates, patches, version upgrades when required.
- Maintain security for Hadoop clusters and implementing SSL authentication
- Capacity Planning and Hardware requirement of the nodes, Network architecture and Planning.
- Hadoop Software Installation and configuration in Cloudera Distribution
- Tuning of Hadoop Cluster and creating new users in Hadoop, handling permissions, performance upgrades.
- Hadoop Backup and Recovery tasks
- Every day finding out which jobs are taking more time, if users say that jobs are stuck to find out the reason.
- Health check of Hadoop cluster Monitoring
- Deployment in Hadoop Cluster and maintaining it.
- Support and maintenance of Hadoop Storage (HDFS)
- Security administration during installation and basic knowledge on Kerberos and Apache Ranger etc.
- Manage Hadoop Log files and analyzing failed jobs
- Troubleshoot Network and applications
- Knowledge on Scripting Skills on Linux environment
- Configuring Name Node, Data Nodes to ensure its high availability.
- Performance tuning of Hadoop clusters
- Screen Hadoop cluster job performances and capacity planning
- Need to solve Vulnerabilities for Hadoop cluster
Job ID: 58014