HADOOP Administrator

Company: Experis
Location: Jersey City
Posted on: January 12, 2021

Job Description:

Description: Hadoop administratorThe Hadoop administrator is responsible for the care, maintenance, administration and reliability of the Hadoop ecosystem. The role will be responsible to work as part of 24X7 shift to provide Hadoop Platform Support and Perform Administrative on Production Hadoop clusters. The role includes ensuring system availability, security, stability, reliability, capacity planning, recoverability (protecting business data) and performance. In addition to providing new system and data management solution delivery to meet the growing and evolving data demands of the enterprise.Essential job Skills:* Hadoop administrator using Cloudera, Administers Hadoop technology and systems responsible for backup, recovery, architecture, performance tuning, security, auditing, metadata management, optimization, statistics, capacity planning, connectivity and other data solutions of Hadoop systems* Responsible for installation and ongoing administration of Hadoop infrastructure* Propose and deploy new hardware and software environments required for Hadoop and to expand existing environments as the need arises. Provision new users, groups and roles and setting up Kerberos principals using Active Directory* Addition and deletion of nodes from Hadoop clusters. Monitoring Hadoop eco-system* Kafka Administration, add/delete new brokers, rebalance Kafka topics workload, setup SSL, security on Kafka brokers* Monitor & Troubleshoot Kafka workload* Log Files and file systems management, HDFS, storage management and capacity planning* Troubleshooting and resolving application errors* Ensure the High Availability and performance of Hadoop clusters* Responsible for data movement in and out of Hadoop clusters* Perform Backup and recovery for the META data store, databases and configuration files* Data modeling, designing and implementation of HIVE, Impala SQL tables* Installing security patches, upgrading software on release schedules* Automation of manual tasks. Experience of automation tools such as Ansible, Chef, Puppet or SALT Stack* Monitor Health check of all the Hadoop clusters.* Thorough knowledge of Hadoop overall architecture, its key components such as HDFS, YARN, Sqoop, HIVE, Impala, Spark, Cloudera Manager etc---* Ability to effectively collaborate with Data Engineers, Data Scientists, System Administrators, Storage Administrators, Network team, vendors etc---* A solid background in Linux shell scripting and system administration* Excellent communication and Problem solving skills* Ability to work with Senior Enterprise Architects to develop a Big Data platform* 10+ year experience in large-scale Relational database administration dealing with data warehousing systems* 4+ year experience in Hadoop (Cloudera preferred)* Hadoop Certification is preferred

Keywords: Experis, Jersey City , HADOOP Administrator, Other , Jersey City, New Jersey