Posted: Tuesday, January 2, 2018 8:29 PM
Job Description Job Overview: The Sr. Hadoop Application Administrator will be an integral member of the platform administration/Dev Ops team within Data as a Service (DaaS) org in Macys Tech. This is a highly technical and hands-on role with responsibility to assist with the design, implementation, tuning and ongoing support of Enterprise Big data platform. The candidate will demonstrate ability to manage large scale Hadoop cluster and insights in to performance tuning of various components in Hadoop eco system, with focus on Hive & spark. Continually strive to improve data systems through pragmatic recommendations of new paradigms and adoption of technologies that enable data discovery, scalable infrastructure and stable environment. Integral to these responsibilities will be an ability to balance and coordinate tactical hands on development and partner with system administrator in operations team for installation, config, day to day support etc. This position requires strong collaboration with data/solution architects, data engineers, DBA, operations advocate, admins and development teams to define requirements and design appropriate systems to support business SLA in alignment with organizations data strategy. Perform other duties as assigned. Essential Functions: Manage large scale Hadoop clusters including design, capacity planning , partner with Ops admin for cluster set up etc. Performance Tuning of the Hadoop cluster & it’s components to meet business SLA. Manage multi-tenant business users in the same cluster. Set up resource management & user queues. Automate monitoring & alerting. Manage the security set up – Kerberos authentication & authorization using Ranger. Establish/socialize access policies within the team and with business partners. Identify and document best practices, standards and guidelines. Deliver solutions in a complex production environment with concurrent considerations such as: o Phased migration, consolidation and parallel production states of disparate legacy data environments. o Maintain, a multi-platform, multi-tenant systems environment for high volume structured and unstructured data ingestion. o Deliver complex and ambiguous business requirements while elevating the system performance to the next level. Evaluate and recommend software & hardware needs for Big Data Platform. Contribute to evolving architecture of our Hadoop eco system with cloud considerations. Partner with release engineer to automate deployments. Create metrics / measurement of utilization and performance. Identify opportunities to define and drive an operationally effective and sustainable environment by assessing internally available toolsets and emerging technology trends. Research and recommend innovative and automated approaches for administrative tasks. Responsible for monitoring the system and fix the bottlenecks proactively as needed. Able to collaborate with internal and external teams/vendors as needed in different time zones. Provide guidance and mentor the technical teams by providing solutions, tuning recommendations and documentation of use cases for continuous improvement. Work directly with project development teams to enable successful project implementation. Work with Architecture and Development teams to understand usage patterns and work load requirements of new projects in order to ensure the Hadoop platform can effectively meet performance requirements and service levels of applications. Develop and enhance platform best practices and educate developers on best practices. Serve as an escalation contact for critical production issues. Perform other work related duties as assigned. Consistently demonstrates regular, dependable attendance & punctuality. Qualifications: Education/Experience: Bachelor’s Degree in Computer Science or other related discipline 7+ years of professional experience supporting production medium to large scale Linux environments 3+ years of professional experience working with Hadoop (HDFS, Sqoop, Hive, Spark) and related open source technology Deep understanding of Hadoop design principles , cluster concepts, security, distributed system performance SQL skills, including experience querying large, complex data sets and performance analysis Experience in networking infrastructure including firewalls, VLANs and load balancers Experience implementing Hadoop in Cloud is a plus Fluency in python, perl , shell scripts and other languages Experience developing highly performant distributed data processing platform with Big Data technologies Experience in the high paced energy of startups as well as experience in the structured world of larger companies Understanding of systems design and technical concepts in order to communicate effectively with other cross-functional teams Strong knowledge and experience with Agile/Scrum methodology and iterative practices in a service delivery lifecycle is a PLUS Communication Skills: Excellent verbal and written communications skills Reasoning Ability: Capable of delivering on multiple competing priorities with little supervision Other Skills: Willing to strive for the ideal design process while still working within the framework of the organization, project, and environment Strong estimating, planning skills and proven ability as a problem-solver Ability and desire to thrive in a proactive, high-pressure, SLA bound environment Work Hours: Ability to work a flexible schedule based on department and store/company needs Company Profile: As the fastest growing part of Macy's Inc. business, macys.com is achieving record sales and broadening our workforce. With offices in New York and San Francisco, macys.com is the best of all worlds. The entrepreneurial thinking of a Web business complements the stability and support of a national brand. Creativity and ingenuity partner with business acumen and tech savvy to build a unique business poised for continued growth. Employees at macys.com have long term opportunities and are encouraged to utilize their Supervisors and Human Resources for cross-functional movement to further their careers. At macys.com we are committed to giving back to the community by partnering with local charitable organizations. By skillfully combining the power of the Internet with the best in retailing, macys.com is reaching new heights. This job description is not all inclusive. Macy’s Inc. reserves the right to amend this job description at any time. Macy's Inc. is an Equal Opportunity Employer, committed to a diverse and inclusive work environment.
• Location: Salt Lake City, West Valley City
• Post ID: 17870092 saltlakecity