Consultant- Hadoop Developer

  • Company:
    General Mills Inc.
  • Location:
  • Salary:
    negotiable / month
  • Job type:
    Full-Time
  • Posted:
    2 weeks ago
  • Category:
    Retailing | Agriculture/Forestry/Fishing

Skill: hive , scala , pig , sql , mysql , hadoop , technical skills , hbase , python , oracle , oozie , mapreduce , hdfs; Exp: 2-5 years; Overview & Responsibilities Qualifications Overview & Responsibilities Job Responsibilities Turn information into insight for improved business performance by consulting with architects, solution managers, and analysts to understand business technical needs and deliver solutions Design, create, code, and support a variety of Hadoop ETL solutions (potentially including but not limited to Python, Scala, Kafka, Informatica, Talend, or others) Create and maintain development patterns, standards, processes and norms. Analyze existing processes and user development requirements to ensure maximum efficiency. Demonstrate the ability to build a work plan or parts of a work plan, as applicable for role. Implement small projects and contribute to the implementation of medium/large projects. Work with the team to design, code and test ETL solutions and stored procedures for the reference architecture Diagnose problems and restore service promptly to Data Lake users, operating within agreed SLAs. Work with system users, other members of the IT Dept., software vendors, & service providers to resolve problems. Carry out assigned activities during system releases and system upgrades. Embrace a Continuous Improvement mentality to streamline and eliminate waste in all processes Demonstrate initiative and ownership by proactively resolving issues and taking on multiple work plan tasks Effective communications with both technical and business communities Maintain strong technical skills and share knowledge with team members Qualifications Education Minimum Degree Requirements Bachelors Preferred Degree Requirements Bachelors Preferred Major Area of Study Engineering Experience Minimum years of Hadoop experience required 2 years Preferred years of Data ware house experience 4 or more years Specific Job Experience or Skills Needed (Done) Mandatory Skills o HDFS, MapReduce, YARN, Pig, Hive, HBase, Zookeeper, Oozie o Oracle, MySQL, SQL, No SQL, Stored Procedures o Python or Scala o Strong ETL Experience o Spark, Spark Streaming o Kafka o Data Modeling (Basic Level) experience o Data Standardization/Canonical Data Format definition o Data Integration Patterns o Data Quality Solutions o Performance Benchmarking and Tuning o Data Conversion and Migration between different databases

Software Engineer

Degree: 

Experience: 2-5

Function: IT Software : Software Products & Services