Data Engineer

  • Company:
    Allstate solutions private limited
  • Location:
  • Salary:
    negotiable / month
  • Job type:
    Full-Time
  • Posted:
    1 week ago
  • Category:
    Financial Services/Stockbroking | Banking

Skill: hive , pig , sql , d3.js , java , big data , mongodb , hbase , python , machine learning , javascript , ruby , nosql , cassandra , infrastructure; Exp: 4-7 years; Data Engineer Date Opened May 18, 2018 Location Bangalore, Karnataka, India Company Allstate Insurance Company We are looking for technically savvy Data Engineers who would be driven by passion to aid building of the business data collection systems and processing pipelines. Data Engineer is responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data Sciences and Analytics teams. Technical Requirements 1-4 years of experience of data engineering and Big Data systems Proficient understanding of distributed computing principles Hands on experience in programming or scripting languages like Java, Javascript, Ruby, Python, R Good knowledge of various ETL techniques and frameworks Experience on Data Visualisation frameworks like D3.js Experience with NoSQL databases such as HBase, Cassandra, MongoDB Experience with Machine Learning toolkits such as Mahout, SparkML, H2O Good Knowledge of Big data querying tools such as Hive, Pig Serious expertise in SQL Responsibilities and job related expectations Ability to manage and access highly scalable Big Data solutions that can collect, store, process & analyze huge sets of data. Be responsible for set up, maintenance and running Big Data Infrastructure, ETL workflows, highly available and scalable data systems that supports Data Sciences and teams that would use the infrastructure Responsible for designing and developing scalable ETL packages from the business source systems and the development of ETL routines in order to populate databases from sources and also to create aggregates. Partner with Data Scientist and Analytics professionals, designers, project managers, QA engineers, operations engineers, third party systems providers and other stakeholders in the Data ecosystem of the organization to ensure timely and correct access to data when needed. To be able to build scalable data access mechanism to achieve industrialization that would make data access easier for the Data Science and Analytics teams. Able to work on automation options for data access and data preparation. The person shall strive to continuously develop new and improved data engineering capabilities.

Software Engineer

Degree: 

Experience: 4-7

Function: IT Software : Software Products & Services