Data Engineer

Role: Data Engineer

Request-ID: 15122-1

Onsite - Bentonville, AR

Mandatory Areas

Must Have Skills -

Hadoop- 5+ Yrs of Exp

Scala - 4+ Yrs of Exp

GCP -3+ Yrs of Exp

Hive- 4+Yrs of Exp

SQL - 3+ Yrs of Exp

strategic data planning, standards, procedures, and governance- 2+ Yrs

ETL Process / Data Pipeline - 4+ Years of experience

JD:

Client is looking for a Data Engineer strong background in data projects. The ideal candidate should be an expert in leading projects in developing and testing data pipelines, data analytics efforts, proactive issue identification and resolution and alerting mechanism using traditional, new and emerging technologies. Excellent written and verbal communication skills and ability to liaise with technologists to executives is key to be successful in this role.

As a Data Engineer at UST Global, this is your opportunity to

• Assembling large to complex sets of data that meet non-functional and functional requirements
• Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Building required infrastructure for optimal extraction, transformation and loading of data from various data sources
• Building analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
• Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
• Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
• work on a multi-vendor multi-geo team support one of the complex enterprise environment

Mandatory Skill sets

• Technology expectations

o 5 + years of experience in Hadoop/Big Data

o 2+ years of experience in strategic data planning, standards, procedures, and governance

o 4+ years of hands-on experience in Python or Scala

o 3+ years of experience in writing and tuning SQLs, Spark queries

o Experience in understanding and managing Hadoop Log Files, Hadoop multiple data processing engines.

o Experience in analysing data in HDFS through Map Reduce, Hive and Pig

o Experience with scripting languages: Python, Scala, etc.

o 3+ experience in GCP environment

• Other required skills

o Strong verbal and written communication skills to effectively share findings with shareholders.

o Good understanding of web-based application development

o Should be an independent contributor from day one.

o A bachelor's degree in computer science or relevant fields is mandatory.

o Should be hands on and be able to work in an agile, fast moving environment.