Sr.Data Engineer

Wavicle Data Solutions, Knoxville, TN (United States)

Category: Programming

Posted on: 20 Nov 2020

Cloud Hadoop Java Python SQL

Job Description

About Wavicle :

Wavicle Data Solutions is built upon the principle that modern organizations rely on data to drive their businesses, yet not every company has the time, staff, or knowledge to leverage this valuable resource. Wavicles driving purpose is to help these organizations craft custom data solutions focused on Big Data, Cloud and Analytics. Solutions that help companies gain deep insights from their data that position them to make todays business decisions and gives them the knowledge to predict future trends.

Role:

    Design and develop data pipeline architectures using Hadoop, Spark and related AWS services.Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of sources Hadoop, Spark, AWS Lambda, etc.Build cloud data lakes using services like EMR, Lambda, Redshift, Kafka, etc. in AWSKnowledge or experience in architectural best practices in building data lakes.Load and performance test data pipelines built using the above-mentioned technologiesExpert-level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data.Strong problem solving and troubleshooting skills with the ability to exercise mature judgment.Hands-on experience and background in developing applications using Java, Python or any other programming language.

Requirements


    Experience with Big Data technologies and ETL toolsHands on Experience with Python and Spark is mustGood understanding of the AWS environment



Want more jobs like this?

Apply Now

By clicking "Apply Now" or "Subscribe and Apply" you will be redirected to an external website. By clicking "Subscribe & Apply" you give TechieJobs consent to process and store your data, and send you job alerts to provided email.

Job Source: Ziprecruiter (Will expire by: 2021-01-04 00:00:00)

Apply Now

Quick poll
How did COVID-19 affect your employment?
  • Nothing's changed
  • I now work from home
  • My salary decreased
  • I lost my job

* This poll is anonymous.