Cloud Data Engineer | 977349

OUR GOAL:
Treat our consultants and clients the way we would like others to treat us!
Interested in joining our team? Check out the opportunity below and apply today!
Our Greenville, South Carolina client has a contract opportunity for a Cloud Data Engineer.
Position Purpose/Scope:

• Provides complete application lifecycle development, deployment, and operations support for large- scale batch and real-time data processing pipelines using cloud technologies.
• Collaborates with product owners, data scientists, business analysts and software engineers to design and build solutions to ingest, transform, store, and export data in a cloud environment while maintaining security, scalability, and personal data protection.

Position Responsibilities/Accountabilities:

• Implements and enhances complex data processing pipelines with a focus on collecting, parsing, cleaning, managing and analyzing large data sets that produce valuable business insights and discoveries.
• Determines the required infrastructure, services, and software required to build advanced data
  ingestion & transformation pipelines and solutions in the cloud.
• Assists data scientists and data analysts with data preparation, exploration and analysis activities.
• Applies problem solving experience and knowledge of advanced algorithms to build high- performance, parallel, and distributed solutions.
• Performs code and solution review activities and recommends enhancements that improve efficiency, performance, stability, and decreased support costs.
• Applies the latest DevOps and Agile methodologies to improve delivery time.
• Works with SCRUM teams in daily stand-up, providing progress updates on a frequent basis.
• Supports application, including incident and problem management.
• Performs debugging and triage of incident or problem and deployment of fix to restore services.
• Documents requirements and configurations and clarifies ambiguous specs.
• Performs other duties as assigned by management.

Education:

• BA/BS Degree in Business, Computer Science or Electrical Engineering preferred or the equivalent of 4 years professional IT related experience.
• MS degree (preferred).

Experience:

• 3+ years of enterprise software engineering experience with object oriented design, coding and testing patterns, as well as, experience in engineering (commercial or open source) software platforms and large-scale data infrastructure solutions.
• 3+ years of software engineering and architecture experience within a cloud environment (Azure, AWS).
• 3+ years of enterprise Data Engineering experience within any Big Data environment (preferred).
• 3+ years of software development experience using Python.
• 2+ years of experience working in an Agile environment (Scrum, Lean or Kanban).
• 3+ years of experience working in large-scale data integration and analytics projects, including using cloud (e.g. AWS Redshift, S3, EC2, Glue, Kinesis, EMR) and data-orchestration (e.g. Oozie, Apache Airflow) technologies
• 3+ years of experience in implementing distributed data processing pipelines using Apache Spark.
• 3+ years of experience in designing relational/NoSQL databases and data warehouse solutions
• 2+ years of experience in writing and optimizing SQL queries in a business environment with large- scale, complex datasets
• 2+ years of Unix/Linux operating system knowledge (including shell programming).
• 1+ years of experience in automation/configuration management tools such as Terraform, Puppet or Chef.
• 1+ years of experience in container development and management using Docker.
• Languages: SQL, Python, Spark.

Licenses and/or Certifications:

• AWS/Azure cloud provider training/certifications (preferred).

Knowledge/Skills/Abilities:

• Basic knowledge of continuous integration tools (e.g. Jenkins).
• Basic knowledge of machine learning algorithms and data visualization tools such as Microsoft Power
• BI and Tableau.

Reference: 977349
ABOUT REVEL IT:
Revel IT (formerly known as Fast Switch) is one of the fastest-growing, privately held, IT Staffing companies in the nation. Our client base includes 32% of the Fortune 25. We have major offices in Dublin, OH, Phoenix, AZ, Los Angeles, CA, and Austin, TX and are rapidly expanding into new markets from coast to coast.
WHY REVEL IT:

• In addition to standard health and 401k benefits, we offer referral bonuses and training/continuing education opportunities.
• 5-year client retention: 99%
• No. 1 supplier with customers: 53%
• Top 3 supplier with customers: 77%
• Consultant retention: 94%

Revel IT is an Equal Opportunity Employer. Revel IT does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
#gdr4900