Big Data Platform Engineer

About

Since 2005, Crystal Management provides information technology (IT) infrastructure, systems integration, cybersecurity, facility design and transition, and professional services to customers in the defense, civilian federal agencies, homeland security, intelligence, and commercial sectors. We understand the mission demands innovative approaches, technology, and people. With talented professionals deployed worldwide, Crystal Management delivers IT enterprise solutions, systems engineering, and management consulting services for the largest transformation and restationing programs in defense history. Crystal Management is a service-disabled veteran-owned small business.

Position Summary

DCSA is taking steps to strengthen its position as a key provider of cloud-based and Big Data services to various Consumers. Transformation of its large-scale Big Data infrastructure is a key element of the overall information technology strategy. The Big Data Platform is comprised of an integrated set of platform technologies that provide industry-leading data persistence and analysis capabilities. As a member of the infrastructure team, the Senior Big Data Platform Engineer will play a significant role in helping DCSA transform its Big Data ecosystem that supports applications including Data Analytics Services and other key initiatives.

This telework position is fully remote with occasional travel to the client worksite.

Responsibilities

• Deploy, configure, upgrade, and sustain the development, testing, and production of BDP environments.
• Work with the applications team to deploy and upgrade applications running on the Big Data Platform.
• Provide subject matter expertise to the organization and will perform hands-on engineering and configuration tasks in complex, interdependent environments, and will lead triage, diagnosis, and remediation of platform-related issues.
• Work with our key partners and industry peers to understand and influence industry technical direction in order that Big Data requirements are accommodated.

Education/Certification Requirements

• High School diploma or equivalent education
• DoD 8570 compliant IAT Level 2 baseline certification (e.g., CCNA-Security, CySA+, GICSP, GSEC, Security+ CE, CND, or SSCP)

Required Qualifications

• 9+ years (or commensurate experience) of demonstrated expertise in technology selection, architecture design, engineering and configuration, deployment, operational support, and issue resolution.
• Full stack technical expertise from OS and configuration management through to Big Data ecosystem components such as:
  • Data processing and streaming analytics using Kafka and Storm
  • Platform management plan using RDAs, Containers, Consul, and Airflow
  • Data storage and analytics using Hadoop with YARN, Accumulo, and Apache Spark
  • Manage user accounts and authentication using Citadel, Kerberos, LDAP, and SAML
  • Proxy services using NGINX
  • Deployment automation and configuration management using Puppet and Ansible
  • Expertise with integration and administration of PostgreSQL databases
• Experience operating in an AWS Cloud environment, including administration of EC2 resources, and understanding of key networking concepts such as VPC, subnet, and security groups.
• Understanding of storage concepts such as EBS volumes and S3.
• Strong understanding of security vulnerability detection and remediation using ACAS and DISA STIGs.
• Strong understanding of various encryption technologies.
• Strong experience in Linux-based scripting and systems administration.
• Demonstrated ability to develop sizing and capacity planning for large-scale Big Data Platforms and to periodically evaluate and optimize performance and platform throughput.
• Excellent communications skills, including the ability to handle detailed technical communications and distill complex technical details into executive-level oral and written communications.
  

Preferred Qualifications

• Cloudera Certified Data Engineer (CCDE) certification
• Hortonworks Certified Associate (HCA) certification
• AWS Certified Big Data - Specialty certification
• Experience with Atlassian tools such as Jira and Confluence
• Experience working in an Agile Framework environment

Clearance Requirement

• Active Secret clearance

COVID-19 Safety Protocols: To protect the health and safety of its employees and to comply with customer requirements, employees in certain positions may be required to be fully vaccinated against COVID-19 or subject to facility entry safety protocols (e.g., testing, masking, physical distancing), subject to the status of the federal contractor mandate and customer site requirements.

Crystal Management, LLC provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

#NowHiring

#CoronaVirusHiring