Senior Data Engineer

Overview

The Data Platform Team looks to raise the level and productivity of Data Engineering and data science by building, scaling, and supporting our big data infrastructure with an emphasis on simple and efficient solutions on top of complex distributed data stores. As a contributing Senior Data Engineer, you will assist in architecting, designing, and implementing components within our cloud data platform expanding our data assets while continuously improving the architecture and processes around our daily operations.        

Responsibilities

• Create cloud and big data technical design recommendations for developing and integrating new software and system technologies - from the physical layer through to the virtual layer - per written specifications; test, evaluate, engineer, implement and support said technologies.
• Review, influence and contribute to new and evolving design, architecture, standards, and methods for operating and contributing to services within our big data ecosystem.
• Add to our existing business and data models. Reviews existing designs and processes to highlight more efficient ways to complete existing workload more effectively through industry perspectives.
• Drive technical innovation and efficiency in infrastructure operations through automation by assisting in improvements to continuous integration, continuous deployment and
• Create cloud and big data technical design recommendations for developing and integrating new software and system technologies - from the physical layer through to the virtual layer - per written specifications; test, evaluate, engineer, implement and support those technologies
• Collaborates with technical teams and utilizes system expertise to deliver technical solutions, continuously learning and evolving big data skillsets.
• Monitors and evaluates overall strategic data infrastructure; tracks system efficiency and reliability; identifies and recommends efficiency improvements and mitigates operational vulnerabilities. Respond to and resolve emergent service problems. Design solutions using automation and self-repair rather than relying on alarming and human intervention

Qualifications

• Pursuing a Bachelor's degree or relevant work experience in Computer Science, Mathematics, Electrical Engineering or related technical discipline.
• 5-7 years experience developing software in a professional environment (preferably financial services but not required)
• Exposure to Docker/Containers, microservices, distributed systems architecture, Kubernetes, and cloud computing preferably Azure.
• Comfortable with core programming concepts and techniques (e.g. concurrency, memory management)
• ETL tooling like Airflow and Databricks.
• Experience in supporting API Gateways and building and consuming REST APIs along with other distribution technologies.
• Familiarity with Financial Systems architecture/ecosystems, Real Time Market Data messaging and FIX Protocol a huge plus.
• Foundational knowledge of data structures, algorithms, and designing for performance.
• Competent in one of the following programming languages: Java, C# or Python (preferred) and willingness to learn and adopt new languages as necessary
• Experience in database technology like MSSQL and one of key value and document databases like MongoDb, Redis, Dynamo Db, Casandra.
• Monitoring/Observability concepts and tooling: APM, Distributed Tracing, Grafana, Splunk, Prometheus.
• Excellent communications skills and the ability to work with subject matter expert to extract critical business concepts.
• Ability to work and potentially lead in an Agile methodology environment.

Employment Type: FULL_TIME