We are looking for a mid level or senior Data Operations Engineer to collaborate both with clients and internal departments to perform projects and maintenance on various data pipelines, data sets, and data products
Responsibilities
* Ensure the consistency and quality of data within the platform.
* Monitor the system for anomalies or missing data and take corrective action.
* Assist with the development of tools to verify data accuracy and integrity.
* Contribute to the maintenance and incremental enhancement of the company's market data aggregation platform as needed.
* Participate in the process of ingesting, cleaning, and normalizing data from multiple sources.
* Support continuous improvements in system architecture and the development process to optimize platform performance.
Minimum Qualification
* Bachelors degree or equivalent experience in a quantitative field such as Computer Science, Mathematics, Statistics, Economics, or Finance
* Strong Python and/or any other scripting language
* Proficient in SQL/NoSQL and working with large-scale databases
* Comfortable working in Linux environment
* Exposure to public cloud computing
* Willingness to engage in a role that requires a balance of development and support tasks
* Strong communication skills (written and oral)* Experience with Git
Preferred Qualifications
* 2+ years of experience with data science packages like Pandas, Numpy, and Matplotlib
* 2+ years of experience scripting in a Linux environment (Python, Bash, Fish, Zsh, etc.)
* Experience with complex data structures, point in time data structures, temporal data
* Experience with Data Warehouse/Data Lake and OLTP data processing
* Experience working with financial data (Bloomberg, Refinitiv, Factset, S&P etc)
* Experience working with big data technologies like Spark
** Experience building and optimizing ETL pipelines
* Knowledge of Quantitative Analysis
Job Type: Full-time
Pay: $135,000.00 - $185,000.00 per year
Benefits:
- 401(k)
- 401(k) matching
- Dental insurance
- Flexible spending account
- Health insurance
- Health savings account
- Life insurance
- Paid time off
- Vision insurance
Compensation package:
- Yearly pay
Experience level:
- 2 years
Schedule:
- 8 hour shift
- Monday to Friday
Ability to Relocate:
- New York, NY 10017: Relocate before starting work (Required)
Work Location: In person