Data Engineer I

Job Title: Senior Data Engineer

Reports to: Director of Technology

Location: Nashville, TN

Position Summary:

AgriCapture is a mission-driven company that certifies Climate-Friendly practices on farms, ranchlands and grasslands and quantifies associated emissions reductions, enabling producers to generate revenue for their sustainable management practices. By certifying agricultural products as Climate-Friendly and developing carbon credits, we serve corporations who are reducing and offsetting their GHG emissions while empowering consumers to consciously select Climate-Friendly products. AgriCapture was recently awarded a $7.5 million grant from the USDA to build a market for Climate-Friendly commodities.

As the Senior Data Engineer, you will function as an expert in developing a variety of proprietary systems and data pipelines that support climate friendly agricultural practice adoption and carbon credit issuance. In this role, you will work close to the business and IT leadership in the design and development of agile data architectures that evolve as new trends emerge. Your expertise will be a vital piece to the company and its mission and greater purpose. This will be a dynamic, fast-paced position providing a unique opportunity to be a part of a growing company that is poised to have a positive environmental impact.

Objectives of the Role

• Build data tools and systems that scale and leverage AgriCapture's core competency and competitive advantage.
• Apply conceptual knowledge of business processes and technology to solve complex business processes and procedural problems.
• Serves as a technical advisor and a subject matter expert to internal and external staff who perform development and IT related functions.
• Work with Product and Business Analysis in transforming business requirements into actions that create value.
• Proven history to acquire, scale and lead with data.
• Participate in multiple projects simultaneously adapting to priorities and thriving in a flexible and dynamic environment.

Responsibilities

• Proficient working with large, complex data sets, with data lake and warehouse in cloud environments.
• Uses industry best practice, proactively analyzes existing software architecture and new development to improve data quality.
• Develop and maintain data models for agriculture practice solutions. Provide technical expertise and recommendations in assessing new software projects and initiatives.
• Work with Business Analysts to validate processes of test / use cases and then optimizes data load jobs to improve performance and automation.
• Proficient in creating, maintaining, and auditing data pipelines using cloud services.
• Monitor and troubleshoot data pipeline performance, efficiency, and accuracy.
• Work with the analysts developing the requirements of the data warehouse solution.
• Provide clear analysis and written documentation including validation and test plans for the development of data modeling projects.
• Create solutions to improve the performance and availability of self-service analytics.
• Lead project efforts, ensuring project requirements and timelines are met and may guide, mentor, and oversee the work of other technical staff.

Skills and Qualifications

• 3+ years of experience building robust data pipelines on cloud platform (Azure) for both structured and unstructured data. Familiarity with Azure and its suite of data, analytic and cloud services.
• 4+ years of experience in programming in Python & T-SQL. Proficient in software development lifecycle and software engineering practices.
• Proficient in understanding and incorporating software engineering principles in design & development process. Experienced in designing and developing scalable systems using object-oriented principles and functional programming.
• Hands-on experience in building, maintaining, and owning tools and applications which have been used by multiple teams across the organization.
• Experience with data ingestion and manipulation of multiple varieties (JSON, Apache Parquet, CSV, etc..) using various ETL tools to connect warehouse services within cloud ecosystem.
• Demonstrates ability to understand complex ETL processes. Familiarity with design and development of ETL processes using Azure DataFactory and Azure Data Lake.
• Significant experience with version control practices and exposure to CI/CD tools and principles.
• Skilled at writing, testing, debugging new and existing code based on program area knowledge, conceptual and technical design specifications.
• Familiarity with REST APIs and building REST based applications.
• Strong interpersonal and communication skills, with the ability to collaborate effectively across diverse teams.
• You have a sustained track record of making significant self-directed and end-to-end contributions to impactful software or Data Engineering projects, understanding the why' behind software initiatives and own development throughout a project's lifecycle.

Nice to have:

• Experience with API and microservice development using Flask/FastAPI frameworks and familiarity with containerization technologies (docker, Kubernetes).
• Understanding of data science and machine learning workflows.
• Prior experience working with geospatial data and/or working in agriculture technology.
• Professional experience building and maintaining solutions with Data Orchestration tools (Airflow, Prefect, Dagster, etc).
• Strong understanding of designing and implementing CI/CD pipelines for the integration and deployment of software solutions.

Benefits

• 100% of employee medical premiums company paid
• Employer HSA contribution
• Coverage for Dental, Vision, Disability, and Life Insurance
• Identity Theft and Prepaid Legal coverage options available
• Time away: Flexible PTO and paid holidays
• Parental Leave
• 401k with company match
• Allowance for office equipment
• Monthly happy hours, weekly lunch cateringand office snacks and drinks

AgriCapture is committed to creating a diverse environment and is proud to be an equal-opportunity employer. AgriCapture recruits, employs, trains, compensates, and promotes regardless of race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.