Address
Form of work Gorilla Logic provides nearshore Agile teams to Fortune 500 and SMB companies, bringing unparalleled expertise in the delivery of full-stack web, mobile, and enterprise applications. Our highly collaborative Agile Gorillas are uniquely qualified to implement complex software initiatives. With offices in the United States, Costa Rica, Colombia and Mexico, Gorilla Logic helps clients gain competitive advantages to achieve results faster.
Senior Data Engineer (Java/Spark/GCP)
Gorilla Logic is looking for a senior engineer where you will play a crucial role in designing, implementing, and maintaining our client's data architecture, ensuring the availability and reliability of data for analysis and business decision making. The ideal candidate is passionate about data, possesses strong technical skills, and has experience developing scalable data solutions. But your real success will be measured by how well you couple critical thinking with self-motivation, enthusiasm, and determination.
Responsibilities
*Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions.
* Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to storage and analysis destinations.
* Develop and implement data models that support the organization's analytical and reporting needs, ensuring data integrity and optimal performance.
* Integrate data from different sources, such as databases, APIs, and external systems, to create a unified and consistent view for analysis
* Implement data quality management by implementing processes and tools to ensure the quality and reliability of data being collected and stored
* Optimizing data infrastructure and processes for performance and scalability, ensuring timely and efficient data retrieval and processing, and handle growing amounts of data
* Implementation of security measures to protect sensitive data and ensure compliance with data privacy regulations
* Work closely with data scientist, analyst, and other stakeholder to understand data requirements to collect and prepare data for analysis, and provide the necessary infrastructure
* Document data engineering processes, data flows, and system architecture to ensure transparency and ease of maintenance
* Experience defining, building, and maintaining KPI, analytics, reporting and dashboards
Technical Requirements
* Bachelor's degree in computer science, Engineering, or related field
* 5+ years of experience as a data engineer building out analytic systems and solutions
* 5+ years of Java/Spring programming experience
* 2+ years of experience with Google Cloud Platform and their data services
* Proficient in SQL and database systems (PostgreSQL)
* Experience with Elasticsearch
* Experience working with Google BigQuery data warehouse
* Experience implementing pub/sub systems (Apache Kafka and RabbitMQ)
* Experience with ETL tools and data integration processes
* Familiar with Apache Spark and Apache Airflow
* API integrations with social media platforms
* Prior experience working with large datasets
* Excellent problem-solving and communication skills
Bonus Skills
* Experience with JSON data formats
* Familiar with DSP reporting for ad campaigns
* API integrations with 3rd party services (Facebook and Google Ads)
Apply for this job
