Data Engineer

Tekfortune is a fast-growing consulting firm specialized in permanent, contract & project-based staffing services for worlds leading organizations in a broad range of industries. In this quickly changing economic landscape, virtual recruiting and remote work are critical for the future of work. To support the active project demands and skills gaps, our staffing experts can help you find the best job for you.
Data Engineer
San Jose, CA (Remote)
Interview Process: 3 Rounds of Interview
Requirement:
Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in Scala and legacy ones on SQL (which require ongoing maintenance).
5 years experience building scalable Spark data pipelines (preferably using Scala)
3-5 years experience in high level programming languages such as Java, Scala, or Python
Proficiency in Spark/MapReduce development and expertise with data processing (ETL) technologies to build and deploy production-quality ETL pipelines
Good understanding of distributed storage and compute (S3, Hive, Spark)
Experience using ETL framework (ex: Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines
Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
Working knowledge of relational databases and expertise in query authoring (SQL) on large datasets
Experienced with big data technologies such as Hadoop, Spark, Hive, etc.
Experience working with Git and Jira (or other source control and task management tools)
For more information and other jobs available please contact our recruitment team at careers@tekfortune.com . To view all the jobs available in the USA and Asia please visit our website at https://www.tekfortune.com/careers/ .