Address
Form of workJob Description
This REMOTE DATA ENGINEER Position Features:
• Full Benefits: Dental, Health and Vision
• 401k Matching
• PTO and Extended Leave
• Great Pay up to $130K
Design, build, maintain, and optimize large scale data processing, and reporting modules on cloud and on-premise using combination of PostgreSQL, Elasticsearch databases, Spark, Data Lake and Event Driven solutions. Solid experience designing and developing high performance systems using big data processing & querying tools including PostgreSQL.
The right candidate will need to have professional knowledge of developing ETL pipelines which involves Postgres, SQL queries, pgPL/SQL, python scripts, Spark, Data Lake & Airflow. It is preferred to understand multi-language text data match processes (Transliteration, Translation and Fuzzy Match).
• Design, develop and maintain high performance complex data processing & querying logic on RDBMS and Data Lake.
• Participate in various requirements sessions with internal teammates and convert business / functional requirements into technical solutions, along with supporting materials such as use cases, designs, flowcharts, models, specifications, and reports.
• Provide technical support to requirements, development, and testing.
• Work directly with Project Management, Business Intelligence and Data Engineering to develop end-user training and reference materials.
• Draft standards and procedures affecting data analysis and process modeling, as well as large scale data design & processing, maintenance, and management.
• Support initiatives related to scalability and performance.
• Conduct performance tuning reviews for improvements and prepare written reports of findings, including recommendations.
• Have experience working with GitLab and being able to build and implement CI/CD pipelines for continues development on different stages (dev, QA, production).
Basic Qualifications
· 8+ years database developer experience on Postgres or Oracle. Including SQL, stored procedures using pgpl/sql or pl/sql programing languages
· 5+ years doing ETL processes. It will be a big plus doing it in a cloud environment specifically on AWS.
· 4+ years DATA ENGINEERing experience specifically using Spark, scala or pyspark
· 4+ python development
· 4+ years development experience on AWS environment(RDS, Lambda, Step functions, Kinesis, Athena, …)
· 4+ years working in an Object-Oriented programming language(Java, C, C++, …).
· Must have Linux/Unix OS working experience.
· Must have containerized development experience.
· Must have CI/CD automated deployment experience.
· Must have experience with performance tuning and optimization in a PostgreSQL or Oracle.
· It is a plus to have Elasticsearch index build and querying experience.
· It is a plus to have Databricks working experience.
· It is plus to understand how web-based applications work.
· Confident and proactive self-starter, skilled in taking initiative, assessing requirements, coming up with plans, and taking the lead in making plans reality.
· Advanced knowledge of decision and intelligence systems concepts working with a big data/data lake, and database structures such as normalization, datamarts, fact tables, dimensions, views, indexing, and partitions.
#1091
AppleOne is proud to be an Equal Opportunity Employer. We believe in people, and we are committed to working with people of all backgrounds and connecting them with clients and companies who share our goals of diversity and inclusiveness. All qualified applicants will receive consideration for employment without regard to race, religion, ancestry, color, national origin, age, gender identity or expression, genetic information, marital status, medical condition, disability, protected veteran status, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable federal, state, or local laws.
The Know Your Rights poster is available here:
https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12.pdf
The pay transparency policy is available here:
https://www.dol.gov/sites/dolgov/files/ofccp/pdf/pay-transp_%20English_formattedESQA508c.pdf
For temporary assignments lasting 13 weeks or longer, the Company is pleased to offer major medical, dental, vision, 401k and any statutory sick pay where required.
We are committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please contact your staffing representative who will reach out to our HR team.
AppleOne participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program.
https://e-verify.uscis.gov/web/media/resourcesContents/E-Verify_Participation_Poster_ES.pdf
Company Description• Full Benefits: Dental, Health and Vision
• 401k Matching
• PTO and Extended Leave
• Great Pay up to $130K
Design, build, maintain, and optimize large scale data processing, and reporting modules on cloud and on-premise using combination of PostgreSQL, Elasticsearch databases, Spark, Data Lake and Event Driven solutions. Solid experience designing and developing high performance systems using big data processing & querying tools including PostgreSQL.
The right candidate will need to have professional knowledge of developing ETL pipelines which involves Postgres, SQL queries, pgPL/SQL, python scripts, Spark, Data Lake & Airflow. It is preferred to understand multi-language text data match processes (Transliteration, Translation and Fuzzy Match).
• Design, develop and maintain high performance complex data processing & querying logic on RDBMS and Data Lake.
• Participate in various requirements sessions with internal teammates and convert business / functional requirements into technical solutions, along with supporting materials such as use cases, designs, flowcharts, models, specifications, and reports.
• Provide technical support to requirements, development, and testing.
• Work directly with Project Management, Business Intelligence and Data Engineering to develop end-user training and reference materials.
• Draft standards and procedures affecting data analysis and process modeling, as well as large scale data design & processing, maintenance, and management.
• Support initiatives related to scalability and performance.
• Conduct performance tuning reviews for improvements and prepare written reports of findings, including recommendations.
• Have experience working with GitLab and being able to build and implement CI/CD pipelines for continues development on different stages (dev, QA, production).
Basic Qualifications
· 8+ years database developer experience on Postgres or Oracle. Including SQL, stored procedures using pgpl/sql or pl/sql programing languages
· 5+ years doing ETL processes. It will be a big plus doing it in a cloud environment specifically on AWS.
· 4+ years DATA ENGINEERing experience specifically using Spark, scala or pyspark
· 4+ python development
· 4+ years development experience on AWS environment(RDS, Lambda, Step functions, Kinesis, Athena, …)
· 4+ years working in an Object-Oriented programming language(Java, C, C++, …).
· Must have Linux/Unix OS working experience.
· Must have containerized development experience.
· Must have CI/CD automated deployment experience.
· Must have experience with performance tuning and optimization in a PostgreSQL or Oracle.
· It is a plus to have Elasticsearch index build and querying experience.
· It is a plus to have Databricks working experience.
· It is plus to understand how web-based applications work.
· Confident and proactive self-starter, skilled in taking initiative, assessing requirements, coming up with plans, and taking the lead in making plans reality.
· Advanced knowledge of decision and intelligence systems concepts working with a big data/data lake, and database structures such as normalization, datamarts, fact tables, dimensions, views, indexing, and partitions.
#1091
AppleOne is proud to be an Equal Opportunity Employer. We believe in people, and we are committed to working with people of all backgrounds and connecting them with clients and companies who share our goals of diversity and inclusiveness. All qualified applicants will receive consideration for employment without regard to race, religion, ancestry, color, national origin, age, gender identity or expression, genetic information, marital status, medical condition, disability, protected veteran status, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable federal, state, or local laws.
The Know Your Rights poster is available here:
https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12.pdf
The pay transparency policy is available here:
https://www.dol.gov/sites/dolgov/files/ofccp/pdf/pay-transp_%20English_formattedESQA508c.pdf
For temporary assignments lasting 13 weeks or longer, the Company is pleased to offer major medical, dental, vision, 401k and any statutory sick pay where required.
We are committed to working with and providing reasonable accommodations to individuals with disabilities. If you need a reasonable accommodation for any part of the employment process, please contact your staffing representative who will reach out to our HR team.
AppleOne participates in the E-Verify program in certain locations as required by law. Learn more about the E-Verify program.
https://e-verify.uscis.gov/web/media/resourcesContents/E-Verify_Participation_Poster_ES.pdf
Founder and CEO, Janice Bryant Howroyd, is a North Carolina native who left her hometown in 1976 armed with $1500. Since then, she has dedicated her efforts to building an organization that is committed to keeping the humanity in Human Resources and Strategic, Inclusive Procurement.
Mrs. Howroyd’s commitment to excellence has grown ActOne Group to 33 countries, with over 17,000 clients and more than 2,800 employees. The largest woman-minority-owned workforce management company founded in the US, ActOne Group professionals bring expertise in delivering corporate HR initiatives to local and global markets.
Mrs. Howroyd was selected by former President Barack Obama to serve as a White House appointee and continues to serve under the current administration as an Ambassador of Energy. Mrs. Howroyd gives generously through funding and advocacy for STEM education, particularly for women and minorities.
Mrs. Howroyd leads her teams to build business success based on the ability to connect great companies with outstanding talent. Her passion for education, mentorship, and self-empowerment initiatives have earned her many professional and philanthropic recognitions. She is a sought–after speaker and media subject matter expert in her fields. Her book, The Art of Work: How to Make Work, Work for You, is available on Amazon.com.
Mrs. Howroyd’s commitment to excellence has grown ActOne Group to 33 countries, with over 17,000 clients and more than 2,800 employees. The largest woman-minority-owned workforce management company founded in the US, ActOne Group professionals bring expertise in delivering corporate HR initiatives to local and global markets.
Mrs. Howroyd was selected by former President Barack Obama to serve as a White House appointee and continues to serve under the current administration as an Ambassador of Energy. Mrs. Howroyd gives generously through funding and advocacy for STEM education, particularly for women and minorities.
Mrs. Howroyd leads her teams to build business success based on the ability to connect great companies with outstanding talent. Her passion for education, mentorship, and self-empowerment initiatives have earned her many professional and philanthropic recognitions. She is a sought–after speaker and media subject matter expert in her fields. Her book, The Art of Work: How to Make Work, Work for You, is available on Amazon.com.
