Job Description
Skills : Data Engineer, Python, AWS, Pyspark
Wilmington, DE
Fulltime
Job description :
- Function as integrators between business needs and technology solutions, helping to create technology solutions to meet clients' business needs.
- Categorizing, cataloging, cleansing and normalizing of datasets.
- Providing users access to datasets using REST and Python APIs.
- Extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS technologies.
- Communicating with business users and technology stakeholders.
- Self-starter and critical thinker, takes ownership of own projects and makes improvement suggestions for the entire infrastructure.
- Other: Elastic stack, RESTful APIs, Node.js.
- Big data tools: Hadoop, Spark, Presto, Kafka, etc.
- Object-oriented languages: Java, C++, etc.
- Excellent self-management and problem-solving skills.
- Proficiency in Python and data analysis libraries (Pandas, NumPy, SciPy).