Big Data Developer

About Wipro:

Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. We leverage our holistic portfolio of capabilities in consulting, design, engineering, operations, and emerging technologies to help clients realize their boldest ambitions and build future-ready, sustainable businesses. A company recognized globally for its comprehensive portfolio of services, strong commitment to sustainability and good corporate citizenship, we have over 250,000 dedicated employees serving clients across 66 countries. We deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world.

• A PROUD HISTORY OF OVER 75 YEARS
• FY22 REVENUE 10.4 BN USD
• WE’RE PRESENT IN 66 COUNTRIES
• OVER 1,400 ACTIVE GLOBAL CLIENTS

Position: Big Data Developer

Location: Houston, TX (Onsite only)

Job description :

As a Big Data Developer within our technology team, you'll be instrumental in building, maintaining, and optimizing Big Data platforms and solutions. Leveraging the Cloudera suite, you will craft robust, scalable data processing pipelines and contribute to the development of our data-centric applications using cutting-edge technologies.

Key Responsibilities:

• Design and develop Big Data applications using Cloudera suite components like Kafka, HDFS, HBASE, KUDU, Zookeeper, HIVE, and Impala.
• Write robust, efficient, and maintainable code in Java/Scala/Python, with a strong emphasis on Spark and Flink for real-time data processing.
• Develop and maintain data pipelines using Apache NIFI, ensuring seamless data collection, ingestion, and distribution.
• Utilize Spring-Boot and Flask frameworks for creating microservices that interact with Big Data systems.
• Manage data workflows with Apache Oozie and orchestrate complex data processes with Apache Airflow.
• Implement solutions for data security and governance using Atlas, Ranger, RangerKMS, and KTS within Cloudera ecosystems.
• Work on cloud-native Big Data technologies, integrating solutions with cloud services for enhanced scalability and performance.
• Scripting and automation of routine tasks within Linux environments to enhance development and deployment processes.
• Optimize data retrieval with advanced HQL queries and tune performance for HIVE and Impala databases.
• Employ Kubernetes container orchestration for deployment, scaling, and operations of application containers across clusters of hosts.
• Ensure the development of high-quality applications by writing test cases and maintaining a continuous integration and deployment pipeline.
• Contribute to the architectural decisions and create documentation outlining design and technical specifications.
• Maintain a proactive approach to troubleshoot and resolve issues in the production environment.
• Engage with cross-functional teams to translate business requirements into technical implementations.
• Stay current with industry trends and evaluate new technologies for adoption into existing or new data infrastructure components.
• Run Data Engineering Jobs on GPUs using SPARK, tweak Jobs to utilize distributed GPUs.
• Design and implement security measures in the application development process, leveraging Kerberos authentication to secure communication within the cluster. Work closely with data administrators to ensure that all applications comply with established security protocols and access control measures. Develop scripts and automation tools to streamline the security aspects of the Big Data applications lifecycle.
• Implement and maintain the encryption standards for securing data-in-transit using TLS protocols to prevent eavesdropping, tampering, and forgery. Architect solutions that encrypt data-at-rest to safeguard sensitive information using industry-standard encryption algorithms and manage encryption keys with a focus on maintaining performance while enforcing data security. Regularly review and audit the code-base for compliance with data protection regulations and organizational policies.

Technical Qualifications:

• Advanced programming skills in Java/Scala/Python with a focus on Spark and Flink for large-scale data processing.
• Strong understanding of the Cloudera suite, including in-depth knowledge of data management and processing services.
• Proficient in building applications with Spring-Boot and Flask, with experience in creating RESTful services.
• Experience with scripting and automation in a Linux environment, along with expertise in shell scripting.
• In-depth knowledge of SQL, HQL, and the ability to perform query optimization on Big Data sets.
• Proficient in Kubernetes, including deploying applications in OpenShift or other Kubernetes environments.
• Familiarity with Neo4j or similar graph database technologies, and the ability to integrate them into Big Data solutions.
• Experience with Cloudera Data Services such as Cloudera Data Engineering, Cloudera Data Warehouse, and Cloudera Machine Learning is highly desirable.
• Experience in RAPIDS & GPU-Aware Scheduling.
• Knowledge of data modeling, data access, and data storage techniques for Big Data environments.
• Proficient in integrating Kerberos authentication within Big Data applications for secure access and communication with Big Data services. Capable of scripting and automation to manage Kerberos ticket lifecycles, renewals, and troubleshooting common Kerberos issues in a development environment.
• Skilled in implementing and managing security protocols for data in transit, including setting up and configuring TLS for secure data transfer within Big Data solutions. Knowledgeable in encryption standards and tools for encrypting data at rest, and understanding of key management systems and cryptographic practices to ensure data privacy and regulatory compliance.

Education:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.

Certifications:

• Cloudera Certified Professional (CCP) or any relevant Big Data certification is preferred.

Soft Skills:

• Strong analytical and problem-solving skills.
• Excellent verbal and written communication abilities.
• Collaborative team player with an ability to work in dynamic environments.
• Self-motivated with a keen interest in technology and continuous learning.

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, caste, creed, religion, gender, marital status, age, ethnic and national origin, gender identity, gender expres.

#LI-AK7

Computing