DevOps Engineer Job in Cape Town
Job Description
DevOps Engineer Job. Introducing the DevOps Engineer role, a crucial position in modern software development environments. This role focuses on streamlining the integration and deployment processes, ensuring seamless collaboration between development and operations teams. As a DevOps Engineer, the responsibilities include automating infrastructure, optimizing system performance, and implementing continuous integration/continuous deployment (CI/CD) pipelines. Joining this role at First Rand offers the opportunity to play a pivotal part in enhancing the efficiency and reliability of software delivery pipelines.
Responsibilities of DevOps Engineer Job
- Deploy, and configure, Cloudera Dataflow (CDF) platforms with required components like Kafka, Nifi, Schema registry, Nifi Registry, etc.
- Cluster expansion and management, Access Management, performance tuning, capacity planning, security, monitoring, and alerting CDF clusters.
- Collaborate with data engineers to optimize and troubleshoot data flows in CDF, especially on Nifi, and Kafka.
- Implement and maintain security policies and access controls for CDF environments using Kerberos, and Ranger.
- Creating alerts and dashboards utilizing different application, and infrastructure monitoring tools such as Grafana, Splunk, etc.
- Troubleshoot and resolve issues related to CDF.
- Creating tickets/cases with the Cloudera vendor for support and resolution of the issues.
- Perform routine maintenance tasks, including backups, updates, and patch management for both platforms.
- Collaborate with cross-functional teams to understand and address business requirements.
- Provide support to users on CDF tools and best practices.
- DevOps – Infrastructure orchestration using Manual/Scripts. Identify and implement opportunities for automation. Resolve infrastructure and application security vulnerabilities.
Requirements
- Experience with Cloudera CDF platforms and cluster management.
- Proven experience as a Cloudera Administrator and Dataflow Administrator.
- In-depth knowledge of Cloudera Manager, Ranger, Spark, Apache Nifi, Kafka Schema Registry, and other components.
- Strong Experience with Linux system administration and shell scripting.
- Good understanding of CDF.
- Knowledge of cloud platforms such as AWS, Azure, and GCP is a plus.
- Excellent problem-solving and communication skills.
- Understand Microsoft Active Directory.
- Knowledge of how to use TLS/SSL to enforce secure encrypted connections.
