Data Engineer - Data Bricks Developer

Job Role: (Data Engineer) Data bricks developer

Location: Remote

Role Description

A Data bricks developer to design, develop, and maintain Data bricks pipelines

Required Skills

5+ years of managing and administering the Databricks environment, including clusters, workspaces, and notebooks, to ensure optimal performance, reliability, and scalability.

Write clean, modular Python code for data processing, orchestration, automation, and integration with internal and external systems.

Implement and tune Spark jobs for performance, reliability, and cost-efficiency, including partitioning, caching, and cluster configuration.

Admin capabilities to setup infrastructure in cost effective way.

Configure and optimize Databricks clusters and resources based on workload requirements and best practices.

Monitor system performance, resource utilization, and availability using Databricks monitoring and logging tools. Preferably Dynatrace.

Troubleshoot and resolve issues related to Databricks infrastructure, security, and integration with other systems.

Implement and enforce security best practices to protect data and resources in the Databricks environment, including authentication, authorization, encryption, and data governance.

Thanks & Regards,

Shilpa

US IT Recruiter

TekLeaders Inc

5151 Headquarters Dr. Suite 105

Plano TX 75024

Mob:

Email:

tekleaders.com

Apply Now

Apply Now