Responsibilities

• Install, configure, and maintain Databricks clusters and workspaces.
• Monitor cluster performance, resource utilization, and troubleshoot issues to ensure optimal performance.
• Implement and manage access controls and security policies to protect sensitive data.
• Perform regular software updates and patches.
• Optimize cluster configurations for performance and cost-effectiveness.
• Implement and enforce security policies, access controls, and encryption mechanisms.
• Stay up-to-date with security best practices and compliance requirements.
• Develop and maintain backup and disaster recovery strategies to ensure data integrity and availability.
• Collaborate with data engineers to integrate Databricks with other data sources, data warehouses, and data lakes.
• Maintain detailed documentation of configurations, procedures, and best practices.
• Collaborate with cross...